-- Logs begin at Thu 2022-07-07 06:36:19 UTC, end at Thu 2022-07-07 07:41:16 UTC. -- Jul 07 07:05:47.979854 dv-cinder-826608-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 07 07:05:47.989003 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 07 07:05:47.991129 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 7 07:05:47 2022] *** Jul 07 07:05:47.991129 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 07 07:05:47.991129 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 07 07:05:47.991129 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: nodename: dv-cinder-826608-5-iscsi Jul 07 07:05:47.991129 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: machine: x86_64 Jul 07 07:05:47.991129 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: clock source: unix Jul 07 07:05:47.991129 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: pcre jit disabled Jul 07 07:05:47.991129 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: detected number of CPU cores: 4 Jul 07 07:05:47.991129 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: current working directory: / Jul 07 07:05:47.991129 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: detected binary path: /usr/bin/uwsgi-core Jul 07 07:05:47.991129 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: your processes number limit is 47680 Jul 07 07:05:47.991751 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: your memory page size is 4096 bytes Jul 07 07:05:47.991751 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: detected max file descriptor number: 2048 Jul 07 07:05:47.991751 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: lock engine: pthread robust mutexes Jul 07 07:05:47.991751 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: thunder lock: enabled Jul 07 07:05:47.991751 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 07 07:05:47.991751 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 07 07:05:48.036876 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: Python main interpreter initialized at 0x558aa089a9c0 Jul 07 07:05:48.036876 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: python threads support enabled Jul 07 07:05:48.036876 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: your server socket listen backlog is limited to 100 connections Jul 07 07:05:48.036876 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: your mercy for graceful operations on workers is 90 seconds Jul 07 07:05:48.037297 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: mapped 403077 bytes (393 KB) for 2 cores Jul 07 07:05:48.037297 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: *** Operational MODE: preforking *** Jul 07 07:05:48.037588 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: *** uWSGI is running in multiple interpreter mode *** Jul 07 07:05:48.037588 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: spawned uWSGI master process (pid: 80267) Jul 07 07:05:48.037807 dv-cinder-826608-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 07 07:05:48.038901 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: spawned uWSGI worker 1 (pid: 80277, cores: 1) Jul 07 07:05:48.038901 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: spawned uWSGI worker 2 (pid: 80278, cores: 1) Jul 07 07:05:48.038901 dv-cinder-826608-5-iscsi devstack@keystone.service[80267]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 07 07:05:53.463092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 07:05:53.463092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: from cryptography.utils import int_from_bytes Jul 07 07:05:53.463897 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 07:05:53.463897 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: from cryptography.utils import int_from_bytes Jul 07 07:05:53.463897 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 07:05:53.463897 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: from cryptography.utils import int_from_bytes Jul 07 07:05:53.464414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 07:05:53.464414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: from cryptography.utils import int_from_bytes Jul 07 07:05:53.512666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 07:05:53.512875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 07:05:53.512953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 07:05:53.513029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] command line args: [] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 07:05:53.513099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 07:05:53.513330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] command line args: [] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 07:05:53.513427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 07:05:53.513581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ================================================================================ {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 07:05:53.513709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 07:05:53.513886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] admin_token = **** {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.514003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ================================================================================ {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 07:05:53.514093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] admin_token = **** {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.514164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] config_dir = [] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.514229 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.514296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] config_dir = [] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.514442 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] config_source = [] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.514577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.514664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] debug = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.514736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] config_source = [] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.514800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.515032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] debug = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.515032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.515182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.515248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.515307 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.515484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.515579 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.515647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.515786 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.515867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.516042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] list_limit = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.516157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] list_limit = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.516241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] log_config_append = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.516304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] log_config_append = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.516367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.516430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.516573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] log_dir = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.516657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] log_dir = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.516729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] log_file = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.516802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] log_file = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.516913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.516993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.517173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.517285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.517415 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.517498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.517684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.517780 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.517842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.517919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.517989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.518057 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.518249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.518351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.518496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.518588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.518749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.518836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.518947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.519023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.519196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.519298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.519419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.519532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.519648 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.519740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.519899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.519998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.520168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.520255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.520663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.520753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.520838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] publish_errors = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.520913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] publish_errors = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.521036 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.521122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.521317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.521404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.521526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.521613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.521736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.521870 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.521990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.522104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.522189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] standard_threads = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.522355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] standard_threads = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.522433 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.522509 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.522631 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.522726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.522805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.522887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.522959 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] use_journal = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.523030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] use_journal = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.523099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] use_json = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.523174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] use_json = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.523276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] use_stderr = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.523368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] use_stderr = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.523443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] use_syslog = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.523512 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] use_syslog = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.523673 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.523754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:05:53.523929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.524021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.524163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.524243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.524429 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.524515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.524664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.524753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.524912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.524995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.525147 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.525241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.525436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.525531 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.525674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.525762 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.525929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.526016 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.526176 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.526268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.526428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.526511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.526661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.526742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.526903 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.526995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.527171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.527252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.527418 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.527505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.527650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.527811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.527887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.527963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.528129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.528213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.528384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.528662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.528761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.528877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.528959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.529113 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.529188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.529404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.529526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.529683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.529790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.529927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.530047 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.530179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.530291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.530410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.530526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.530640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.530761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.530869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.531000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.531104 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.531252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.531338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.531512 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.531591 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.531748 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.531825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.531982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.532059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.532235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.532314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.532485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.532561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.532719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.532802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.532971 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.533055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.533201 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.533289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.533459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.533538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.533692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.533765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.533911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.534081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.534162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.534234 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.534355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.534441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.534587 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.534701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.534829 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.534941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.535068 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.535191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.535303 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.535425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.535544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.535664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.535778 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.535895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.536040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.536147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.536244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.536338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.536480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.536592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.536696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.536791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.536936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.537083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.537175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.537311 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.537429 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.537541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.537685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.537766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.537898 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.537982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.538124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.538203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.538376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.538466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.538614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.538701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.538849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.538936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.539081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.539167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.539341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.539419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.539578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.539690 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.539794 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.539890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.540034 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.540116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.540267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.540348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.540532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.540613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.540770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.540858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.541017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.541133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.541284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.541368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.541524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.541656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.541757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.541843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.541990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.542067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.542236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.542321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.542472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.542590 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.542762 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.542866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.543010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.543194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.543274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.543443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.543521 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.543685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.543767 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.543916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.544000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.544150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.544236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.544387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.544465 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.544636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.544713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.544877 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.544956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.545112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.545198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.545411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.545487 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.545601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.545682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.545839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.545918 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.546073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.546160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.546308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.546387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.546538 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.546615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.546772 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.546849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.547010 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.547111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.547233 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.547319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.547466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.547588 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.547710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.547819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.547926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.548006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.548164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.548243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.548399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.548478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.548667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.548745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.548903 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.548994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.549136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] auth.external = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.549244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.549389 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.549467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] auth.external = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.549682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.549773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.549912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.550003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.550153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] auth.password = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.550279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.550382 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] auth.token = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.550461 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] auth.password = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.550620 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.550712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] auth.token = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.550857 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.550937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.551107 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.551185 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.551337 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.551423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.551581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.551660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.551824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.551902 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.552055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.552147 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.552290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.552368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] credential.caching = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.552528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] credential.caching = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.552608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.552775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.552861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.553023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.553102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.553281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.553364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.553534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.553625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.553760 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.553838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.553999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.554077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.554265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.554351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.554502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.554581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.554745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.554823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.555002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.555090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.555259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.555338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.555520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.555600 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.555759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.555845 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.556016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.556096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.556248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] federation.caching = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.556326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.556491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.556579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] federation.caching = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.556726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.556804 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.556972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.557052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.557203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.557308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.557468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.557547 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.557703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.557781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.557955 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.558042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.558189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.558268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.558472 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.558558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.558708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.558796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.558950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.559029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.559183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.caching = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.559260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.559434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.caching = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.559594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.559670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.559742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.559902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.560008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.560136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.560216 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.560373 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.560452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.560599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.560685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.560836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.560916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.561072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.561149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.561346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.561472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.561568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.561650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.561801 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.561881 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.562030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.562110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.562258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.562338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.562505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.562584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.562751 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.562829 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.562997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.563077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.563269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.563353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.563505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.563706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.563798 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.563872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.563964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.564035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.564196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.564277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.564433 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.564514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.564662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.564750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.564898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.564977 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.565131 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.565210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.565393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.565471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.565633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.565711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.565864 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.565944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.566106 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.566191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.566351 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.566430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.566586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.566667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.566825 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.566904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.567071 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.567149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.567303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.567392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.567538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.567617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.567766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.567844 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.567997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.568076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.568756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.568837 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.568910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.569052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.569146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.569311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.569393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.569554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.569633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.569802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.569899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.570055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.570135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.570293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.570374 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.570512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.570599 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.570765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.570845 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.571012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.571090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.571244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.571330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.571482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.571562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.571718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.571852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.571946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.572022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.572168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.572247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.572425 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.572501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.572653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.572731 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.572899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.572975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.573143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.573263 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.573414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.573494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.573649 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.573726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.573879 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.573955 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.574165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.574245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.574400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.574476 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.574632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.574707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.574861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.574939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.575107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.575184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.575354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.575430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.575599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.575676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.575844 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.575919 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.576088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.576163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.576315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.576404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.576564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.576640 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.576806 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.576881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.577039 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.577116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.577295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.577376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.577531 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.577609 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.577772 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.577852 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.578027 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.578102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.578253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.578329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.578508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.578586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.578741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.578817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.578985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.579067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.579217 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.579299 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.579451 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.579532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.579689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.579766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.579934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.580011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.580175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.580254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.580405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.580481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.580640 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.580716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.580875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] resource.caching = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.580951 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] resource.caching = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.581125 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.581199 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.581399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.581486 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.581633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.581710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.581882 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.581959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.582126 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.582203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.582360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.582436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.582604 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.582680 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.582830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.582902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.583062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.583141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.583292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] role.caching = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.583367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] role.caching = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.583546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] role.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.583625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] role.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.583774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.583850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.584020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.584101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.584266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.584344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.584510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.584586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.584758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.584841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.585009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.585085 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.585278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.585357 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.585523 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.585611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.585770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.585848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.586001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.586076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.586247 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.586330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.586493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.586577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.586736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.586812 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.586983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.587068 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.587382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.587463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.587615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.587692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.587864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.587948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.588110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.588186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.588357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.588432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.588606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.588690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.588839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.588915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.589086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.589162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.589361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.589464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.589638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.589716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.589872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.589949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.590111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.590189 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.590344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.590421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.590596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.590673 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.590853 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.590930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.591099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.591174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.591338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.591414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.591573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.591649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.591804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.591879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.592038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] token.caching = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.592113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] token.caching = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.592273 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.592349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.592516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.592591 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.592752 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.592827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.593009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.593086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.593276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.593356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.593517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.593593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.593761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.593882 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.594002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.594092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.594251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.594330 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.594483 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.594563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.594719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.594797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.594949 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.595027 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.595197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.595278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.595446 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.595525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.595675 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.595753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.595914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.595993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.596208 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.596286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.596464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.connection = **** {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.596551 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.connection = **** {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.596710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.596814 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.596953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.597038 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.597188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.597318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.597453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.597531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.597689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.597775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.597923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.598000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.598157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.598234 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.598393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.598479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.598642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.598719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.598875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.598951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.599112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.599197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.599344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.599421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.599591 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.599667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.599822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.599907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.600064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.600140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.600290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.600366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.600527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.600611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.600758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.600834 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:05:53.600926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 07:05:53.601002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 07:05:53.632366 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.632599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.632791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.632919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.633006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.633250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.641346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.641873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.669825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.669984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.670054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.670176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.817125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.817447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.865907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.866121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.866232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.866493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.930488 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.930656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.930730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.930810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.930897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.930962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.931022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.931096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.931243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.931401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.931401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.931651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.956117 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.956290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.956386 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.956467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.956531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.956603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.956767 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.956907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.956979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.957041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.957160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.957274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.957460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.957603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.968545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.968912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.981421 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.981610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.981930 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.982056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.982126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.982210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.982210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.982538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.982607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.982667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.982740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.982802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.982862 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:53.984135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 07:05:54.000630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.000854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 07 07:05:54.001013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.001147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.001277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 07 07:05:54.001358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 07 07:05:54.001570 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.001704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.001792 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 07 07:05:54.001889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.002001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.002091 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.002285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.002410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.002522 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.002802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.013549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.013814 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.013996 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.014122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.014295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.014451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.014523 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.014830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.023145 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.023416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.026564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.026817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.026915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.027180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.027279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.027491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.027619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.027782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.027915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.027990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.028088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.028294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.028437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.028551 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.028641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.028835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.028978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.029053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.029129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.029378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.029510 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.029602 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.056868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.057095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.058676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.058804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.058910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.058989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.064457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.064654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.064654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.064775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.065052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.065182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.075418 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.075640 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.075720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.075816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.080400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.080595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.080667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.080730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.080967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.081094 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.081248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.081393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.081543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.081670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.081761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.081829 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.082060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.082186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.082301 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.082407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.101549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.101770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.101844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.101907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.106627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.106792 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.110335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.110475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.110645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.110771 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.115932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.116097 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.119592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.119724 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.123342 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.123476 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.123624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.123758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.123933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.124079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.124234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.124359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.124509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.124635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.124788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.124927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.144473 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.144696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.144771 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.144833 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.145024 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.145149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.145253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.145322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.153443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.153659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.155139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.155304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.155384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.155455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.158618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.158799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.158893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.158958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.159155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.159282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.159411 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.159504 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.159716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.159854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.173136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.173312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.173403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.173489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.173702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.173842 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.173961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.174054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.174256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.174384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.174541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.174813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.176043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.176334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.194724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.194858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.198073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.198446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.201398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.202081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.202995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.203831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.204755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.205023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.205324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.205450 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.205739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.206026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.212647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.213480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.214284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.215121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.217584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.217869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.218165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.218421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.218545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.218676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.219092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.219367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.227679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.227962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.228236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.228548 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.228819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.229121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.236525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.236812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.237082 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.237372 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.237643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.237911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.238177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.238447 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.238822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.239115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.239443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.239723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.240007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.240279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.241084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 07:05:54.241725 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.242169 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.242657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.243103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.243693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.243985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.244267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.244543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.244829 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.245111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.245394 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.245664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.246093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 07:05:54.278563 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558aa089a9c0 pid: 80277 (default app) Jul 07 07:05:54.282115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1683e-47e5-43e2-b5c1-88627b8ff461 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:05:54.282419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1683e-47e5-43e2-b5c1-88627b8ff461 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:05:54.282702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1683e-47e5-43e2-b5c1-88627b8ff461 None None] PATH_INFO: `/v3` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:05:54.284149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558aa089a9c0 pid: 80278 (default app) Jul 07 07:05:54.287066 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Thu Jul 7 07:05:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:02.012319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b3f2a-e007-4254-8cbe-116376783c71 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:02.012930 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b3f2a-e007-4254-8cbe-116376783c71 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:02.012930 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b3f2a-e007-4254-8cbe-116376783c71 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:02.017898 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:02.024397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21250875-aa08-4ac5-bd08-c91e70619f63 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:02.025143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21250875-aa08-4ac5-bd08-c91e70619f63 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:02.025313 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21250875-aa08-4ac5-bd08-c91e70619f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:02.100099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: INFO dbcounter [None req-21250875-aa08-4ac5-bd08-c91e70619f63 None None] Registered counter for database keystone Jul 07 07:06:02.121944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG oslo_db.sqlalchemy.engines [None req-21250875-aa08-4ac5-bd08-c91e70619f63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:06:02.133012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writer thread running {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:06:02.332852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG passlib.handlers.bcrypt [None req-21250875-aa08-4ac5-bd08-c91e70619f63 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80277) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 07 07:06:02.333562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG passlib.handlers.bcrypt [None req-21250875-aa08-4ac5-bd08-c91e70619f63 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80277) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 07 07:06:02.396795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-21250875-aa08-4ac5-bd08-c91e70619f63 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:02.399521 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-21250875-aa08-4ac5-bd08-c91e70619f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:02.533490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 07 07:06:02.729794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b3f2a-e007-4254-8cbe-116376783c71 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:02.800306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: INFO dbcounter [None req-d05b3f2a-e007-4254-8cbe-116376783c71 None None] Registered counter for database keystone Jul 07 07:06:02.822623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG oslo_db.sqlalchemy.engines [None req-d05b3f2a-e007-4254-8cbe-116376783c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:06:02.834362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writer thread running {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:06:02.957776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b3f2a-e007-4254-8cbe-116376783c71 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:02.963383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2dae0-4563-4207-ae6e-3052b8b079f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:02.964051 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2dae0-4563-4207-ae6e-3052b8b079f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:02.964354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2dae0-4563-4207-ae6e-3052b8b079f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:02.964655 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2dae0-4563-4207-ae6e-3052b8b079f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:02.973904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2dae0-4563-4207-ae6e-3052b8b079f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:03.026154 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2ef2dae0-4563-4207-ae6e-3052b8b079f5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 07 07:06:03.026721 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2dae0-4563-4207-ae6e-3052b8b079f5 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:03.037133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Thu Jul 7 07:06:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:06:03.047140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21250875-aa08-4ac5-bd08-c91e70619f63 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:03.062934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21250875-aa08-4ac5-bd08-c91e70619f63 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:03.067919 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6533d-b5e2-44f0-92dc-0f42e6121709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:03.069500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6533d-b5e2-44f0-92dc-0f42e6121709 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:03.069765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6533d-b5e2-44f0-92dc-0f42e6121709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:03.070063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6533d-b5e2-44f0-92dc-0f42e6121709 admin admin] PATH_INFO: `/v3/projects/b5d565ccc8d74ff1978b89c064272f84` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:03.074292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6533d-b5e2-44f0-92dc-0f42e6121709 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d565ccc8d74ff1978b89c064272f84)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:03.125238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1fe6533d-b5e2-44f0-92dc-0f42e6121709 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 07 07:06:03.125608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6533d-b5e2-44f0-92dc-0f42e6121709 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:03.130345 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Thu Jul 7 07:06:03 2022] GET /identity/v3/projects/b5d565ccc8d74ff1978b89c064272f84 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:05.124742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52036e0f-adf7-4a99-b82d-e2151f381a75 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:05.125414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52036e0f-adf7-4a99-b82d-e2151f381a75 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:05.125414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52036e0f-adf7-4a99-b82d-e2151f381a75 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:05.129596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:05.139125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff476dd-8071-422a-86ac-5da46928d325 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:05.139583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff476dd-8071-422a-86ac-5da46928d325 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:05.139674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff476dd-8071-422a-86ac-5da46928d325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:05.169537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-7ff476dd-8071-422a-86ac-5da46928d325 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:05.171105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7ff476dd-8071-422a-86ac-5da46928d325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:05.181416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 07 07:06:05.205671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52036e0f-adf7-4a99-b82d-e2151f381a75 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:05.226474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52036e0f-adf7-4a99-b82d-e2151f381a75 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:05.232570 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195214b-9b30-49ca-b95b-29ad7f5bf4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:05.233211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195214b-9b30-49ca-b95b-29ad7f5bf4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:05.233532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195214b-9b30-49ca-b95b-29ad7f5bf4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:05.233813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195214b-9b30-49ca-b95b-29ad7f5bf4f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:05.242495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195214b-9b30-49ca-b95b-29ad7f5bf4f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:05.244318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195214b-9b30-49ca-b95b-29ad7f5bf4f9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:05.254247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Thu Jul 7 07:06:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:06:05.260181 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff476dd-8071-422a-86ac-5da46928d325 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:05.269991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff476dd-8071-422a-86ac-5da46928d325 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:05.275786 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d09c6c-ce29-48b4-9e28-1c2d5955ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:05.276674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d09c6c-ce29-48b4-9e28-1c2d5955ee6e admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:05.276960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d09c6c-ce29-48b4-9e28-1c2d5955ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:05.277265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d09c6c-ce29-48b4-9e28-1c2d5955ee6e admin admin] PATH_INFO: `/v3/users/a3aabddbd41c4280b0867d9e10f45bdf` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:05.278818 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d09c6c-ce29-48b4-9e28-1c2d5955ee6e admin admin] RBAC: Authorizing `identity:get_user(user_id=a3aabddbd41c4280b0867d9e10f45bdf)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:05.280689 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d09c6c-ce29-48b4-9e28-1c2d5955ee6e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:05.282386 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Thu Jul 7 07:06:05 2022] GET /identity/v3/users/a3aabddbd41c4280b0867d9e10f45bdf => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:07.385347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b5500-c8d2-48a1-b71d-eefbec2d503a None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:07.385891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b5500-c8d2-48a1-b71d-eefbec2d503a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:07.385891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b5500-c8d2-48a1-b71d-eefbec2d503a None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:07.387804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:07.393259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3c29b-0068-4a46-b433-ad8f9e370670 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:07.393744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3c29b-0068-4a46-b433-ad8f9e370670 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:07.393829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3c29b-0068-4a46-b433-ad8f9e370670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:07.405245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b2297-87a7-413f-8cf2-e7586904076f None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:07.405560 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b2297-87a7-413f-8cf2-e7586904076f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:07.405830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b2297-87a7-413f-8cf2-e7586904076f None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:07.407533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:06:07.411942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-6ae3c29b-0068-4a46-b433-ad8f9e370670 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:07.412344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24d8eb-abee-4049-9461-7d76d4b7d1af None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:07.412632 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24d8eb-abee-4049-9461-7d76d4b7d1af None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:07.412883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24d8eb-abee-4049-9461-7d76d4b7d1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:07.413134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6ae3c29b-0068-4a46-b433-ad8f9e370670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:07.453003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG passlib.handlers.bcrypt [None req-1d24d8eb-abee-4049-9461-7d76d4b7d1af None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80278) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 07 07:06:07.453446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG passlib.handlers.bcrypt [None req-1d24d8eb-abee-4049-9461-7d76d4b7d1af None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80278) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 07 07:06:07.496565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 6/12] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:07.498580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1d24d8eb-abee-4049-9461-7d76d4b7d1af None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:07.500188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1d24d8eb-abee-4049-9461-7d76d4b7d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:07.520434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3c29b-0068-4a46-b433-ad8f9e370670 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:07.547549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:07.602766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:07.628482 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24d8eb-abee-4049-9461-7d76d4b7d1af None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:07.632468 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3c29b-0068-4a46-b433-ad8f9e370670 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:07.667936 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1c2f1-333d-4a10-85e8-8b53ec9f4874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:07.668663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c2f1-333d-4a10-85e8-8b53ec9f4874 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:07.668948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c2f1-333d-4a10-85e8-8b53ec9f4874 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:07.669266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c2f1-333d-4a10-85e8-8b53ec9f4874 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:07.680982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1c2f1-333d-4a10-85e8-8b53ec9f4874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-bbf1c2f1-333d-4a10-85e8-8b53ec9f4874 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:07.692360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:07.693951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:07.694783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 7/14] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:07.700220 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1c2f1-333d-4a10-85e8-8b53ec9f4874 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:07.734454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24d8eb-abee-4049-9461-7d76d4b7d1af None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:07.736989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:07.780233 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b3e8a-a612-4fb3-abe6-ffd149be504e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:07.781169 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b3e8a-a612-4fb3-abe6-ffd149be504e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:07.781491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b3e8a-a612-4fb3-abe6-ffd149be504e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:07.781785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b3e8a-a612-4fb3-abe6-ffd149be504e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:07.788093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:07.807510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1c2f1-333d-4a10-85e8-8b53ec9f4874 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:07.845043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017964f-68b9-48c7-b60b-49282d906bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:07.845980 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017964f-68b9-48c7-b60b-49282d906bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:07.846263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017964f-68b9-48c7-b60b-49282d906bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:07.846543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017964f-68b9-48c7-b60b-49282d906bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:07.847311 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017964f-68b9-48c7-b60b-49282d906bf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:07.847687 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017964f-68b9-48c7-b60b-49282d906bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:07.849130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017964f-68b9-48c7-b60b-49282d906bf4 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:07.852067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b3e8a-a612-4fb3-abe6-ffd149be504e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:07.853638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b3e8a-a612-4fb3-abe6-ffd149be504e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:07.862063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 8/15] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:07.867616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017964f-68b9-48c7-b60b-49282d906bf4 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:07.960424 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 8/16] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 07:06:07.966193 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b3e8a-a612-4fb3-abe6-ffd149be504e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:07.968972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:07.972626 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017964f-68b9-48c7-b60b-49282d906bf4 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:08.013475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e149f-82b6-4cfe-bb4a-f57cae4ecfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:08.014396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e149f-82b6-4cfe-bb4a-f57cae4ecfea None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:08.014674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e149f-82b6-4cfe-bb4a-f57cae4ecfea None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:08.014973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e149f-82b6-4cfe-bb4a-f57cae4ecfea None admin] PATH_INFO: `/v3/users/a3aabddbd41c4280b0867d9e10f45bdf` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:08.016243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e149f-82b6-4cfe-bb4a-f57cae4ecfea None admin] RBAC: Authorizing `identity:get_user(user_id=a3aabddbd41c4280b0867d9e10f45bdf)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:08.017834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e149f-82b6-4cfe-bb4a-f57cae4ecfea None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:08.019542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 9/17] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:07 2022] GET /identity/v3/users/a3aabddbd41c4280b0867d9e10f45bdf => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:08.025280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e149f-82b6-4cfe-bb4a-f57cae4ecfea None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:08.040828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:08.068747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b3e8a-a612-4fb3-abe6-ffd149be504e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:08.103553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c939838-7a1f-4a80-ad10-7454fb89a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:08.104355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c939838-7a1f-4a80-ad10-7454fb89a791 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:08.104637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c939838-7a1f-4a80-ad10-7454fb89a791 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:08.105017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c939838-7a1f-4a80-ad10-7454fb89a791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:08.123779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c939838-7a1f-4a80-ad10-7454fb89a791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:08.125371 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c939838-7a1f-4a80-ad10-7454fb89a791 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:08.127755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e149f-82b6-4cfe-bb4a-f57cae4ecfea None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-9c939838-7a1f-4a80-ad10-7454fb89a791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:06:08.148669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:08.149588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:08.150375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:06:08.150375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:06:08.150375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:06:08.150375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:08.150375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 9/18] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:08.156080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c939838-7a1f-4a80-ad10-7454fb89a791 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:08.164176 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094bab8-e817-4ae0-bfe3-f2d6b45c3559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:08.164997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094bab8-e817-4ae0-bfe3-f2d6b45c3559 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:08.165313 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094bab8-e817-4ae0-bfe3-f2d6b45c3559 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:08.165683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094bab8-e817-4ae0-bfe3-f2d6b45c3559 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:08.166942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094bab8-e817-4ae0-bfe3-f2d6b45c3559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:08.168628 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094bab8-e817-4ae0-bfe3-f2d6b45c3559 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:08.170302 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 10/19] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:08.176310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094bab8-e817-4ae0-bfe3-f2d6b45c3559 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:08.218353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:08.259416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:08.262782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c939838-7a1f-4a80-ad10-7454fb89a791 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:08.279700 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094bab8-e817-4ae0-bfe3-f2d6b45c3559 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:08.299385 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3f027-271e-4310-b9c8-12631901bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:08.300099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f027-271e-4310-b9c8-12631901bda1 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:08.300385 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f027-271e-4310-b9c8-12631901bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:08.300664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f027-271e-4310-b9c8-12631901bda1 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:08.301458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3f027-271e-4310-b9c8-12631901bda1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:08.301782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3f027-271e-4310-b9c8-12631901bda1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:08.303277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3f027-271e-4310-b9c8-12631901bda1 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:08.319758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70159e7-d478-489e-968e-37db4da2e34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:08.320463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70159e7-d478-489e-968e-37db4da2e34e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:08.320757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70159e7-d478-489e-968e-37db4da2e34e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:08.321031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70159e7-d478-489e-968e-37db4da2e34e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:08.321939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70159e7-d478-489e-968e-37db4da2e34e None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.domain.id=default, user.id=a3aabddbd41c4280b0867d9e10f45bdf) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:08.322271 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70159e7-d478-489e-968e-37db4da2e34e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:08.323692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 10/20] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:08.323879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70159e7-d478-489e-968e-37db4da2e34e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:08.332676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 11/21] 10.222.0.62 () {56 vars in 1322 bytes} [Thu Jul 7 07:06:08 2022] GET /identity/v3/role_assignments?user.id=a3aabddbd41c4280b0867d9e10f45bdf&scope.domain.id=default&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:10.602940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c9ab1-8b92-4f22-bb93-8a440997931e None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:10.603983 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c9ab1-8b92-4f22-bb93-8a440997931e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:10.604484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c9ab1-8b92-4f22-bb93-8a440997931e None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:10.606251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 11/22] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:10.611888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b4855-e482-4b57-9d56-c54bdf99f41f None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:10.612722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b4855-e482-4b57-9d56-c54bdf99f41f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:10.613198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b4855-e482-4b57-9d56-c54bdf99f41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:10.633312 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-1d7b4855-e482-4b57-9d56-c54bdf99f41f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:10.634870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1d7b4855-e482-4b57-9d56-c54bdf99f41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:10.724852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 12/23] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:10.747231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268bfe7-6655-492d-8d87-c71a8d43fdf5 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:10.747833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268bfe7-6655-492d-8d87-c71a8d43fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:10.748337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268bfe7-6655-492d-8d87-c71a8d43fdf5 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:10.749983 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 12/24] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:10.759261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268bfe7-6655-492d-8d87-c71a8d43fdf5 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:10.763608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0c372-30db-4ff6-b35a-1dd8ce28dac0 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:10.764127 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0c372-30db-4ff6-b35a-1dd8ce28dac0 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:10.767541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0c372-30db-4ff6-b35a-1dd8ce28dac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:10.799264 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-adb0c372-30db-4ff6-b35a-1dd8ce28dac0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:10.800789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-adb0c372-30db-4ff6-b35a-1dd8ce28dac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:10.955946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 13/25] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:10.999365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268bfe7-6655-492d-8d87-c71a8d43fdf5 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:11.002819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0c372-30db-4ff6-b35a-1dd8ce28dac0 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:11.016001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:11.032075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:11.075380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58edfad-1c16-48aa-80d5-2f0dcc0d9e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:11.076200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58edfad-1c16-48aa-80d5-2f0dcc0d9e5e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:11.076484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58edfad-1c16-48aa-80d5-2f0dcc0d9e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:11.076761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58edfad-1c16-48aa-80d5-2f0dcc0d9e5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:11.101296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58edfad-1c16-48aa-80d5-2f0dcc0d9e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-a58edfad-1c16-48aa-80d5-2f0dcc0d9e5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:11.110540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:11.111418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:11.112127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 13/26] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:06:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:11.118221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58edfad-1c16-48aa-80d5-2f0dcc0d9e5e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:11.263771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0c372-30db-4ff6-b35a-1dd8ce28dac0 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:11.308149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58edfad-1c16-48aa-80d5-2f0dcc0d9e5e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:11.308880 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a59ac4-d113-4fe6-bf72-ce2dacd1723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:11.309701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a59ac4-d113-4fe6-bf72-ce2dacd1723a None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:11.310088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a59ac4-d113-4fe6-bf72-ce2dacd1723a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:11.310577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a59ac4-d113-4fe6-bf72-ce2dacd1723a None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:11.311595 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a59ac4-d113-4fe6-bf72-ce2dacd1723a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:11.313153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a59ac4-d113-4fe6-bf72-ce2dacd1723a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:11.355858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1ebd8-1a90-42e0-9f5b-ad6edf1d7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:11.357199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ebd8-1a90-42e0-9f5b-ad6edf1d7e0c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:11.357807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ebd8-1a90-42e0-9f5b-ad6edf1d7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:11.358252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ebd8-1a90-42e0-9f5b-ad6edf1d7e0c None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:11.359188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1ebd8-1a90-42e0-9f5b-ad6edf1d7e0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:11.359692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1ebd8-1a90-42e0-9f5b-ad6edf1d7e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:11.361486 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1ebd8-1a90-42e0-9f5b-ad6edf1d7e0c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:11.376124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 14/27] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:11.377993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac2331-4c76-4f3e-8477-781e9af0e271 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:11.378451 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac2331-4c76-4f3e-8477-781e9af0e271 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:11.378918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac2331-4c76-4f3e-8477-781e9af0e271 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:11.380859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 15/28] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:11.382336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bdab9-e6a7-462b-a8f8-3522f031d77a None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:11.382775 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bdab9-e6a7-462b-a8f8-3522f031d77a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:11.383205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bdab9-e6a7-462b-a8f8-3522f031d77a None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:11.384753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 16/29] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:11.386030 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bdab9-e6a7-462b-a8f8-3522f031d77a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:11.433343 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:11.465046 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 14/30] 10.222.0.62 () {60 vars in 1131 bytes} [Thu Jul 7 07:06:11 2022] POST /identity/v3/roles => generated 219 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:06:11.466736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c2045-dea8-4d8b-bd7b-3070afde53d5 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:11.467035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c2045-dea8-4d8b-bd7b-3070afde53d5 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:11.467344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c2045-dea8-4d8b-bd7b-3070afde53d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:11.485924 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-fa5c2045-dea8-4d8b-bd7b-3070afde53d5 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:11.487518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-fa5c2045-dea8-4d8b-bd7b-3070afde53d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:11.514304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bdab9-e6a7-462b-a8f8-3522f031d77a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:11.554550 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:11.562197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc249d8b-c23f-45c0-88ed-7c18ccd87859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:11.563425 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc249d8b-c23f-45c0-88ed-7c18ccd87859 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:11.563883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc249d8b-c23f-45c0-88ed-7c18ccd87859 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:11.564329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc249d8b-c23f-45c0-88ed-7c18ccd87859 None admin] PATH_INFO: `/v3/users/a3aabddbd41c4280b0867d9e10f45bdf` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:11.573243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc249d8b-c23f-45c0-88ed-7c18ccd87859 None admin] RBAC: Authorizing `identity:get_user(user_id=a3aabddbd41c4280b0867d9e10f45bdf)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:11.573408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 15/31] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:11.573525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc249d8b-c23f-45c0-88ed-7c18ccd87859 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:11.573611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa8e30-b55b-48a9-ab5c-35acf43b0a56 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:11.573611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa8e30-b55b-48a9-ab5c-35acf43b0a56 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:11.573611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa8e30-b55b-48a9-ab5c-35acf43b0a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:11.573874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 17/32] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:11 2022] GET /identity/v3/users/a3aabddbd41c4280b0867d9e10f45bdf => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:11.578247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc249d8b-c23f-45c0-88ed-7c18ccd87859 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:11.598703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-83aa8e30-b55b-48a9-ab5c-35acf43b0a56 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:11.600154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-83aa8e30-b55b-48a9-ab5c-35acf43b0a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:11.716630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 16/33] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:11.717501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa8e30-b55b-48a9-ab5c-35acf43b0a56 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:11.801286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc249d8b-c23f-45c0-88ed-7c18ccd87859 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:11.812059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:11.850004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ccc53-0d42-4b71-b391-7c6ea9194e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:11.851386 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ccc53-0d42-4b71-b391-7c6ea9194e04 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:11.851915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ccc53-0d42-4b71-b391-7c6ea9194e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:11.852367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ccc53-0d42-4b71-b391-7c6ea9194e04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:11.852655 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa8e30-b55b-48a9-ab5c-35acf43b0a56 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:11.854032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ccc53-0d42-4b71-b391-7c6ea9194e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:11.857417 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ccc53-0d42-4b71-b391-7c6ea9194e04 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:11.859412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 18/34] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:11.860436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ccc53-0d42-4b71-b391-7c6ea9194e04 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:11.890827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:11.908855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77237589-ebe5-423a-acce-e783ee6e7686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:11.909760 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77237589-ebe5-423a-acce-e783ee6e7686 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:11.910045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77237589-ebe5-423a-acce-e783ee6e7686 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:11.910321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77237589-ebe5-423a-acce-e783ee6e7686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:11.924507 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77237589-ebe5-423a-acce-e783ee6e7686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:11.926190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77237589-ebe5-423a-acce-e783ee6e7686 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-77237589-ebe5-423a-acce-e783ee6e7686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:06:11.952960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:11.953856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:11.954642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:06:11.954642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:06:11.954642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:06:11.954642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:11.959510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 17/35] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:11.959510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77237589-ebe5-423a-acce-e783ee6e7686 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:11.980103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ccc53-0d42-4b71-b391-7c6ea9194e04 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:12.017247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1d066-3d51-48ec-9e0c-32eaaa179a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:12.018128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1d066-3d51-48ec-9e0c-32eaaa179a15 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:12.018511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1d066-3d51-48ec-9e0c-32eaaa179a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:12.018888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1d066-3d51-48ec-9e0c-32eaaa179a15 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:12.019751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1d066-3d51-48ec-9e0c-32eaaa179a15 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:12.021393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1d066-3d51-48ec-9e0c-32eaaa179a15 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:12.093991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77237589-ebe5-423a-acce-e783ee6e7686 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:12.131126 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f91037-ae21-4ea3-ba78-e30130ffbd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:12.132124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f91037-ae21-4ea3-ba78-e30130ffbd09 None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:12.132461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f91037-ae21-4ea3-ba78-e30130ffbd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:12.132748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f91037-ae21-4ea3-ba78-e30130ffbd09 None admin] PATH_INFO: `/v3/domains/default/users/a3aabddbd41c4280b0867d9e10f45bdf/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:12.134789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f91037-ae21-4ea3-ba78-e30130ffbd09 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a3aabddbd41c4280b0867d9e10f45bdf, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:12.136291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f91037-ae21-4ea3-ba78-e30130ffbd09 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:12.155676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 18/36] 10.222.0.62 () {58 vars in 1361 bytes} [Thu Jul 7 07:06:11 2022] PUT /identity/v3/domains/default/users/a3aabddbd41c4280b0867d9e10f45bdf/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:06:12.157685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 19/37] 10.222.0.62 () {60 vars in 1131 bytes} [Thu Jul 7 07:06:11 2022] POST /identity/v3/roles => generated 225 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:06:12.162619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f91037-ae21-4ea3-ba78-e30130ffbd09 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:12.222904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:12.295236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea1160-5fbd-4682-b7b6-a45bb49f557c None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:12.295525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea1160-5fbd-4682-b7b6-a45bb49f557c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:12.295809 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea1160-5fbd-4682-b7b6-a45bb49f557c None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:12.297306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 20/38] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:12.298494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a950d-f099-4c2c-9ecf-fc1f1accc280 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:12.298842 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a950d-f099-4c2c-9ecf-fc1f1accc280 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:12.299133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a950d-f099-4c2c-9ecf-fc1f1accc280 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:12.300752 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 21/39] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:12.305571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f91037-ae21-4ea3-ba78-e30130ffbd09 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:12.311413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9249850-8d1b-4560-a4be-161716fc5090 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:12.311727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9249850-8d1b-4560-a4be-161716fc5090 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:12.312014 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9249850-8d1b-4560-a4be-161716fc5090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:12.336958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-c9249850-8d1b-4560-a4be-161716fc5090 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:12.340230 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c9249850-8d1b-4560-a4be-161716fc5090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:12.370719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d123dc-0309-43ce-80c8-6e855c998cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:12.372328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d123dc-0309-43ce-80c8-6e855c998cbe None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:12.372786 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d123dc-0309-43ce-80c8-6e855c998cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:12.373211 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d123dc-0309-43ce-80c8-6e855c998cbe None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:12.374460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d123dc-0309-43ce-80c8-6e855c998cbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:12.374917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d123dc-0309-43ce-80c8-6e855c998cbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:12.377143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d123dc-0309-43ce-80c8-6e855c998cbe None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:12.380717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:12.408578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 19/40] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:12.415457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258eb042-f514-4ff8-8724-358ffd524b78 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:12.415759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258eb042-f514-4ff8-8724-358ffd524b78 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:12.416053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258eb042-f514-4ff8-8724-358ffd524b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:12.457547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 22/41] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:12.458970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9249850-8d1b-4560-a4be-161716fc5090 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:12.570469 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9249850-8d1b-4560-a4be-161716fc5090 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:12.575150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-258eb042-f514-4ff8-8724-358ffd524b78 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:12.576395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-258eb042-f514-4ff8-8724-358ffd524b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:12.610467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f9aa4-c9e4-4ef2-820e-a4d7ee643838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:12.611530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f9aa4-c9e4-4ef2-820e-a4d7ee643838 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:12.611755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f9aa4-c9e4-4ef2-820e-a4d7ee643838 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:12.612016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f9aa4-c9e4-4ef2-820e-a4d7ee643838 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:12.612795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f9aa4-c9e4-4ef2-820e-a4d7ee643838 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:12.614495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f9aa4-c9e4-4ef2-820e-a4d7ee643838 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:12.646294 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 23/42] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:06:12 2022] POST /identity/v3/projects => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:06:12.647046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f9aa4-c9e4-4ef2-820e-a4d7ee643838 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:12.660375 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 20/43] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:12.669424 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:12.685573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258eb042-f514-4ff8-8724-358ffd524b78 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:12.726000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:12.796046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f9aa4-c9e4-4ef2-820e-a4d7ee643838 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:12.817058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258eb042-f514-4ff8-8724-358ffd524b78 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:12.844988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457b6dd-cfd0-4a09-813e-ac610972e50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:12.845741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457b6dd-cfd0-4a09-813e-ac610972e50e None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:12.846034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457b6dd-cfd0-4a09-813e-ac610972e50e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:12.846322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457b6dd-cfd0-4a09-813e-ac610972e50e None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:12.847091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457b6dd-cfd0-4a09-813e-ac610972e50e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:12.848509 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457b6dd-cfd0-4a09-813e-ac610972e50e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:12.863817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd809942-8afb-431f-a12c-8060b1d7aa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:12.864708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd809942-8afb-431f-a12c-8060b1d7aa06 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:12.864991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd809942-8afb-431f-a12c-8060b1d7aa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:12.866243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd809942-8afb-431f-a12c-8060b1d7aa06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:12.867166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 24/44] 10.222.0.62 () {60 vars in 1131 bytes} [Thu Jul 7 07:06:12 2022] POST /identity/v3/roles => generated 223 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:06:12.870204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd809942-8afb-431f-a12c-8060b1d7aa06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:12.870204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd809942-8afb-431f-a12c-8060b1d7aa06 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:12.871796 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 21/45] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:12.878380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457b6dd-cfd0-4a09-813e-ac610972e50e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:12.968730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:13.002934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457b6dd-cfd0-4a09-813e-ac610972e50e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:13.042880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534222b-4faf-4539-87bc-b7a74362fe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:13.043636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534222b-4faf-4539-87bc-b7a74362fe72 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:13.043792 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534222b-4faf-4539-87bc-b7a74362fe72 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:13.044116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534222b-4faf-4539-87bc-b7a74362fe72 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:13.044838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534222b-4faf-4539-87bc-b7a74362fe72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:13.046401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534222b-4faf-4539-87bc-b7a74362fe72 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:13.074585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 25/46] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:06:12 2022] POST /identity/v3/projects => generated 312 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:06:14.316784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fba21-85ea-4560-a8c9-61376c641990 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:14.317362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fba21-85ea-4560-a8c9-61376c641990 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:14.317362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fba21-85ea-4560-a8c9-61376c641990 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:14.319150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 22/47] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:14.324923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd24058-e715-44ac-ac7d-e7967baa56e6 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:14.325403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd24058-e715-44ac-ac7d-e7967baa56e6 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:14.325489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd24058-e715-44ac-ac7d-e7967baa56e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:14.342978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-cbd24058-e715-44ac-ac7d-e7967baa56e6 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:14.344184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cbd24058-e715-44ac-ac7d-e7967baa56e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:14.414691 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 26/48] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:14.438244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fba21-85ea-4560-a8c9-61376c641990 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:14.535919 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:14.544870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fba21-85ea-4560-a8c9-61376c641990 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:14.581257 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f65895-d90f-4f09-a145-0a3a3649b85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:14.582065 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f65895-d90f-4f09-a145-0a3a3649b85b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:14.582323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f65895-d90f-4f09-a145-0a3a3649b85b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:14.582601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f65895-d90f-4f09-a145-0a3a3649b85b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:14.593800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f65895-d90f-4f09-a145-0a3a3649b85b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-c4f65895-d90f-4f09-a145-0a3a3649b85b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:14.601557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:14.602384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:14.603258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 23/49] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:06:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:14.609027 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd24058-e715-44ac-ac7d-e7967baa56e6 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:14.669863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:14.712961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd24058-e715-44ac-ac7d-e7967baa56e6 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:14.748740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d64c96-9b3f-40d1-80b4-7cce11104a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:14.749458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64c96-9b3f-40d1-80b4-7cce11104a8f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:14.749747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64c96-9b3f-40d1-80b4-7cce11104a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:14.750030 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64c96-9b3f-40d1-80b4-7cce11104a8f None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:14.750792 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d64c96-9b3f-40d1-80b4-7cce11104a8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:14.751102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d64c96-9b3f-40d1-80b4-7cce11104a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:14.752474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d64c96-9b3f-40d1-80b4-7cce11104a8f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:14.761228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 27/50] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:14.766915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f65895-d90f-4f09-a145-0a3a3649b85b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:14.873641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f65895-d90f-4f09-a145-0a3a3649b85b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:14.908084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1ae93-326a-4419-bc22-c34a205e36df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:14.908964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1ae93-326a-4419-bc22-c34a205e36df None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:14.909251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1ae93-326a-4419-bc22-c34a205e36df None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:14.909548 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1ae93-326a-4419-bc22-c34a205e36df None admin] PATH_INFO: `/v3/users/a3aabddbd41c4280b0867d9e10f45bdf` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:14.910745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1ae93-326a-4419-bc22-c34a205e36df None admin] RBAC: Authorizing `identity:get_user(user_id=a3aabddbd41c4280b0867d9e10f45bdf)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:14.912231 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1ae93-326a-4419-bc22-c34a205e36df None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:14.913968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 24/51] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:14 2022] GET /identity/v3/users/a3aabddbd41c4280b0867d9e10f45bdf => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:14.919646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d64c96-9b3f-40d1-80b4-7cce11104a8f None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:15.116377 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96757ea3-c001-4a53-8b33-a022a08e353a None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:15.116668 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96757ea3-c001-4a53-8b33-a022a08e353a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:15.116955 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96757ea3-c001-4a53-8b33-a022a08e353a None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:15.118472 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 25/52] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:15.123775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445fe0b-99c7-4657-a335-35b2030c0342 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:15.123968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445fe0b-99c7-4657-a335-35b2030c0342 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:15.124281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445fe0b-99c7-4657-a335-35b2030c0342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:15.142048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d64c96-9b3f-40d1-80b4-7cce11104a8f None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:15.143006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-9445fe0b-99c7-4657-a335-35b2030c0342 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:15.144220 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9445fe0b-99c7-4657-a335-35b2030c0342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:15.160901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:15.166642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:15.181293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c11c1e-90ec-45f7-adde-8676a2b741d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:15.182110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c11c1e-90ec-45f7-adde-8676a2b741d9 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:15.182401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c11c1e-90ec-45f7-adde-8676a2b741d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:15.182679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c11c1e-90ec-45f7-adde-8676a2b741d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:15.184510 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c11c1e-90ec-45f7-adde-8676a2b741d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:15.187626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c11c1e-90ec-45f7-adde-8676a2b741d9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:15.189346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 28/53] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:15.195490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c11c1e-90ec-45f7-adde-8676a2b741d9 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:15.220874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 26/54] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:15.243815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445fe0b-99c7-4657-a335-35b2030c0342 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:15.297378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c11c1e-90ec-45f7-adde-8676a2b741d9 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:15.332698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecb4e5-9b8d-4f8f-961a-e313692aa4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:15.333442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecb4e5-9b8d-4f8f-961a-e313692aa4fc None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:15.333688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecb4e5-9b8d-4f8f-961a-e313692aa4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:15.333978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecb4e5-9b8d-4f8f-961a-e313692aa4fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:15.334828 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecb4e5-9b8d-4f8f-961a-e313692aa4fc None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.domain.id=default, user.id=a3aabddbd41c4280b0867d9e10f45bdf) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:15.335145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecb4e5-9b8d-4f8f-961a-e313692aa4fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:15.336624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecb4e5-9b8d-4f8f-961a-e313692aa4fc None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:15.346245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 29/55] 10.222.0.62 () {56 vars in 1322 bytes} [Thu Jul 7 07:06:15 2022] GET /identity/v3/role_assignments?user.id=a3aabddbd41c4280b0867d9e10f45bdf&scope.domain.id=default&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:15.346385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445fe0b-99c7-4657-a335-35b2030c0342 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:15.385611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f9703-80cc-464d-8821-4b4c788fdcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:15.386438 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f9703-80cc-464d-8821-4b4c788fdcef None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:15.386725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f9703-80cc-464d-8821-4b4c788fdcef None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:15.387006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f9703-80cc-464d-8821-4b4c788fdcef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:15.388354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f9703-80cc-464d-8821-4b4c788fdcef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:15.389925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f9703-80cc-464d-8821-4b4c788fdcef None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:15.391881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 27/56] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:15.397682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecb4e5-9b8d-4f8f-961a-e313692aa4fc None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:15.462266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:15.518745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecb4e5-9b8d-4f8f-961a-e313692aa4fc None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:15.554037 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ec85c-9abe-492e-82d1-8093ca800e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:15.554763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ec85c-9abe-492e-82d1-8093ca800e2c None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:15.555029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ec85c-9abe-492e-82d1-8093ca800e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:15.555334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ec85c-9abe-492e-82d1-8093ca800e2c None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:15.556060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ec85c-9abe-492e-82d1-8093ca800e2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:15.557561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ec85c-9abe-492e-82d1-8093ca800e2c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:15.583689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 30/57] 10.222.0.62 () {60 vars in 1140 bytes} [Thu Jul 7 07:06:15 2022] POST /identity/v3/projects => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:06:17.618338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a795a-e716-4151-a24b-c280829f9559 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:17.618878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a795a-e716-4151-a24b-c280829f9559 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:17.618878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a795a-e716-4151-a24b-c280829f9559 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:17.620482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 28/58] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:17.627394 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a73fe-dd12-4817-9fe3-323d8d26900c None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:17.628046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a73fe-dd12-4817-9fe3-323d8d26900c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:17.628373 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a73fe-dd12-4817-9fe3-323d8d26900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:17.655049 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-487a73fe-dd12-4817-9fe3-323d8d26900c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:17.656334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-487a73fe-dd12-4817-9fe3-323d8d26900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:17.726463 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 31/59] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:17.751856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a795a-e716-4151-a24b-c280829f9559 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:17.776016 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:17.866589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a795a-e716-4151-a24b-c280829f9559 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:17.908414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16432cac-1f3e-417e-bd27-c3aff44b05e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:17.909162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16432cac-1f3e-417e-bd27-c3aff44b05e0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:17.909482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16432cac-1f3e-417e-bd27-c3aff44b05e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:17.909763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16432cac-1f3e-417e-bd27-c3aff44b05e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:17.911029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16432cac-1f3e-417e-bd27-c3aff44b05e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:17.912509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16432cac-1f3e-417e-bd27-c3aff44b05e0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:17.914228 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 29/60] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:17.921016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a73fe-dd12-4817-9fe3-323d8d26900c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:17.974171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:18.045837 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a73fe-dd12-4817-9fe3-323d8d26900c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:18.086058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144064c5-af47-4e6b-9b34-b78e0e7bbcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:18.086728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144064c5-af47-4e6b-9b34-b78e0e7bbcf9 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:18.087011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144064c5-af47-4e6b-9b34-b78e0e7bbcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:18.087290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144064c5-af47-4e6b-9b34-b78e0e7bbcf9 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:18.088023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144064c5-af47-4e6b-9b34-b78e0e7bbcf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:18.089605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144064c5-af47-4e6b-9b34-b78e0e7bbcf9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:18.117778 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 32/61] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:06:17 2022] POST /identity/v3/users => generated 275 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:06:21.365078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab40fb8-f31b-42dc-ac26-034880244607 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:21.366157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab40fb8-f31b-42dc-ac26-034880244607 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:21.366640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab40fb8-f31b-42dc-ac26-034880244607 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:21.368310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 30/62] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:21.374023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1f6f1-d4fa-4d3f-a246-69bebfda949c None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:21.374467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1f6f1-d4fa-4d3f-a246-69bebfda949c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:21.374587 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1f6f1-d4fa-4d3f-a246-69bebfda949c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:21.403496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-24e1f6f1-d4fa-4d3f-a246-69bebfda949c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:21.405001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-24e1f6f1-d4fa-4d3f-a246-69bebfda949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:21.470501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf6ce9-0234-47b1-8ff2-4b772bde75d5 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:21.471681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf6ce9-0234-47b1-8ff2-4b772bde75d5 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:21.472182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf6ce9-0234-47b1-8ff2-4b772bde75d5 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:21.474204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:06:21.479717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f7511-71c6-4b4a-aef7-cb69793796c0 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:21.480747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f7511-71c6-4b4a-aef7-cb69793796c0 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:21.481396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f7511-71c6-4b4a-aef7-cb69793796c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:21.510740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-024f7511-71c6-4b4a-aef7-cb69793796c0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:21.511953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-024f7511-71c6-4b4a-aef7-cb69793796c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:21.516619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 33/64] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:21.559050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1f6f1-d4fa-4d3f-a246-69bebfda949c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:21.601644 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:21.617162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 32/65] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:21.640745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f7511-71c6-4b4a-aef7-cb69793796c0 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:21.681606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:21.769652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1f6f1-d4fa-4d3f-a246-69bebfda949c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:21.773697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f7511-71c6-4b4a-aef7-cb69793796c0 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:21.811390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c465ad-1e90-41f5-8cd1-94a2ed26ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:21.812194 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c465ad-1e90-41f5-8cd1-94a2ed26ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:21.812733 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c465ad-1e90-41f5-8cd1-94a2ed26ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:21.813012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c465ad-1e90-41f5-8cd1-94a2ed26ffe4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:21.826203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c465ad-1e90-41f5-8cd1-94a2ed26ffe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:21.826946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb6b9b-99ac-4e62-ac27-c99445357e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:21.827963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb6b9b-99ac-4e62-ac27-c99445357e8f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:21.828439 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb6b9b-99ac-4e62-ac27-c99445357e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:21.828961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb6b9b-99ac-4e62-ac27-c99445357e8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-25c465ad-1e90-41f5-8cd1-94a2ed26ffe4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:21.835855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:21.836709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:21.837603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 33/66] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:06:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:21.838679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383dcff-a9bb-4e0d-af1b-5c0cdbb3e7c5 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:21.838900 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383dcff-a9bb-4e0d-af1b-5c0cdbb3e7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:21.839182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383dcff-a9bb-4e0d-af1b-5c0cdbb3e7c5 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:21.840491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 34/67] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:21.843225 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383dcff-a9bb-4e0d-af1b-5c0cdbb3e7c5 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:21.849058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb6b9b-99ac-4e62-ac27-c99445357e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-b1fb6b9b-99ac-4e62-ac27-c99445357e8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:21.857552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:21.858382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:21.859116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:21.859116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:21.859116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:21.859116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:21.859116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:21.859116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:21.859116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:21.859116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:21.859116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:21.859116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:21.859116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:21.859116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:21.861961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 34/68] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:21.863440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd57c2e-6451-41ac-aec6-6d5c4530e39a None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:21.863942 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd57c2e-6451-41ac-aec6-6d5c4530e39a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:21.864422 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd57c2e-6451-41ac-aec6-6d5c4530e39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:21.883327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-6bd57c2e-6451-41ac-aec6-6d5c4530e39a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:21.884932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6bd57c2e-6451-41ac-aec6-6d5c4530e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:21.942099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:21.965402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 35/69] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:21.965402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd57c2e-6451-41ac-aec6-6d5c4530e39a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:21.970328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383dcff-a9bb-4e0d-af1b-5c0cdbb3e7c5 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:21.982975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:22.009740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e2678-8413-416b-bd1f-caa897f238f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:22.010423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e2678-8413-416b-bd1f-caa897f238f3 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.010761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e2678-8413-416b-bd1f-caa897f238f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.011045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e2678-8413-416b-bd1f-caa897f238f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.011808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e2678-8413-416b-bd1f-caa897f238f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:22.012120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e2678-8413-416b-bd1f-caa897f238f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:22.013559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e2678-8413-416b-bd1f-caa897f238f3 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:22.022239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 35/70] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:22.026847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e01ff-c9bd-4b6f-b6e0-31ea9fdd9c95 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.027210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e01ff-c9bd-4b6f-b6e0-31ea9fdd9c95 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.027499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e01ff-c9bd-4b6f-b6e0-31ea9fdd9c95 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.028845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 36/71] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:22.029585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e01ff-c9bd-4b6f-b6e0-31ea9fdd9c95 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:22.072312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd57c2e-6451-41ac-aec6-6d5c4530e39a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:22.107696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec4d49-5dc1-44cc-8156-5863b2a918a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:22.108398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec4d49-5dc1-44cc-8156-5863b2a918a1 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.108681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec4d49-5dc1-44cc-8156-5863b2a918a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.108964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec4d49-5dc1-44cc-8156-5863b2a918a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.109759 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec4d49-5dc1-44cc-8156-5863b2a918a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:22.110070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec4d49-5dc1-44cc-8156-5863b2a918a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:22.111490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec4d49-5dc1-44cc-8156-5863b2a918a1 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:22.119757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 36/72] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:22.124710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708835b-4e2d-4fed-bc52-c0b232daa0fa None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.124710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708835b-4e2d-4fed-bc52-c0b232daa0fa None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.124710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708835b-4e2d-4fed-bc52-c0b232daa0fa None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.124710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 37/73] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:22.124710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708835b-4e2d-4fed-bc52-c0b232daa0fa None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:22.138854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e01ff-c9bd-4b6f-b6e0-31ea9fdd9c95 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:22.173268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6c50c-9c3e-4c9c-b772-f1ccc4ecf7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:22.174157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6c50c-9c3e-4c9c-b772-f1ccc4ecf7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.174443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6c50c-9c3e-4c9c-b772-f1ccc4ecf7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.174750 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6c50c-9c3e-4c9c-b772-f1ccc4ecf7a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.182903 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:22.186830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6c50c-9c3e-4c9c-b772-f1ccc4ecf7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-18d6c50c-9c3e-4c9c-b772-f1ccc4ecf7a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:22.195341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:22.196154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:22.196879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 37/74] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:06:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:22.198118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b62b89-c137-45d0-b74e-2c43aab0f97c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.198223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b62b89-c137-45d0-b74e-2c43aab0f97c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.198615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b62b89-c137-45d0-b74e-2c43aab0f97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.199585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:22.216805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-75b62b89-c137-45d0-b74e-2c43aab0f97c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:22.218042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-75b62b89-c137-45d0-b74e-2c43aab0f97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:22.235282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708835b-4e2d-4fed-bc52-c0b232daa0fa None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:22.270940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb6151-44aa-48a2-97b1-6779d4e2d446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:22.271824 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6151-44aa-48a2-97b1-6779d4e2d446 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.272103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6151-44aa-48a2-97b1-6779d4e2d446 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.272370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6151-44aa-48a2-97b1-6779d4e2d446 None admin] PATH_INFO: `/v3/users/a3aabddbd41c4280b0867d9e10f45bdf` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.273598 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb6151-44aa-48a2-97b1-6779d4e2d446 None admin] RBAC: Authorizing `identity:get_user(user_id=a3aabddbd41c4280b0867d9e10f45bdf)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:22.275071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb6151-44aa-48a2-97b1-6779d4e2d446 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:22.281271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 38/75] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:22 2022] GET /identity/v3/users/a3aabddbd41c4280b0867d9e10f45bdf => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:22.281271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb6151-44aa-48a2-97b1-6779d4e2d446 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:22.286912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 38/76] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:22.289821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a66746-c27d-4d58-aaf6-b1a56a3906cf None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.289821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a66746-c27d-4d58-aaf6-b1a56a3906cf None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.289821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a66746-c27d-4d58-aaf6-b1a56a3906cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.317539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-01a66746-c27d-4d58-aaf6-b1a56a3906cf None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:22.318934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-01a66746-c27d-4d58-aaf6-b1a56a3906cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:22.386321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb6151-44aa-48a2-97b1-6779d4e2d446 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:22.390676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 39/77] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:22.394154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a66746-c27d-4d58-aaf6-b1a56a3906cf None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:22.427823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85264bc-58f1-494e-8a80-b3456b076b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:22.428728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85264bc-58f1-494e-8a80-b3456b076b2d None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.429012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85264bc-58f1-494e-8a80-b3456b076b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.429329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85264bc-58f1-494e-8a80-b3456b076b2d None admin] PATH_INFO: `/v3/users/4b27b1bc486d4913b619fc0b63c6c425` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.446077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:22.451643 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85264bc-58f1-494e-8a80-b3456b076b2d None admin] RBAC: Authorizing `identity:get_user(user_id=4b27b1bc486d4913b619fc0b63c6c425)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:22.453141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85264bc-58f1-494e-8a80-b3456b076b2d None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:22.455013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 39/78] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:22 2022] GET /identity/v3/users/4b27b1bc486d4913b619fc0b63c6c425 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:22.455823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85264bc-58f1-494e-8a80-b3456b076b2d None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:22.456320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:22.498463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a66746-c27d-4d58-aaf6-b1a56a3906cf None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:22.533165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39398971-08c6-4511-9cfb-ecb62af92ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:22.533888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39398971-08c6-4511-9cfb-ecb62af92ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.534173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39398971-08c6-4511-9cfb-ecb62af92ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.534464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39398971-08c6-4511-9cfb-ecb62af92ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.535225 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39398971-08c6-4511-9cfb-ecb62af92ed0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:22.535536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39398971-08c6-4511-9cfb-ecb62af92ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:22.536957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39398971-08c6-4511-9cfb-ecb62af92ed0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:22.545476 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 40/79] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:06:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:22.546085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39398971-08c6-4511-9cfb-ecb62af92ed0 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:22.560244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85264bc-58f1-494e-8a80-b3456b076b2d None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:22.596229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537500ca-7014-4992-8ce4-200a1ed9436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:22.596890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537500ca-7014-4992-8ce4-200a1ed9436c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.597179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537500ca-7014-4992-8ce4-200a1ed9436c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.597490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537500ca-7014-4992-8ce4-200a1ed9436c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.647032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39398971-08c6-4511-9cfb-ecb62af92ed0 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:22.662285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:22.667025 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537500ca-7014-4992-8ce4-200a1ed9436c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:22.668701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537500ca-7014-4992-8ce4-200a1ed9436c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:22.669265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:22.688882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e991f5f-f172-4547-a905-ab1e6921f962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:22.689733 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e991f5f-f172-4547-a905-ab1e6921f962 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.690015 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e991f5f-f172-4547-a905-ab1e6921f962 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.690293 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e991f5f-f172-4547-a905-ab1e6921f962 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.691508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e991f5f-f172-4547-a905-ab1e6921f962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:22.693104 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e991f5f-f172-4547-a905-ab1e6921f962 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:22.695061 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 41/80] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:22.695936 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e991f5f-f172-4547-a905-ab1e6921f962 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:22.791097 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 40/81] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:22.791745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537500ca-7014-4992-8ce4-200a1ed9436c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:22.806376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e991f5f-f172-4547-a905-ab1e6921f962 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:22.841915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859d1f2-e787-4e44-8f5b-6fd8139b336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:22.842779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859d1f2-e787-4e44-8f5b-6fd8139b336d None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.843116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859d1f2-e787-4e44-8f5b-6fd8139b336d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.843390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859d1f2-e787-4e44-8f5b-6fd8139b336d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.854695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859d1f2-e787-4e44-8f5b-6fd8139b336d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-9859d1f2-e787-4e44-8f5b-6fd8139b336d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:22.862731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:22.863791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:22.864702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 42/82] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:22.866455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859d1f2-e787-4e44-8f5b-6fd8139b336d None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:22.905388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:22.909442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537500ca-7014-4992-8ce4-200a1ed9436c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:22.919725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:22.945733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b17420-0cdd-43b2-ba4a-a5c0fa65a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:22.946419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b17420-0cdd-43b2-ba4a-a5c0fa65a36a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:22.946709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b17420-0cdd-43b2-ba4a-a5c0fa65a36a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:22.946991 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b17420-0cdd-43b2-ba4a-a5c0fa65a36a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:22.976826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859d1f2-e787-4e44-8f5b-6fd8139b336d None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:23.011235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8d57a-7584-4027-b339-3b42f6a28f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:23.012148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d57a-7584-4027-b339-3b42f6a28f60 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:23.012437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d57a-7584-4027-b339-3b42f6a28f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:23.012743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d57a-7584-4027-b339-3b42f6a28f60 None admin] PATH_INFO: `/v3/users/4b27b1bc486d4913b619fc0b63c6c425` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:23.013953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8d57a-7584-4027-b339-3b42f6a28f60 None admin] RBAC: Authorizing `identity:get_user(user_id=4b27b1bc486d4913b619fc0b63c6c425)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:23.015436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8d57a-7584-4027-b339-3b42f6a28f60 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:23.017153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 43/83] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:22 2022] GET /identity/v3/users/4b27b1bc486d4913b619fc0b63c6c425 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:23.017950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8d57a-7584-4027-b339-3b42f6a28f60 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:23.025461 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b17420-0cdd-43b2-ba4a-a5c0fa65a36a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:23.027043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b17420-0cdd-43b2-ba4a-a5c0fa65a36a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:23.122330 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8d57a-7584-4027-b339-3b42f6a28f60 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:23.128184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:23.137316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 41/84] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:23.137316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b17420-0cdd-43b2-ba4a-a5c0fa65a36a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:23.140836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:23.159717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cd26b-8624-4671-92ad-050915b85b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:23.160339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cd26b-8624-4671-92ad-050915b85b81 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:23.160616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cd26b-8624-4671-92ad-050915b85b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:23.160901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cd26b-8624-4671-92ad-050915b85b81 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:23.161691 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cd26b-8624-4671-92ad-050915b85b81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:23.163202 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cd26b-8624-4671-92ad-050915b85b81 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:23.192517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 44/85] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:06:23 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:06:23.205497 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cd26b-8624-4671-92ad-050915b85b81 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:23.272460 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b17420-0cdd-43b2-ba4a-a5c0fa65a36a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:23.322933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad8634-0b2a-495a-aadd-d4ad2c77844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:23.325183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad8634-0b2a-495a-aadd-d4ad2c77844b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:23.325545 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad8634-0b2a-495a-aadd-d4ad2c77844b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:23.325840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad8634-0b2a-495a-aadd-d4ad2c77844b None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:23.326850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cd26b-8624-4671-92ad-050915b85b81 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:23.327288 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad8634-0b2a-495a-aadd-d4ad2c77844b None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:23.329088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad8634-0b2a-495a-aadd-d4ad2c77844b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:23.337608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 42/86] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:23 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:23.337608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad8634-0b2a-495a-aadd-d4ad2c77844b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:23.368952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e44369-5201-4e08-8cf7-1ac54509c613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:23.370542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e44369-5201-4e08-8cf7-1ac54509c613 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:23.370830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e44369-5201-4e08-8cf7-1ac54509c613 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:23.371111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e44369-5201-4e08-8cf7-1ac54509c613 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:23.371891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e44369-5201-4e08-8cf7-1ac54509c613 None admin] RBAC: Adding query filter params (name=member) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:23.372204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e44369-5201-4e08-8cf7-1ac54509c613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:23.373674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e44369-5201-4e08-8cf7-1ac54509c613 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:23.383741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 45/87] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:23.384403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e44369-5201-4e08-8cf7-1ac54509c613 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:23.431172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:23.431693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:23.477159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad8634-0b2a-495a-aadd-d4ad2c77844b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:23.519343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e44369-5201-4e08-8cf7-1ac54509c613 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:23.521380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae49117-23c0-4af5-8225-6ed7fad0984c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:23.522904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae49117-23c0-4af5-8225-6ed7fad0984c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:23.523200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae49117-23c0-4af5-8225-6ed7fad0984c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:23.523484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae49117-23c0-4af5-8225-6ed7fad0984c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:23.562100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4ca7c-63f7-47a9-964d-3f93283fdfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:23.563296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4ca7c-63f7-47a9-964d-3f93283fdfae None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:23.563584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4ca7c-63f7-47a9-964d-3f93283fdfae None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:23.563981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4ca7c-63f7-47a9-964d-3f93283fdfae None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:23.565362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4ca7c-63f7-47a9-964d-3f93283fdfae None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:23.567584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4ca7c-63f7-47a9-964d-3f93283fdfae None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:23.569712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 46/88] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:23 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:23.570844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4ca7c-63f7-47a9-964d-3f93283fdfae None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:23.618270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae49117-23c0-4af5-8225-6ed7fad0984c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:23.620229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae49117-23c0-4af5-8225-6ed7fad0984c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:23.691212 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4ca7c-63f7-47a9-964d-3f93283fdfae None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:23.695229 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:23.704344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:23.743968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7e851-c714-4b39-b6b0-6e2ab59c1a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:23.744633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e851-c714-4b39-b6b0-6e2ab59c1a70 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:23.744919 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e851-c714-4b39-b6b0-6e2ab59c1a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:23.745290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e851-c714-4b39-b6b0-6e2ab59c1a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:23.746134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7e851-c714-4b39-b6b0-6e2ab59c1a70 None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=02a8a5b7d75b4de4b84070e456454f06, user.id=a3aabddbd41c4280b0867d9e10f45bdf) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:23.746453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7e851-c714-4b39-b6b0-6e2ab59c1a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:23.747968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7e851-c714-4b39-b6b0-6e2ab59c1a70 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:23.754587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 47/89] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:23 2022] GET /identity/v3/role_assignments?user.id=a3aabddbd41c4280b0867d9e10f45bdf&scope.project.id=02a8a5b7d75b4de4b84070e456454f06&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:23.762207 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7e851-c714-4b39-b6b0-6e2ab59c1a70 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:23.764593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 43/90] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:23.765727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae49117-23c0-4af5-8225-6ed7fad0984c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:23.910500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae49117-23c0-4af5-8225-6ed7fad0984c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:23.947916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c0691-8022-40b2-a15d-7f57aaae2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:23.948613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c0691-8022-40b2-a15d-7f57aaae2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:23.953248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c0691-8022-40b2-a15d-7f57aaae2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:23.953248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c0691-8022-40b2-a15d-7f57aaae2fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:23.953248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c0691-8022-40b2-a15d-7f57aaae2fc8 None admin] RBAC: Adding query filter params (role.id=118677ef2dfa4e808ddc78b083c01059, scope.project.id=02a8a5b7d75b4de4b84070e456454f06, user.id=4b27b1bc486d4913b619fc0b63c6c425) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:23.953248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c0691-8022-40b2-a15d-7f57aaae2fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:23.953248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c0691-8022-40b2-a15d-7f57aaae2fc8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:23.958868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 44/91] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:23 2022] GET /identity/v3/role_assignments?user.id=4b27b1bc486d4913b619fc0b63c6c425&scope.project.id=02a8a5b7d75b4de4b84070e456454f06&role.id=118677ef2dfa4e808ddc78b083c01059 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:23.959849 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c0691-8022-40b2-a15d-7f57aaae2fc8 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:23.996761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7e851-c714-4b39-b6b0-6e2ab59c1a70 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:24.017600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:24.095826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c0691-8022-40b2-a15d-7f57aaae2fc8 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:24.121306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dfda4-8b34-4d10-aa22-0e2ec2051977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:24.122565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dfda4-8b34-4d10-aa22-0e2ec2051977 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:24.123069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dfda4-8b34-4d10-aa22-0e2ec2051977 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:24.123540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dfda4-8b34-4d10-aa22-0e2ec2051977 None admin] PATH_INFO: `/v3/users/4b27b1bc486d4913b619fc0b63c6c425` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:24.125079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dfda4-8b34-4d10-aa22-0e2ec2051977 None admin] RBAC: Authorizing `identity:get_user(user_id=4b27b1bc486d4913b619fc0b63c6c425)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:24.130942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dfda4-8b34-4d10-aa22-0e2ec2051977 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:24.133025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 48/92] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:23 2022] GET /identity/v3/users/4b27b1bc486d4913b619fc0b63c6c425 => generated 275 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:24.148559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dfda4-8b34-4d10-aa22-0e2ec2051977 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:24.158182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46098d-bf32-43f3-bd10-5e8595b7c9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:24.160086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46098d-bf32-43f3-bd10-5e8595b7c9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:24.160377 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46098d-bf32-43f3-bd10-5e8595b7c9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:24.160653 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46098d-bf32-43f3-bd10-5e8595b7c9c7 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:24.163916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46098d-bf32-43f3-bd10-5e8595b7c9c7 None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:24.165449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46098d-bf32-43f3-bd10-5e8595b7c9c7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:24.173250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 45/93] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:23 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:24.173926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46098d-bf32-43f3-bd10-5e8595b7c9c7 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:24.274671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:24.311203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46098d-bf32-43f3-bd10-5e8595b7c9c7 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:24.341702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:24.351437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce9f54-9750-462c-ae13-81b155ca3f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:24.352125 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce9f54-9750-462c-ae13-81b155ca3f02 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:24.352410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce9f54-9750-462c-ae13-81b155ca3f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:24.352690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce9f54-9750-462c-ae13-81b155ca3f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:24.357239 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce9f54-9750-462c-ae13-81b155ca3f02 None admin] RBAC: Adding query filter params (role.id=5c9f98a938a74f35857ce032dd9e06b1, scope.project.id=02a8a5b7d75b4de4b84070e456454f06, user.id=4b27b1bc486d4913b619fc0b63c6c425) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:24.357239 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce9f54-9750-462c-ae13-81b155ca3f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:24.357239 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce9f54-9750-462c-ae13-81b155ca3f02 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:24.362323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 46/94] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:24 2022] GET /identity/v3/role_assignments?user.id=4b27b1bc486d4913b619fc0b63c6c425&scope.project.id=02a8a5b7d75b4de4b84070e456454f06&role.id=5c9f98a938a74f35857ce032dd9e06b1 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:24.463042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dfda4-8b34-4d10-aa22-0e2ec2051977 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:24.518612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8c931-756b-41a8-b665-02240f3f2e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:24.519640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8c931-756b-41a8-b665-02240f3f2e0b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:24.520147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8c931-756b-41a8-b665-02240f3f2e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:24.520643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8c931-756b-41a8-b665-02240f3f2e0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:24.602679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8c931-756b-41a8-b665-02240f3f2e0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:24.604184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8c931-756b-41a8-b665-02240f3f2e0b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:24.640121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:24.707515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 49/95] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:24.713105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce9f54-9750-462c-ae13-81b155ca3f02 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:24.815632 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce9f54-9750-462c-ae13-81b155ca3f02 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:24.850179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d088dc-5c86-451e-a5f3-cbe36ff0655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:24.851063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d088dc-5c86-451e-a5f3-cbe36ff0655f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:24.851350 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d088dc-5c86-451e-a5f3-cbe36ff0655f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:24.851641 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d088dc-5c86-451e-a5f3-cbe36ff0655f None admin] PATH_INFO: `/v3/projects/0af8f49c5b1742ef8455f029a9842d76` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:24.852901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d088dc-5c86-451e-a5f3-cbe36ff0655f None admin] RBAC: Authorizing `identity:get_project(project_id=0af8f49c5b1742ef8455f029a9842d76)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:24.854408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d088dc-5c86-451e-a5f3-cbe36ff0655f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:24.856163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 47/96] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:24 2022] GET /identity/v3/projects/0af8f49c5b1742ef8455f029a9842d76 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:24.862019 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8c931-756b-41a8-b665-02240f3f2e0b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:24.962460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8c931-756b-41a8-b665-02240f3f2e0b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:24.997823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59b491-2fbd-49e6-adf5-8258a4987766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:24.998565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59b491-2fbd-49e6-adf5-8258a4987766 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:24.998852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59b491-2fbd-49e6-adf5-8258a4987766 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:24.999186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59b491-2fbd-49e6-adf5-8258a4987766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:25.000045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59b491-2fbd-49e6-adf5-8258a4987766 None admin] RBAC: Adding query filter params (role.id=118677ef2dfa4e808ddc78b083c01059, scope.project.id=0af8f49c5b1742ef8455f029a9842d76, user.id=4b27b1bc486d4913b619fc0b63c6c425) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:25.000365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59b491-2fbd-49e6-adf5-8258a4987766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:25.001891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59b491-2fbd-49e6-adf5-8258a4987766 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:25.005420 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:25.008514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 50/97] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:24 2022] GET /identity/v3/role_assignments?user.id=4b27b1bc486d4913b619fc0b63c6c425&scope.project.id=0af8f49c5b1742ef8455f029a9842d76&role.id=118677ef2dfa4e808ddc78b083c01059 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:25.868360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262753c8-2b36-4300-a2a4-dc5735158308 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:25.868875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262753c8-2b36-4300-a2a4-dc5735158308 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:25.868948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262753c8-2b36-4300-a2a4-dc5735158308 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:25.870441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 48/98] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:25.875832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36e9a7-d1e5-4815-9536-73b9d5c730e8 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:25.876258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36e9a7-d1e5-4815-9536-73b9d5c730e8 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:25.876424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36e9a7-d1e5-4815-9536-73b9d5c730e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:25.902311 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-df36e9a7-d1e5-4815-9536-73b9d5c730e8 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:25.903520 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-df36e9a7-d1e5-4815-9536-73b9d5c730e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:25.995257 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 51/99] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:26.030762 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262753c8-2b36-4300-a2a4-dc5735158308 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:26.081356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:26.190050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262753c8-2b36-4300-a2a4-dc5735158308 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:26.239520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158072d-3248-498b-803a-8117e9639133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:26.240332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158072d-3248-498b-803a-8117e9639133 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:26.240614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158072d-3248-498b-803a-8117e9639133 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:26.240890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158072d-3248-498b-803a-8117e9639133 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:26.254128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158072d-3248-498b-803a-8117e9639133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-0158072d-3248-498b-803a-8117e9639133 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:26.261934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:26.262781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:26.263529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 49/100] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:26.268973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36e9a7-d1e5-4815-9536-73b9d5c730e8 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:26.381724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36e9a7-d1e5-4815-9536-73b9d5c730e8 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:26.417632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:26.420338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e5227-eb1a-4665-8887-4bbcc8d49f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:26.421058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e5227-eb1a-4665-8887-4bbcc8d49f84 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:26.421381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e5227-eb1a-4665-8887-4bbcc8d49f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:26.421663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e5227-eb1a-4665-8887-4bbcc8d49f84 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:26.422521 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e5227-eb1a-4665-8887-4bbcc8d49f84 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:26.422844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e5227-eb1a-4665-8887-4bbcc8d49f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:26.424259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e5227-eb1a-4665-8887-4bbcc8d49f84 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:26.437528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 52/101] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:26.439499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158072d-3248-498b-803a-8117e9639133 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:26.549323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:26.559160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158072d-3248-498b-803a-8117e9639133 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:26.589397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def372c-cc2d-49d2-bf90-24d642633225 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:26.590063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def372c-cc2d-49d2-bf90-24d642633225 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:26.590551 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def372c-cc2d-49d2-bf90-24d642633225 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:26.592200 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 53/102] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:26.593263 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310333-34e5-455f-9cae-c6ad0fbff086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:26.594183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310333-34e5-455f-9cae-c6ad0fbff086 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:26.594456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310333-34e5-455f-9cae-c6ad0fbff086 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:26.594749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310333-34e5-455f-9cae-c6ad0fbff086 None admin] PATH_INFO: `/v3/users/8a53f0842dd94d659976e09f9e003e72` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:26.599737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c2b1b-1cfa-42d7-8b1a-b835be94b0c2 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:26.600337 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c2b1b-1cfa-42d7-8b1a-b835be94b0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:26.600822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c2b1b-1cfa-42d7-8b1a-b835be94b0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:26.611349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0310333-34e5-455f-9cae-c6ad0fbff086 None admin] RBAC: Authorizing `identity:get_user(user_id=8a53f0842dd94d659976e09f9e003e72)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:26.612842 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0310333-34e5-455f-9cae-c6ad0fbff086 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:26.614704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 50/103] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:26 2022] GET /identity/v3/users/8a53f0842dd94d659976e09f9e003e72 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:26.620127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310333-34e5-455f-9cae-c6ad0fbff086 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:26.621855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-968c2b1b-1cfa-42d7-8b1a-b835be94b0c2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:26.623456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-968c2b1b-1cfa-42d7-8b1a-b835be94b0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:26.724122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310333-34e5-455f-9cae-c6ad0fbff086 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:26.759168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306190e4-eb57-459f-981a-6fec178df873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:26.760162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306190e4-eb57-459f-981a-6fec178df873 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:26.760631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306190e4-eb57-459f-981a-6fec178df873 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:26.761056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306190e4-eb57-459f-981a-6fec178df873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:26.762645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 54/104] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:26.764527 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c946c-a357-412b-bd92-c6d8e6b1f7ee None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:26.764979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c946c-a357-412b-bd92-c6d8e6b1f7ee None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:26.765437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c946c-a357-412b-bd92-c6d8e6b1f7ee None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:26.766933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 55/105] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:26.772619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871b2d7-0a66-433a-b417-32cdc02d9987 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:26.773120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871b2d7-0a66-433a-b417-32cdc02d9987 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:26.773566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871b2d7-0a66-433a-b417-32cdc02d9987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:26.781386 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:26.805760 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-b871b2d7-0a66-433a-b417-32cdc02d9987 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:26.807317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b871b2d7-0a66-433a-b417-32cdc02d9987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:26.879344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306190e4-eb57-459f-981a-6fec178df873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:26.881451 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306190e4-eb57-459f-981a-6fec178df873 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:26.916486 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 56/106] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:26.918415 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871b2d7-0a66-433a-b417-32cdc02d9987 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:27.022459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:27.067261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 51/107] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 07:06:27.068838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306190e4-eb57-459f-981a-6fec178df873 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:27.089135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871b2d7-0a66-433a-b417-32cdc02d9987 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:27.124844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678384db-a366-4fe6-bd52-3dbe3de30e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:27.125957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678384db-a366-4fe6-bd52-3dbe3de30e82 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:27.126401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678384db-a366-4fe6-bd52-3dbe3de30e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:27.126831 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678384db-a366-4fe6-bd52-3dbe3de30e82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:27.128191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678384db-a366-4fe6-bd52-3dbe3de30e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:27.129959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678384db-a366-4fe6-bd52-3dbe3de30e82 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:27.130790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:27.132132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 57/108] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:27.133876 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c767-ef92-4ec1-adf1-3804f12dfddd None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:27.134416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c767-ef92-4ec1-adf1-3804f12dfddd None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:27.134935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c767-ef92-4ec1-adf1-3804f12dfddd None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:27.136519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 58/109] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:27.137845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99c767-ef92-4ec1-adf1-3804f12dfddd None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:27.199483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306190e4-eb57-459f-981a-6fec178df873 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:27.238352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58867a5d-6390-4822-863a-027d6c202e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:27.239616 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58867a5d-6390-4822-863a-027d6c202e36 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:27.240101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58867a5d-6390-4822-863a-027d6c202e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:27.240578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58867a5d-6390-4822-863a-027d6c202e36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:27.252079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58867a5d-6390-4822-863a-027d6c202e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:27.259795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99c767-ef92-4ec1-adf1-3804f12dfddd None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-58867a5d-6390-4822-863a-027d6c202e36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:27.260513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:27.261368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:27.262221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:27.262221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:27.262221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:27.262221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:27.262221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:27.262221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:27.262221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:27.262221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:27.262221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:27.262221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:27.262221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:27.262221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:27.264690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 52/110] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:06:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:27.270657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58867a5d-6390-4822-863a-027d6c202e36 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:27.286270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:27.306068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858d8e-d19f-44f5-b5dd-8c7dc4a7a21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:27.307268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858d8e-d19f-44f5-b5dd-8c7dc4a7a21f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:27.307634 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858d8e-d19f-44f5-b5dd-8c7dc4a7a21f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:27.307916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858d8e-d19f-44f5-b5dd-8c7dc4a7a21f None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:27.309392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55858d8e-d19f-44f5-b5dd-8c7dc4a7a21f None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:27.310851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55858d8e-d19f-44f5-b5dd-8c7dc4a7a21f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:27.313935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 59/111] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:27 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:27.315282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119ba50-28c2-4091-bd04-ebb1172119f2 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:27.315570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119ba50-28c2-4091-bd04-ebb1172119f2 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:27.315847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119ba50-28c2-4091-bd04-ebb1172119f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:27.348561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-d119ba50-28c2-4091-bd04-ebb1172119f2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:27.349996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d119ba50-28c2-4091-bd04-ebb1172119f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:27.396130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58867a5d-6390-4822-863a-027d6c202e36 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:27.407431 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:27.432902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 60/112] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:27.434332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119ba50-28c2-4091-bd04-ebb1172119f2 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:27.455195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6779bd8-a61d-45f0-8895-5728b4e96310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:27.455876 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6779bd8-a61d-45f0-8895-5728b4e96310 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:27.456168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6779bd8-a61d-45f0-8895-5728b4e96310 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:27.456443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6779bd8-a61d-45f0-8895-5728b4e96310 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:27.457199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6779bd8-a61d-45f0-8895-5728b4e96310 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:27.458715 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6779bd8-a61d-45f0-8895-5728b4e96310 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:27.488795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 53/113] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:06:27 2022] POST /identity/v3/projects => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:06:27.490597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac068c0-e28c-4eb9-8ada-a05b90a18a5a None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:27.491106 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac068c0-e28c-4eb9-8ada-a05b90a18a5a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:27.491347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac068c0-e28c-4eb9-8ada-a05b90a18a5a None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:27.492860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 54/114] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:27.498176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac068c0-e28c-4eb9-8ada-a05b90a18a5a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:27.576396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119ba50-28c2-4091-bd04-ebb1172119f2 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:27.602657 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:27.628290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6f156-063f-4d82-b534-c070714d0a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:27.629001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f156-063f-4d82-b534-c070714d0a73 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:27.629321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f156-063f-4d82-b534-c070714d0a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:27.629608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f156-063f-4d82-b534-c070714d0a73 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:27.630391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6f156-063f-4d82-b534-c070714d0a73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:27.630707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6f156-063f-4d82-b534-c070714d0a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:27.631990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac068c0-e28c-4eb9-8ada-a05b90a18a5a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:27.632189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6f156-063f-4d82-b534-c070714d0a73 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:27.643935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 61/115] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:27.643935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6f156-063f-4d82-b534-c070714d0a73 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:27.690315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1853-085d-468d-99b4-68bdf58cd2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:27.691001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1853-085d-468d-99b4-68bdf58cd2ee None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:27.691283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1853-085d-468d-99b4-68bdf58cd2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:27.691564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1853-085d-468d-99b4-68bdf58cd2ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:27.692424 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1853-085d-468d-99b4-68bdf58cd2ee None admin] RBAC: Adding query filter params (role.id=a4709d01dc6b4ff6a2471497008b7808, scope.project.id=02a8a5b7d75b4de4b84070e456454f06, user.id=8a53f0842dd94d659976e09f9e003e72) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:27.692737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1853-085d-468d-99b4-68bdf58cd2ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:27.694585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1853-085d-468d-99b4-68bdf58cd2ee None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:27.703219 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 55/116] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:27 2022] GET /identity/v3/role_assignments?user.id=8a53f0842dd94d659976e09f9e003e72&scope.project.id=02a8a5b7d75b4de4b84070e456454f06&role.id=a4709d01dc6b4ff6a2471497008b7808 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:27.704609 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1f454-c499-41be-8588-c5a335fff469 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:27.705489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1f454-c499-41be-8588-c5a335fff469 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:27.705489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1f454-c499-41be-8588-c5a335fff469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:27.723160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-39e1f454-c499-41be-8588-c5a335fff469 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:27.724543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-39e1f454-c499-41be-8588-c5a335fff469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:27.747965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:27.802891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6f156-063f-4d82-b534-c070714d0a73 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:27.807484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 56/117] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:27.808326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1f454-c499-41be-8588-c5a335fff469 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:27.874748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363b809-bebb-4829-8230-f3864f6039c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:27.875820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363b809-bebb-4829-8230-f3864f6039c5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:27.876244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363b809-bebb-4829-8230-f3864f6039c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:27.876668 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363b809-bebb-4829-8230-f3864f6039c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:27.897861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363b809-bebb-4829-8230-f3864f6039c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-8363b809-bebb-4829-8230-f3864f6039c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:27.915659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:27.917255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:27.918012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 62/118] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:27.920683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363b809-bebb-4829-8230-f3864f6039c5 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:27.963218 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1f454-c499-41be-8588-c5a335fff469 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:28.005629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:28.034480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5f956-b890-445d-85f3-f16d126c9dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:28.035370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5f956-b890-445d-85f3-f16d126c9dff None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:28.035658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5f956-b890-445d-85f3-f16d126c9dff None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:28.035938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5f956-b890-445d-85f3-f16d126c9dff None admin] PATH_INFO: `/v3/users/a3aabddbd41c4280b0867d9e10f45bdf` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:28.038627 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5f956-b890-445d-85f3-f16d126c9dff None admin] RBAC: Authorizing `identity:get_user(user_id=a3aabddbd41c4280b0867d9e10f45bdf)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:28.040137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5f956-b890-445d-85f3-f16d126c9dff None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:28.043166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 57/119] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:27 2022] GET /identity/v3/users/a3aabddbd41c4280b0867d9e10f45bdf => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:28.046194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5f956-b890-445d-85f3-f16d126c9dff None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:28.097649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:28.106615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363b809-bebb-4829-8230-f3864f6039c5 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:28.153439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbc424-fe2c-495a-afc3-11c20c841c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:28.154188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbc424-fe2c-495a-afc3-11c20c841c83 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:28.154478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbc424-fe2c-495a-afc3-11c20c841c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:28.154762 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbc424-fe2c-495a-afc3-11c20c841c83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:28.168283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbc424-fe2c-495a-afc3-11c20c841c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:28.168443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5f956-b890-445d-85f3-f16d126c9dff None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-77bbc424-fe2c-495a-afc3-11c20c841c83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:28.176866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:28.177765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:28.178545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:28.178545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:28.178545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:28.178545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:28.178545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:28.178545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:28.178545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:28.178545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:28.178545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:28.178545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:28.178545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:28.178545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:28.181024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 63/120] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:06:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:28.186853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbc424-fe2c-495a-afc3-11c20c841c83 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:28.209724 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea9072-47a7-46cf-9e5b-a684848ff1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:28.212260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea9072-47a7-46cf-9e5b-a684848ff1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:28.212563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea9072-47a7-46cf-9e5b-a684848ff1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:28.212898 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea9072-47a7-46cf-9e5b-a684848ff1a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:28.213931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea9072-47a7-46cf-9e5b-a684848ff1a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:28.214299 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea9072-47a7-46cf-9e5b-a684848ff1a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:28.215891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea9072-47a7-46cf-9e5b-a684848ff1a9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:28.229253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 58/121] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:28.229253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dab5a-48fb-417c-b9be-843f8eba236e None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:28.229253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dab5a-48fb-417c-b9be-843f8eba236e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:28.229253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dab5a-48fb-417c-b9be-843f8eba236e None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:28.234311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 59/122] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:28.234954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dab5a-48fb-417c-b9be-843f8eba236e None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:28.304237 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:28.306983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbc424-fe2c-495a-afc3-11c20c841c83 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:28.352082 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7131912-8960-494f-99b4-d2d6d47d043b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:28.352922 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7131912-8960-494f-99b4-d2d6d47d043b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:28.353237 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7131912-8960-494f-99b4-d2d6d47d043b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:28.353338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dab5a-48fb-417c-b9be-843f8eba236e None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:28.353533 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7131912-8960-494f-99b4-d2d6d47d043b None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:28.354810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7131912-8960-494f-99b4-d2d6d47d043b None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:28.357355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7131912-8960-494f-99b4-d2d6d47d043b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:28.359457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 64/123] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:28 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:28.360694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375428f-b46a-49e3-8383-f8bd57f7d00c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:28.360986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375428f-b46a-49e3-8383-f8bd57f7d00c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:28.361286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375428f-b46a-49e3-8383-f8bd57f7d00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:28.369716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:28.381523 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-1375428f-b46a-49e3-8383-f8bd57f7d00c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:28.383715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1375428f-b46a-49e3-8383-f8bd57f7d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:28.415093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a3a7c-ef42-437b-8a19-8da71b5d3a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:28.415785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a3a7c-ef42-437b-8a19-8da71b5d3a66 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:28.416079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a3a7c-ef42-437b-8a19-8da71b5d3a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:28.416364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a3a7c-ef42-437b-8a19-8da71b5d3a66 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:28.417316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a3a7c-ef42-437b-8a19-8da71b5d3a66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:28.417638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a3a7c-ef42-437b-8a19-8da71b5d3a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:28.419253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a3a7c-ef42-437b-8a19-8da71b5d3a66 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:28.429278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 60/124] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:06:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:28.430303 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a3a7c-ef42-437b-8a19-8da71b5d3a66 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:28.474287 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 65/125] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:28.475478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375428f-b46a-49e3-8383-f8bd57f7d00c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:28.563826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a3a7c-ef42-437b-8a19-8da71b5d3a66 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:28.582725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:28.588749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375428f-b46a-49e3-8383-f8bd57f7d00c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:28.600961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda406a-1a63-46f8-83b3-3788f0ad6192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:28.602182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda406a-1a63-46f8-83b3-3788f0ad6192 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:28.602480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda406a-1a63-46f8-83b3-3788f0ad6192 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:28.602978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda406a-1a63-46f8-83b3-3788f0ad6192 None admin] PATH_INFO: `/v3/users/4b27b1bc486d4913b619fc0b63c6c425` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:28.604789 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda406a-1a63-46f8-83b3-3788f0ad6192 None admin] RBAC: Authorizing `identity:get_user(user_id=4b27b1bc486d4913b619fc0b63c6c425)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:28.606720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda406a-1a63-46f8-83b3-3788f0ad6192 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:28.609283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 61/126] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:28 2022] GET /identity/v3/users/4b27b1bc486d4913b619fc0b63c6c425 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:28.610933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda406a-1a63-46f8-83b3-3788f0ad6192 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:28.628944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5af33-b851-4a06-91a7-e2cae5cccdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:28.630339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5af33-b851-4a06-91a7-e2cae5cccdf8 None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:28.630834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5af33-b851-4a06-91a7-e2cae5cccdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:28.631339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:28.632575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5af33-b851-4a06-91a7-e2cae5cccdf8 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06/users/a3aabddbd41c4280b0867d9e10f45bdf/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:28.636459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5af33-b851-4a06-91a7-e2cae5cccdf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=02a8a5b7d75b4de4b84070e456454f06, user_id=a3aabddbd41c4280b0867d9e10f45bdf, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:28.638204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5af33-b851-4a06-91a7-e2cae5cccdf8 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:28.654238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 66/127] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:06:28 2022] PUT /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06/users/a3aabddbd41c4280b0867d9e10f45bdf/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:06:28.655426 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5af33-b851-4a06-91a7-e2cae5cccdf8 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:28.782589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5af33-b851-4a06-91a7-e2cae5cccdf8 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:28.804487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda406a-1a63-46f8-83b3-3788f0ad6192 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:28.826633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57a9f1-5606-4a05-a716-4a13d6dfe74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:28.827894 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57a9f1-5606-4a05-a716-4a13d6dfe74f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:28.828419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57a9f1-5606-4a05-a716-4a13d6dfe74f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:28.828897 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57a9f1-5606-4a05-a716-4a13d6dfe74f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:28.842861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57a9f1-5606-4a05-a716-4a13d6dfe74f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-de57a9f1-5606-4a05-a716-4a13d6dfe74f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:28.852546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:28.853496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:28.854286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:28.854286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:28.854286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:28.854286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:28.854286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:28.854286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:28.854286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:28.854286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:28.854286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:28.854286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:28.854286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:28.854286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:28.857325 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 67/128] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:28.858423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57a9f1-5606-4a05-a716-4a13d6dfe74f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:28.882222 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:28.914603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4736c6a-1ca7-4394-9167-b91fbaa3bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:28.915496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4736c6a-1ca7-4394-9167-b91fbaa3bc20 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:28.915776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4736c6a-1ca7-4394-9167-b91fbaa3bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:28.916053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4736c6a-1ca7-4394-9167-b91fbaa3bc20 None admin] PATH_INFO: `/v3/users/4b27b1bc486d4913b619fc0b63c6c425` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:28.921994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4736c6a-1ca7-4394-9167-b91fbaa3bc20 None admin] RBAC: Authorizing `identity:get_user(user_id=4b27b1bc486d4913b619fc0b63c6c425)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:28.923483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4736c6a-1ca7-4394-9167-b91fbaa3bc20 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:28.925468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 62/129] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:28 2022] GET /identity/v3/users/4b27b1bc486d4913b619fc0b63c6c425 => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:28.926052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4736c6a-1ca7-4394-9167-b91fbaa3bc20 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:28.991032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57a9f1-5606-4a05-a716-4a13d6dfe74f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:29.065656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3965c0-81f9-41c2-8d33-af1d68d5fe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:29.066975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3965c0-81f9-41c2-8d33-af1d68d5fe7e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:29.067950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3965c0-81f9-41c2-8d33-af1d68d5fe7e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:29.068825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3965c0-81f9-41c2-8d33-af1d68d5fe7e None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:29.071535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:29.074781 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3965c0-81f9-41c2-8d33-af1d68d5fe7e None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:29.079215 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3965c0-81f9-41c2-8d33-af1d68d5fe7e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:29.085891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 68/130] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:28 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:29.086844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3965c0-81f9-41c2-8d33-af1d68d5fe7e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:29.113041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4736c6a-1ca7-4394-9167-b91fbaa3bc20 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:29.152059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bedd0-c346-4dd9-89e5-3ec000a72508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:29.152743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bedd0-c346-4dd9-89e5-3ec000a72508 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:29.153030 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bedd0-c346-4dd9-89e5-3ec000a72508 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:29.153344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bedd0-c346-4dd9-89e5-3ec000a72508 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:29.154112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0bedd0-c346-4dd9-89e5-3ec000a72508 None admin] RBAC: Adding query filter params (name=member) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:29.154425 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0bedd0-c346-4dd9-89e5-3ec000a72508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:29.157349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0bedd0-c346-4dd9-89e5-3ec000a72508 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:29.164779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 63/131] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:29.166289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bedd0-c346-4dd9-89e5-3ec000a72508 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:29.260239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:29.271686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bedd0-c346-4dd9-89e5-3ec000a72508 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:29.296211 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3965c0-81f9-41c2-8d33-af1d68d5fe7e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:29.313245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53e3a-0ae0-43c7-b5b6-0309dace8e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:29.313245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53e3a-0ae0-43c7-b5b6-0309dace8e76 None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:29.313245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53e3a-0ae0-43c7-b5b6-0309dace8e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:29.313245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53e3a-0ae0-43c7-b5b6-0309dace8e76 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06/users/4b27b1bc486d4913b619fc0b63c6c425/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:29.313686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d53e3a-0ae0-43c7-b5b6-0309dace8e76 None admin] RBAC: Authorizing `identity:create_grant(project_id=02a8a5b7d75b4de4b84070e456454f06, user_id=4b27b1bc486d4913b619fc0b63c6c425, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:29.314344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d53e3a-0ae0-43c7-b5b6-0309dace8e76 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:29.336640 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 64/132] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:06:29 2022] PUT /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06/users/4b27b1bc486d4913b619fc0b63c6c425/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:06:29.340194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53e3a-0ae0-43c7-b5b6-0309dace8e76 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:29.350407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:29.386701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a0973-0f8f-45bf-ba85-6baf94ad594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:29.391033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a0973-0f8f-45bf-ba85-6baf94ad594f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:29.391033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a0973-0f8f-45bf-ba85-6baf94ad594f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:29.391033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a0973-0f8f-45bf-ba85-6baf94ad594f None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:29.391907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a0973-0f8f-45bf-ba85-6baf94ad594f None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:29.397297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a0973-0f8f-45bf-ba85-6baf94ad594f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:29.400296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 69/133] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:29 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:29.406352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a0973-0f8f-45bf-ba85-6baf94ad594f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:29.508122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53e3a-0ae0-43c7-b5b6-0309dace8e76 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:29.544717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e8e00-a002-4e76-a689-5366aefb3847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:29.545618 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e8e00-a002-4e76-a689-5366aefb3847 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:29.545899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e8e00-a002-4e76-a689-5366aefb3847 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:29.546175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e8e00-a002-4e76-a689-5366aefb3847 None admin] PATH_INFO: `/v3/users/4b27b1bc486d4913b619fc0b63c6c425` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:29.549262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e8e00-a002-4e76-a689-5366aefb3847 None admin] RBAC: Authorizing `identity:get_user(user_id=4b27b1bc486d4913b619fc0b63c6c425)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:29.549262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e8e00-a002-4e76-a689-5366aefb3847 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:29.550650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 65/134] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:29 2022] GET /identity/v3/users/4b27b1bc486d4913b619fc0b63c6c425 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:29.557558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e8e00-a002-4e76-a689-5366aefb3847 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:29.637688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:29.644632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a0973-0f8f-45bf-ba85-6baf94ad594f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:29.671786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e8e00-a002-4e76-a689-5366aefb3847 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:29.716525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856db34-0745-4de1-a120-ca1d4984f99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:29.717912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856db34-0745-4de1-a120-ca1d4984f99a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:29.718206 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856db34-0745-4de1-a120-ca1d4984f99a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:29.718491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856db34-0745-4de1-a120-ca1d4984f99a None admin] PATH_INFO: `/v3/projects/0af8f49c5b1742ef8455f029a9842d76` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:29.720481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856db34-0745-4de1-a120-ca1d4984f99a None admin] RBAC: Authorizing `identity:get_project(project_id=0af8f49c5b1742ef8455f029a9842d76)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:29.721988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856db34-0745-4de1-a120-ca1d4984f99a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:29.724478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904b3a6-4e46-49a0-89f1-aaeed4d1a96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:29.725396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 66/135] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:29 2022] GET /identity/v3/projects/0af8f49c5b1742ef8455f029a9842d76 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:29.725711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904b3a6-4e46-49a0-89f1-aaeed4d1a96f None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:29.726003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904b3a6-4e46-49a0-89f1-aaeed4d1a96f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:29.726281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904b3a6-4e46-49a0-89f1-aaeed4d1a96f None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06/users/4b27b1bc486d4913b619fc0b63c6c425/roles/5c9f98a938a74f35857ce032dd9e06b1` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:29.729478 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856db34-0745-4de1-a120-ca1d4984f99a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:29.731068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904b3a6-4e46-49a0-89f1-aaeed4d1a96f None admin] RBAC: Authorizing `identity:create_grant(project_id=02a8a5b7d75b4de4b84070e456454f06, user_id=4b27b1bc486d4913b619fc0b63c6c425, role_id=5c9f98a938a74f35857ce032dd9e06b1)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:29.732565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904b3a6-4e46-49a0-89f1-aaeed4d1a96f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:29.757499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 70/136] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:06:29 2022] PUT /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06/users/4b27b1bc486d4913b619fc0b63c6c425/roles/5c9f98a938a74f35857ce032dd9e06b1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:06:29.859899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856db34-0745-4de1-a120-ca1d4984f99a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:29.896151 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627333f4-05a5-41cd-a262-5fb6a10345fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:29.897083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627333f4-05a5-41cd-a262-5fb6a10345fa None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:29.897406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627333f4-05a5-41cd-a262-5fb6a10345fa None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:29.897688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627333f4-05a5-41cd-a262-5fb6a10345fa None admin] PATH_INFO: `/v3/projects/0af8f49c5b1742ef8455f029a9842d76/users/4b27b1bc486d4913b619fc0b63c6c425/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:29.899743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627333f4-05a5-41cd-a262-5fb6a10345fa None admin] RBAC: Authorizing `identity:create_grant(project_id=0af8f49c5b1742ef8455f029a9842d76, user_id=4b27b1bc486d4913b619fc0b63c6c425, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:29.901246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627333f4-05a5-41cd-a262-5fb6a10345fa None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:29.912040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:29.917636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 67/137] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:06:29 2022] PUT /identity/v3/projects/0af8f49c5b1742ef8455f029a9842d76/users/4b27b1bc486d4913b619fc0b63c6c425/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:06:30.054503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe613ad-ed6c-4631-baae-168bcca7767b None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:30.055012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe613ad-ed6c-4631-baae-168bcca7767b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:30.055083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe613ad-ed6c-4631-baae-168bcca7767b None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:30.056566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 71/138] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:30.062207 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba673-0a2f-43a4-b49d-b9c89fac5bd4 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:30.062497 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba673-0a2f-43a4-b49d-b9c89fac5bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:30.062773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ba673-0a2f-43a4-b49d-b9c89fac5bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:30.086194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-982ba673-0a2f-43a4-b49d-b9c89fac5bd4 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:30.087523 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-982ba673-0a2f-43a4-b49d-b9c89fac5bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:30.107232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd07a1c-0e70-4fbe-b4e4-6224c62a109f None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:30.107558 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd07a1c-0e70-4fbe-b4e4-6224c62a109f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:30.107789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd07a1c-0e70-4fbe-b4e4-6224c62a109f None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:30.109420 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 72/139] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:30.115179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d4f07-884e-4c63-bfdf-b5e57f74f3b3 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:30.115781 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d4f07-884e-4c63-bfdf-b5e57f74f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:30.116251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d4f07-884e-4c63-bfdf-b5e57f74f3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:30.150493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-016d4f07-884e-4c63-bfdf-b5e57f74f3b3 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:30.152077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-016d4f07-884e-4c63-bfdf-b5e57f74f3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:30.167929 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:30.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 68/140] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:30.204839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ba673-0a2f-43a4-b49d-b9c89fac5bd4 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:30.240516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 73/141] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:30.269565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d4f07-884e-4c63-bfdf-b5e57f74f3b3 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:30.318661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ba673-0a2f-43a4-b49d-b9c89fac5bd4 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:30.352261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:30.357347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a9446-3ede-4e88-8066-07de5fc252a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:30.358317 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a9446-3ede-4e88-8066-07de5fc252a9 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:30.358704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a9446-3ede-4e88-8066-07de5fc252a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:30.359081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a9446-3ede-4e88-8066-07de5fc252a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:30.360410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a9446-3ede-4e88-8066-07de5fc252a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:30.365267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a9446-3ede-4e88-8066-07de5fc252a9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:30.365267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 69/142] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:30.370105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a9446-3ede-4e88-8066-07de5fc252a9 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:30.484361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d4f07-884e-4c63-bfdf-b5e57f74f3b3 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:30.503085 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a9446-3ede-4e88-8066-07de5fc252a9 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:30.538161 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f8481-bc01-40e6-a571-edab587a26d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:30.539218 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f8481-bc01-40e6-a571-edab587a26d3 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:30.539696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f8481-bc01-40e6-a571-edab587a26d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:30.540167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f8481-bc01-40e6-a571-edab587a26d3 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:30.541095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f8481-bc01-40e6-a571-edab587a26d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:30.542827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f8481-bc01-40e6-a571-edab587a26d3 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:30.564358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7a7a7-fe44-49d3-baf3-ad8c29c11232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:30.565178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7a7a7-fe44-49d3-baf3-ad8c29c11232 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:30.565496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7a7a7-fe44-49d3-baf3-ad8c29c11232 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:30.565780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7a7a7-fe44-49d3-baf3-ad8c29c11232 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:30.567552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 70/143] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:06:30 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:06:30.598388 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7a7a7-fe44-49d3-baf3-ad8c29c11232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-c0e7a7a7-fe44-49d3-baf3-ad8c29c11232 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:30.606224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:30.607032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:30.607776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:30.607776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:30.607776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:30.607776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:30.607776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:30.607776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:30.607776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:30.607776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:30.607776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:30.607776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:30.607776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:30.607776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:30.612376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 74/144] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:30.613958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f8481-bc01-40e6-a571-edab587a26d3 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:30.678770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:30.735219 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f8481-bc01-40e6-a571-edab587a26d3 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:30.771042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba70f6-4431-4269-9d31-4d7457dda45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:30.772158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba70f6-4431-4269-9d31-4d7457dda45b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:30.772636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba70f6-4431-4269-9d31-4d7457dda45b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:30.773210 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba70f6-4431-4269-9d31-4d7457dda45b None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:30.774235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba70f6-4431-4269-9d31-4d7457dda45b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:30.774760 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba70f6-4431-4269-9d31-4d7457dda45b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:30.776510 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba70f6-4431-4269-9d31-4d7457dda45b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:30.786498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 71/145] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:30.791735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7a7a7-fe44-49d3-baf3-ad8c29c11232 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:30.801379 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:30.943803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7a7a7-fe44-49d3-baf3-ad8c29c11232 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:30.980178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46fab4-59e2-44a2-add5-8a5c9ef2110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:30.981103 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46fab4-59e2-44a2-add5-8a5c9ef2110d None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:30.981419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46fab4-59e2-44a2-add5-8a5c9ef2110d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:30.981736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46fab4-59e2-44a2-add5-8a5c9ef2110d None admin] PATH_INFO: `/v3/users/8a53f0842dd94d659976e09f9e003e72` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:30.982983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46fab4-59e2-44a2-add5-8a5c9ef2110d None admin] RBAC: Authorizing `identity:get_user(user_id=8a53f0842dd94d659976e09f9e003e72)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:30.984494 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46fab4-59e2-44a2-add5-8a5c9ef2110d None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:30.986473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 75/146] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:30 2022] GET /identity/v3/users/8a53f0842dd94d659976e09f9e003e72 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:30.991737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba70f6-4431-4269-9d31-4d7457dda45b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:31.113459 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba70f6-4431-4269-9d31-4d7457dda45b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:31.132927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:31.155924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9f6bb-e056-46a5-8257-19f2ef09bbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:31.156811 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9f6bb-e056-46a5-8257-19f2ef09bbbf None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:31.157096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9f6bb-e056-46a5-8257-19f2ef09bbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:31.157427 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9f6bb-e056-46a5-8257-19f2ef09bbbf None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:31.158655 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9f6bb-e056-46a5-8257-19f2ef09bbbf None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:31.160117 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9f6bb-e056-46a5-8257-19f2ef09bbbf None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:31.161946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 72/147] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:30 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:31.169390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46fab4-59e2-44a2-add5-8a5c9ef2110d None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:31.261724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:31.298889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46fab4-59e2-44a2-add5-8a5c9ef2110d None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:31.340629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fd077-e502-4a58-8345-28047ff8f465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:31.341580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fd077-e502-4a58-8345-28047ff8f465 None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:31.341867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fd077-e502-4a58-8345-28047ff8f465 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:31.342146 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fd077-e502-4a58-8345-28047ff8f465 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06/users/8a53f0842dd94d659976e09f9e003e72/roles/a4709d01dc6b4ff6a2471497008b7808` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:31.344528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fd077-e502-4a58-8345-28047ff8f465 None admin] RBAC: Authorizing `identity:create_grant(project_id=02a8a5b7d75b4de4b84070e456454f06, user_id=8a53f0842dd94d659976e09f9e003e72, role_id=a4709d01dc6b4ff6a2471497008b7808)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:31.346049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fd077-e502-4a58-8345-28047ff8f465 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:31.366824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 76/148] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:06:31 2022] PUT /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06/users/8a53f0842dd94d659976e09f9e003e72/roles/a4709d01dc6b4ff6a2471497008b7808 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:06:31.923211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028cd6f-4105-45d9-a0db-e6bdca761770 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:31.923583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028cd6f-4105-45d9-a0db-e6bdca761770 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:31.923783 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028cd6f-4105-45d9-a0db-e6bdca761770 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:31.925552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 73/149] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:31.936667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c124e-cae7-4e2d-b7b9-ff565f7ee26c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:31.936951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c124e-cae7-4e2d-b7b9-ff565f7ee26c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:31.937286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c124e-cae7-4e2d-b7b9-ff565f7ee26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:31.958884 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e03c124e-cae7-4e2d-b7b9-ff565f7ee26c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:31.960147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e03c124e-cae7-4e2d-b7b9-ff565f7ee26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:32.035505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 77/150] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:32.075750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028cd6f-4105-45d9-a0db-e6bdca761770 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:32.195988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028cd6f-4105-45d9-a0db-e6bdca761770 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:32.239394 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a6d3f-90c3-495b-8bf3-ead0eb8a7a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:32.240276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a6d3f-90c3-495b-8bf3-ead0eb8a7a75 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:32.240554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a6d3f-90c3-495b-8bf3-ead0eb8a7a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:32.240824 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a6d3f-90c3-495b-8bf3-ead0eb8a7a75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:32.253618 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a6d3f-90c3-495b-8bf3-ead0eb8a7a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-f58a6d3f-90c3-495b-8bf3-ead0eb8a7a75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:32.261586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:32.262428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:32.264406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 74/151] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:32.271604 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c124e-cae7-4e2d-b7b9-ff565f7ee26c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:32.369525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:32.432162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c124e-cae7-4e2d-b7b9-ff565f7ee26c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:32.479452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be88968-7e85-4f35-ba86-b9c188351607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:32.480067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be88968-7e85-4f35-ba86-b9c188351607 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:32.480350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be88968-7e85-4f35-ba86-b9c188351607 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:32.480636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be88968-7e85-4f35-ba86-b9c188351607 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:32.481436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be88968-7e85-4f35-ba86-b9c188351607 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:32.481749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be88968-7e85-4f35-ba86-b9c188351607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:32.483163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be88968-7e85-4f35-ba86-b9c188351607 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:32.497147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 78/152] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:32.503302 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a6d3f-90c3-495b-8bf3-ead0eb8a7a75 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:32.529258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd2774-d601-445d-af2b-2d5fb994c632 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:32.529571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd2774-d601-445d-af2b-2d5fb994c632 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:32.529975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd2774-d601-445d-af2b-2d5fb994c632 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:32.531692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 79/153] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:06:32.538060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39133f1b-cb31-4464-856e-6618f065fd9b None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:32.538354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39133f1b-cb31-4464-856e-6618f065fd9b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:32.538636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39133f1b-cb31-4464-856e-6618f065fd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:32.574933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:32.578338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-39133f1b-cb31-4464-856e-6618f065fd9b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:32.579577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-39133f1b-cb31-4464-856e-6618f065fd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:32.654867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a6d3f-90c3-495b-8bf3-ead0eb8a7a75 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:32.714934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb5015-01ae-4d89-a787-94c2cacdce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:32.716630 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb5015-01ae-4d89-a787-94c2cacdce39 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:32.717131 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb5015-01ae-4d89-a787-94c2cacdce39 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:32.717630 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb5015-01ae-4d89-a787-94c2cacdce39 None admin] PATH_INFO: `/v3/users/a3aabddbd41c4280b0867d9e10f45bdf` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:32.719700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb5015-01ae-4d89-a787-94c2cacdce39 None admin] RBAC: Authorizing `identity:get_user(user_id=a3aabddbd41c4280b0867d9e10f45bdf)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:32.721495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb5015-01ae-4d89-a787-94c2cacdce39 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:32.724455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 75/154] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:32 2022] GET /identity/v3/users/a3aabddbd41c4280b0867d9e10f45bdf => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:32.729681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb5015-01ae-4d89-a787-94c2cacdce39 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:32.749293 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 80/155] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:32.809567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39133f1b-cb31-4464-856e-6618f065fd9b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:32.893036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb5015-01ae-4d89-a787-94c2cacdce39 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:32.914963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:32.924153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:32.970534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73f887-b6aa-445f-81ee-12ebbea7cdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:32.971199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73f887-b6aa-445f-81ee-12ebbea7cdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:32.971771 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73f887-b6aa-445f-81ee-12ebbea7cdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:32.971771 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73f887-b6aa-445f-81ee-12ebbea7cdc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:33.049599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39133f1b-cb31-4464-856e-6618f065fd9b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:33.098668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73f887-b6aa-445f-81ee-12ebbea7cdc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:33.100392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73f887-b6aa-445f-81ee-12ebbea7cdc2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:33.118541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620727e-51d2-4c5e-b92c-25105f6cb3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:33.119596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620727e-51d2-4c5e-b92c-25105f6cb3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:33.120074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620727e-51d2-4c5e-b92c-25105f6cb3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:33.120526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620727e-51d2-4c5e-b92c-25105f6cb3a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:33.142671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620727e-51d2-4c5e-b92c-25105f6cb3a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-9620727e-51d2-4c5e-b92c-25105f6cb3a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:33.158776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:33.159993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:33.160819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:33.160819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:33.160819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:33.160819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:33.160819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:33.160819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:33.160819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:33.160819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:33.160819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:33.160819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:33.160819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:33.160819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:33.168037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 81/156] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:33.169734 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc20f0-4caf-47a2-bb34-24ca9881cfb4 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:33.170224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc20f0-4caf-47a2-bb34-24ca9881cfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:33.170716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc20f0-4caf-47a2-bb34-24ca9881cfb4 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:33.172596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 82/157] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:33.173531 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc20f0-4caf-47a2-bb34-24ca9881cfb4 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:33.285919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 76/158] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:33.287284 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50013f-67d2-40f2-86d9-0933fd125bb0 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:33.287715 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50013f-67d2-40f2-86d9-0933fd125bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:33.288120 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50013f-67d2-40f2-86d9-0933fd125bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:33.321195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-fb50013f-67d2-40f2-86d9-0933fd125bb0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:33.322654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-fb50013f-67d2-40f2-86d9-0933fd125bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:33.335814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:33.355130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc20f0-4caf-47a2-bb34-24ca9881cfb4 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:33.374781 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:33.425969 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca58e5-4f47-4044-9bc9-7831fac486a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:33.426664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca58e5-4f47-4044-9bc9-7831fac486a6 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:33.426953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca58e5-4f47-4044-9bc9-7831fac486a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:33.427230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca58e5-4f47-4044-9bc9-7831fac486a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:33.428001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca58e5-4f47-4044-9bc9-7831fac486a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:33.428340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca58e5-4f47-4044-9bc9-7831fac486a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:33.429793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca58e5-4f47-4044-9bc9-7831fac486a6 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:33.439763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 83/159] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:33.440969 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca58e5-4f47-4044-9bc9-7831fac486a6 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:33.471062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 77/160] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:33.472297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50013f-67d2-40f2-86d9-0933fd125bb0 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:33.596455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca58e5-4f47-4044-9bc9-7831fac486a6 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:33.646018 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a63c7-cbd9-4207-a376-917a2836f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:33.647198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a63c7-cbd9-4207-a376-917a2836f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:33.647649 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a63c7-cbd9-4207-a376-917a2836f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:33.648115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a63c7-cbd9-4207-a376-917a2836f5f6 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:33.649758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a63c7-cbd9-4207-a376-917a2836f5f6 None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:33.651473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a63c7-cbd9-4207-a376-917a2836f5f6 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:33.653519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 84/161] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:33 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:33.657256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a63c7-cbd9-4207-a376-917a2836f5f6 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:33.674468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50013f-67d2-40f2-86d9-0933fd125bb0 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:33.729245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:33.781961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198bab3-f429-4635-9e1a-4bfeecd82c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:33.782872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198bab3-f429-4635-9e1a-4bfeecd82c86 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:33.783160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198bab3-f429-4635-9e1a-4bfeecd82c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:33.783442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198bab3-f429-4635-9e1a-4bfeecd82c86 None admin] PATH_INFO: `/v3/users/4b27b1bc486d4913b619fc0b63c6c425` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:33.784735 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198bab3-f429-4635-9e1a-4bfeecd82c86 None admin] RBAC: Authorizing `identity:get_user(user_id=4b27b1bc486d4913b619fc0b63c6c425)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:33.786097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a63c7-cbd9-4207-a376-917a2836f5f6 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:33.786224 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198bab3-f429-4635-9e1a-4bfeecd82c86 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:33.787929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 78/162] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:33 2022] GET /identity/v3/users/4b27b1bc486d4913b619fc0b63c6c425 => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:33.788866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198bab3-f429-4635-9e1a-4bfeecd82c86 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:33.819211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:33.823414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e1b1c-7dd4-4aa6-a8e4-b726d5b1a927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:33.824522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e1b1c-7dd4-4aa6-a8e4-b726d5b1a927 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:33.825020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e1b1c-7dd4-4aa6-a8e4-b726d5b1a927 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:33.825522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e1b1c-7dd4-4aa6-a8e4-b726d5b1a927 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:33.844644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e1b1c-7dd4-4aa6-a8e4-b726d5b1a927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-d74e1b1c-7dd4-4aa6-a8e4-b726d5b1a927 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:33.858305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:33.859184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:33.859948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:33.859948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:33.859948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:33.859948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:33.859948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:33.859948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:33.859948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:33.859948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:33.859948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:33.859948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:33.859948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:33.859948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:33.862994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 85/163] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:06:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:33.865430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e1b1c-7dd4-4aa6-a8e4-b726d5b1a927 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:33.987304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198bab3-f429-4635-9e1a-4bfeecd82c86 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:34.027521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440946a-2fc9-409b-90d7-034375c91365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:34.028790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440946a-2fc9-409b-90d7-034375c91365 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:34.029357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440946a-2fc9-409b-90d7-034375c91365 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:34.030004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440946a-2fc9-409b-90d7-034375c91365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:34.031077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440946a-2fc9-409b-90d7-034375c91365 None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=02a8a5b7d75b4de4b84070e456454f06, user.id=a3aabddbd41c4280b0867d9e10f45bdf) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:34.031589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440946a-2fc9-409b-90d7-034375c91365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:34.033437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440946a-2fc9-409b-90d7-034375c91365 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:34.044852 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 79/164] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:33 2022] GET /identity/v3/role_assignments?user.id=a3aabddbd41c4280b0867d9e10f45bdf&scope.project.id=02a8a5b7d75b4de4b84070e456454f06&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:34.046587 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440946a-2fc9-409b-90d7-034375c91365 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:34.079780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e1b1c-7dd4-4aa6-a8e4-b726d5b1a927 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:34.087437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:34.182635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8709278-41f2-453f-a550-0c890caa9302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:34.183740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8709278-41f2-453f-a550-0c890caa9302 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:34.184215 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8709278-41f2-453f-a550-0c890caa9302 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:34.184695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8709278-41f2-453f-a550-0c890caa9302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:34.188474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:34.246081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440946a-2fc9-409b-90d7-034375c91365 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:34.310935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3537c-ee11-4264-8bea-ca2f15c9ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:34.312416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3537c-ee11-4264-8bea-ca2f15c9ac04 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:34.312956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3537c-ee11-4264-8bea-ca2f15c9ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:34.313461 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3537c-ee11-4264-8bea-ca2f15c9ac04 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:34.314459 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3537c-ee11-4264-8bea-ca2f15c9ac04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:34.314979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3537c-ee11-4264-8bea-ca2f15c9ac04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:34.316647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3537c-ee11-4264-8bea-ca2f15c9ac04 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:34.334237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 80/165] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:06:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:34.335951 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defa8e6-da53-483b-a4c1-b17f11c7ce41 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:34.336427 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defa8e6-da53-483b-a4c1-b17f11c7ce41 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:34.336891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defa8e6-da53-483b-a4c1-b17f11c7ce41 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:34.338879 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 81/166] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:34.346688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defa8e6-da53-483b-a4c1-b17f11c7ce41 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:34.378332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8709278-41f2-453f-a550-0c890caa9302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:34.380392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8709278-41f2-453f-a550-0c890caa9302 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:34.495925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defa8e6-da53-483b-a4c1-b17f11c7ce41 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:34.538666 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b307b0-d1ec-446b-8807-fc4765bbaff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:34.540138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b307b0-d1ec-446b-8807-fc4765bbaff7 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:34.540519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b307b0-d1ec-446b-8807-fc4765bbaff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:34.540887 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b307b0-d1ec-446b-8807-fc4765bbaff7 None admin] PATH_INFO: `/v3/users/4b27b1bc486d4913b619fc0b63c6c425` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:34.542443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b307b0-d1ec-446b-8807-fc4765bbaff7 None admin] RBAC: Authorizing `identity:get_user(user_id=4b27b1bc486d4913b619fc0b63c6c425)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:34.544137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b307b0-d1ec-446b-8807-fc4765bbaff7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:34.546481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 82/167] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:34 2022] GET /identity/v3/users/4b27b1bc486d4913b619fc0b63c6c425 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:34.547936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4306-c932-447e-9487-025eb83f970b None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:34.548404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4306-c932-447e-9487-025eb83f970b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:34.548867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4306-c932-447e-9487-025eb83f970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:34.558146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:34.562294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 86/168] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:34.568636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8709278-41f2-453f-a550-0c890caa9302 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:34.572704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:34.579710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0dfe4306-c932-447e-9487-025eb83f970b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:34.581282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0dfe4306-c932-447e-9487-025eb83f970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:34.710598 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 83/169] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:34.711788 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe4306-c932-447e-9487-025eb83f970b None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:34.712777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8709278-41f2-453f-a550-0c890caa9302 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:34.788635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf355e0-1d79-48df-8933-3eb1665ad364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:34.789441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf355e0-1d79-48df-8933-3eb1665ad364 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:34.789755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf355e0-1d79-48df-8933-3eb1665ad364 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:34.790045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf355e0-1d79-48df-8933-3eb1665ad364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:34.872318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe4306-c932-447e-9487-025eb83f970b None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:34.911152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183f4e7-0b4e-45eb-a9b4-050230ed4a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:34.912029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183f4e7-0b4e-45eb-a9b4-050230ed4a73 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:34.912311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183f4e7-0b4e-45eb-a9b4-050230ed4a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:34.912592 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183f4e7-0b4e-45eb-a9b4-050230ed4a73 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:34.913824 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183f4e7-0b4e-45eb-a9b4-050230ed4a73 None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:34.915404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183f4e7-0b4e-45eb-a9b4-050230ed4a73 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:34.917207 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 84/170] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:34 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:34.918010 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183f4e7-0b4e-45eb-a9b4-050230ed4a73 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:34.930958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:34.942952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf355e0-1d79-48df-8933-3eb1665ad364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:34.944838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf355e0-1d79-48df-8933-3eb1665ad364 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:34.949693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:35.048203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 87/171] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:35.049899 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a233-3da3-4fe5-8d89-f866fb1b1291 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.050433 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a233-3da3-4fe5-8d89-f866fb1b1291 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.050906 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a233-3da3-4fe5-8d89-f866fb1b1291 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.052514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 88/172] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:35.053489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545a233-3da3-4fe5-8d89-f866fb1b1291 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:35.133312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183f4e7-0b4e-45eb-a9b4-050230ed4a73 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:35.160428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545a233-3da3-4fe5-8d89-f866fb1b1291 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:35.169599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:35.198123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d27b8-fbe5-4eca-840c-2b2d15eb2447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:35.199180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d27b8-fbe5-4eca-840c-2b2d15eb2447 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.199715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d27b8-fbe5-4eca-840c-2b2d15eb2447 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.200258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d27b8-fbe5-4eca-840c-2b2d15eb2447 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.201424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d27b8-fbe5-4eca-840c-2b2d15eb2447 None admin] RBAC: Adding query filter params (role.id=118677ef2dfa4e808ddc78b083c01059, scope.project.id=02a8a5b7d75b4de4b84070e456454f06, user.id=4b27b1bc486d4913b619fc0b63c6c425) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:35.201992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d27b8-fbe5-4eca-840c-2b2d15eb2447 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:35.202611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336a1a7-7c21-42a9-a000-4d7aa1a1926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:35.203423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336a1a7-7c21-42a9-a000-4d7aa1a1926c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.203709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336a1a7-7c21-42a9-a000-4d7aa1a1926c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.203985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336a1a7-7c21-42a9-a000-4d7aa1a1926c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.204774 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d27b8-fbe5-4eca-840c-2b2d15eb2447 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:35.212482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 89/173] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:35 2022] GET /identity/v3/role_assignments?user.id=4b27b1bc486d4913b619fc0b63c6c425&scope.project.id=02a8a5b7d75b4de4b84070e456454f06&role.id=118677ef2dfa4e808ddc78b083c01059 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:35.213972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d27b8-fbe5-4eca-840c-2b2d15eb2447 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:35.238284 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336a1a7-7c21-42a9-a000-4d7aa1a1926c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-5336a1a7-7c21-42a9-a000-4d7aa1a1926c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:35.253952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:35.254875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 85/174] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:35.256237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8adf1-697f-4d6b-b2ab-f264bb846aab None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.256955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8adf1-697f-4d6b-b2ab-f264bb846aab None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.256955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8adf1-697f-4d6b-b2ab-f264bb846aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.298401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-c6a8adf1-697f-4d6b-b2ab-f264bb846aab None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:35.299529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c6a8adf1-697f-4d6b-b2ab-f264bb846aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:35.329942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d27b8-fbe5-4eca-840c-2b2d15eb2447 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:35.370721 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9960c0-5b1c-4d77-b96a-64fc16039e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:35.372005 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9960c0-5b1c-4d77-b96a-64fc16039e17 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.372505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9960c0-5b1c-4d77-b96a-64fc16039e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.372978 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9960c0-5b1c-4d77-b96a-64fc16039e17 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.382331 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9960c0-5b1c-4d77-b96a-64fc16039e17 None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:35.384648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9960c0-5b1c-4d77-b96a-64fc16039e17 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:35.386850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 90/175] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:35 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:35.400289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9960c0-5b1c-4d77-b96a-64fc16039e17 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:35.413612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:35.434389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 86/176] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:35.435421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8adf1-697f-4d6b-b2ab-f264bb846aab None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:35.489556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:35.567228 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9960c0-5b1c-4d77-b96a-64fc16039e17 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:35.582780 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8adf1-697f-4d6b-b2ab-f264bb846aab None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:35.604710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f350a8-fa92-4217-817d-6eb1fda781bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:35.605800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f350a8-fa92-4217-817d-6eb1fda781bb None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.606273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f350a8-fa92-4217-817d-6eb1fda781bb None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.606734 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f350a8-fa92-4217-817d-6eb1fda781bb None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.607706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f350a8-fa92-4217-817d-6eb1fda781bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:35.608197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f350a8-fa92-4217-817d-6eb1fda781bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:35.610986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f350a8-fa92-4217-817d-6eb1fda781bb None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:35.620265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 91/177] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:35.626392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b35b23-7ea2-4e2b-87d2-b749625aeb86 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.626996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b35b23-7ea2-4e2b-87d2-b749625aeb86 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.627276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b35b23-7ea2-4e2b-87d2-b749625aeb86 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.628824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 92/178] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:35.629458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b35b23-7ea2-4e2b-87d2-b749625aeb86 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:35.633272 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552290e-be77-435d-897d-8fbc05fbc5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:35.634873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552290e-be77-435d-897d-8fbc05fbc5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.635160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552290e-be77-435d-897d-8fbc05fbc5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.635480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552290e-be77-435d-897d-8fbc05fbc5a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.636335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552290e-be77-435d-897d-8fbc05fbc5a3 None admin] RBAC: Adding query filter params (role.id=5c9f98a938a74f35857ce032dd9e06b1, scope.project.id=02a8a5b7d75b4de4b84070e456454f06, user.id=4b27b1bc486d4913b619fc0b63c6c425) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:35.636650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552290e-be77-435d-897d-8fbc05fbc5a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:35.638905 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552290e-be77-435d-897d-8fbc05fbc5a3 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:35.647293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 87/179] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:35 2022] GET /identity/v3/role_assignments?user.id=4b27b1bc486d4913b619fc0b63c6c425&scope.project.id=02a8a5b7d75b4de4b84070e456454f06&role.id=5c9f98a938a74f35857ce032dd9e06b1 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:35.650207 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552290e-be77-435d-897d-8fbc05fbc5a3 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:35.767629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:35.771767 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:35.778171 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b35b23-7ea2-4e2b-87d2-b749625aeb86 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:35.818533 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75eace9-2fde-426d-8849-05296c45266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:35.819264 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75eace9-2fde-426d-8849-05296c45266a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.819538 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75eace9-2fde-426d-8849-05296c45266a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.819636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552290e-be77-435d-897d-8fbc05fbc5a3 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:35.819806 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75eace9-2fde-426d-8849-05296c45266a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.835158 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75eace9-2fde-426d-8849-05296c45266a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-e75eace9-2fde-426d-8849-05296c45266a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:35.843077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:35.843952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:35.844715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 93/180] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:06:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:35.846616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c5f13-a8bc-485c-b194-1cf9cc5dafb4 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.846901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c5f13-a8bc-485c-b194-1cf9cc5dafb4 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.847177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c5f13-a8bc-485c-b194-1cf9cc5dafb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.863670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4d838-a7e4-4a1f-a14d-eed1bed18650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:35.864590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4d838-a7e4-4a1f-a14d-eed1bed18650 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.864886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4d838-a7e4-4a1f-a14d-eed1bed18650 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.865150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4d838-a7e4-4a1f-a14d-eed1bed18650 None admin] PATH_INFO: `/v3/users/4b27b1bc486d4913b619fc0b63c6c425` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.866406 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-8e1c5f13-a8bc-485c-b194-1cf9cc5dafb4 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:35.868163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4d838-a7e4-4a1f-a14d-eed1bed18650 None admin] RBAC: Authorizing `identity:get_user(user_id=4b27b1bc486d4913b619fc0b63c6c425)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:35.868276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8e1c5f13-a8bc-485c-b194-1cf9cc5dafb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:35.868983 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4d838-a7e4-4a1f-a14d-eed1bed18650 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:35.871195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 88/181] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:35 2022] GET /identity/v3/users/4b27b1bc486d4913b619fc0b63c6c425 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:35.872313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf40a1-e3d3-48f3-a966-3ed6ccf9cd04 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.872600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf40a1-e3d3-48f3-a966-3ed6ccf9cd04 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.872879 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf40a1-e3d3-48f3-a966-3ed6ccf9cd04 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.874373 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 89/182] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:35.875365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414df67-9412-4db0-b5db-d622104c2c81 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.875646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414df67-9412-4db0-b5db-d622104c2c81 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.875920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414df67-9412-4db0-b5db-d622104c2c81 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.877181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 90/183] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:35.883184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414df67-9412-4db0-b5db-d622104c2c81 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:35.948593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 94/184] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:35.949966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d08fe-0fb6-44d3-be27-1f115dd58099 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:35.950335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d08fe-0fb6-44d3-be27-1f115dd58099 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:35.950534 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d08fe-0fb6-44d3-be27-1f115dd58099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:35.975347 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-f72d08fe-0fb6-44d3-be27-1f115dd58099 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:35.976566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f72d08fe-0fb6-44d3-be27-1f115dd58099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:35.993162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414df67-9412-4db0-b5db-d622104c2c81 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:36.016477 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:36.028255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2d8dd-2485-404b-ac37-88bf270cdc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:36.028941 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2d8dd-2485-404b-ac37-88bf270cdc4c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:36.029236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2d8dd-2485-404b-ac37-88bf270cdc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:36.029524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2d8dd-2485-404b-ac37-88bf270cdc4c None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:36.030286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2d8dd-2485-404b-ac37-88bf270cdc4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:36.030594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2d8dd-2485-404b-ac37-88bf270cdc4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:36.031992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2d8dd-2485-404b-ac37-88bf270cdc4c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:36.040346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 91/185] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:36.041154 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2d8dd-2485-404b-ac37-88bf270cdc4c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:36.048843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 95/186] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:36.050234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9405-a2b7-41e3-9829-4e220478669e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:36.050529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9405-a2b7-41e3-9829-4e220478669e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:36.050810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9405-a2b7-41e3-9829-4e220478669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:36.075215 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a45c9405-a2b7-41e3-9829-4e220478669e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:36.076327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a45c9405-a2b7-41e3-9829-4e220478669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:36.090106 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:36.150070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 96/187] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:36.151096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c9405-a2b7-41e3-9829-4e220478669e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:36.163073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2d8dd-2485-404b-ac37-88bf270cdc4c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:36.199979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4fd92-c2f0-4625-bade-f8fe9618d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:36.200915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4fd92-c2f0-4625-bade-f8fe9618d5ff None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:36.201494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4fd92-c2f0-4625-bade-f8fe9618d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:36.201913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4fd92-c2f0-4625-bade-f8fe9618d5ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:36.253817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c9405-a2b7-41e3-9829-4e220478669e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:36.259062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:36.273742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4fd92-c2f0-4625-bade-f8fe9618d5ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:36.275228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4fd92-c2f0-4625-bade-f8fe9618d5ff None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:36.288279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713fedc-202f-4642-9d2e-72aa191a1978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:36.289100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713fedc-202f-4642-9d2e-72aa191a1978 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:36.289409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713fedc-202f-4642-9d2e-72aa191a1978 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:36.289692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713fedc-202f-4642-9d2e-72aa191a1978 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:36.300430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713fedc-202f-4642-9d2e-72aa191a1978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-a713fedc-202f-4642-9d2e-72aa191a1978 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:36.308280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:36.309467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:36.310461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 97/188] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:36.311168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713fedc-202f-4642-9d2e-72aa191a1978 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:36.323902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:36.377427 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 92/189] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:36.379562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4fd92-c2f0-4625-bade-f8fe9618d5ff None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:36.414858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713fedc-202f-4642-9d2e-72aa191a1978 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:36.449393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fb86d-cedc-470d-8f50-dde9fb60237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:36.450278 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fb86d-cedc-470d-8f50-dde9fb60237d None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:36.450553 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fb86d-cedc-470d-8f50-dde9fb60237d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:36.450824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fb86d-cedc-470d-8f50-dde9fb60237d None admin] PATH_INFO: `/v3/users/f85a99a2a3fb4e2f813dee4765602c76` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:36.464290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fb86d-cedc-470d-8f50-dde9fb60237d None admin] RBAC: Authorizing `identity:get_user(user_id=f85a99a2a3fb4e2f813dee4765602c76)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:36.465832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fb86d-cedc-470d-8f50-dde9fb60237d None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:36.466777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:36.467871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 98/190] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:36 2022] GET /identity/v3/users/f85a99a2a3fb4e2f813dee4765602c76 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:36.468388 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fb86d-cedc-470d-8f50-dde9fb60237d None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:36.482699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4fd92-c2f0-4625-bade-f8fe9618d5ff None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:36.518357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc8ba-e500-4928-961b-e141b632f51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:36.519172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc8ba-e500-4928-961b-e141b632f51b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:36.519453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc8ba-e500-4928-961b-e141b632f51b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:36.519730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc8ba-e500-4928-961b-e141b632f51b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:36.520956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc8ba-e500-4928-961b-e141b632f51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:36.522486 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc8ba-e500-4928-961b-e141b632f51b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:36.524356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 93/191] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:36.525054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc8ba-e500-4928-961b-e141b632f51b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:36.536982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:36.572166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fb86d-cedc-470d-8f50-dde9fb60237d None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:36.606910 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac6faf-a992-4376-b452-ed4ee911049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:36.607717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac6faf-a992-4376-b452-ed4ee911049a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:36.608000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac6faf-a992-4376-b452-ed4ee911049a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:36.608266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac6faf-a992-4376-b452-ed4ee911049a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:36.618778 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac6faf-a992-4376-b452-ed4ee911049a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:36.622953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc8ba-e500-4928-961b-e141b632f51b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-39ac6faf-a992-4376-b452-ed4ee911049a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:36.626686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:36.628516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 99/192] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:06:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:36.630255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac6faf-a992-4376-b452-ed4ee911049a None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:36.662436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37d01d-8d4d-4546-b996-f3436a0b7a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:36.663114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37d01d-8d4d-4546-b996-f3436a0b7a9f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:36.663398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37d01d-8d4d-4546-b996-f3436a0b7a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:36.663668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37d01d-8d4d-4546-b996-f3436a0b7a9f None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:36.664431 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37d01d-8d4d-4546-b996-f3436a0b7a9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:36.664738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37d01d-8d4d-4546-b996-f3436a0b7a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:36.666167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37d01d-8d4d-4546-b996-f3436a0b7a9f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:36.674928 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 94/193] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:36.679702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37d01d-8d4d-4546-b996-f3436a0b7a9f None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:36.694661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:36.738238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac6faf-a992-4376-b452-ed4ee911049a None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:36.764192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:36.774209 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f617bfd-1494-4a46-83ce-ba7ecbb2608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:36.775085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617bfd-1494-4a46-83ce-ba7ecbb2608c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:36.775366 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617bfd-1494-4a46-83ce-ba7ecbb2608c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:36.775641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617bfd-1494-4a46-83ce-ba7ecbb2608c None admin] PATH_INFO: `/v3/projects/0af8f49c5b1742ef8455f029a9842d76` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:36.776817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f617bfd-1494-4a46-83ce-ba7ecbb2608c None admin] RBAC: Authorizing `identity:get_project(project_id=0af8f49c5b1742ef8455f029a9842d76)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:36.778342 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f617bfd-1494-4a46-83ce-ba7ecbb2608c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:36.780353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 100/194] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:36 2022] GET /identity/v3/projects/0af8f49c5b1742ef8455f029a9842d76 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:36.780856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f617bfd-1494-4a46-83ce-ba7ecbb2608c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:36.787974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37d01d-8d4d-4546-b996-f3436a0b7a9f None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:36.823571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4c37f-4dd1-4f13-8f70-1b581abd5173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:36.824216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4c37f-4dd1-4f13-8f70-1b581abd5173 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:36.824516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4c37f-4dd1-4f13-8f70-1b581abd5173 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:36.824797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4c37f-4dd1-4f13-8f70-1b581abd5173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:36.880239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f617bfd-1494-4a46-83ce-ba7ecbb2608c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:36.892492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4c37f-4dd1-4f13-8f70-1b581abd5173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:36.894003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4c37f-4dd1-4f13-8f70-1b581abd5173 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:36.910432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:36.912935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491f790-65a0-455e-9145-b6adfb0704a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:36.913696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491f790-65a0-455e-9145-b6adfb0704a7 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:36.913980 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491f790-65a0-455e-9145-b6adfb0704a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:36.914279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491f790-65a0-455e-9145-b6adfb0704a7 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:36.915000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491f790-65a0-455e-9145-b6adfb0704a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:36.916603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491f790-65a0-455e-9145-b6adfb0704a7 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:36.938252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 101/195] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:06:36 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:06:36.946670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491f790-65a0-455e-9145-b6adfb0704a7 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:37.007766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 95/196] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:37.008096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:37.009337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4c37f-4dd1-4f13-8f70-1b581abd5173 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:37.072175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491f790-65a0-455e-9145-b6adfb0704a7 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:37.110648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f9720-1fb8-4425-ac6d-6dab8d363241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:37.111332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f9720-1fb8-4425-ac6d-6dab8d363241 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:37.111622 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f9720-1fb8-4425-ac6d-6dab8d363241 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:37.111902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f9720-1fb8-4425-ac6d-6dab8d363241 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:37.112665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f9720-1fb8-4425-ac6d-6dab8d363241 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:37.112981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f9720-1fb8-4425-ac6d-6dab8d363241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:37.114457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f9720-1fb8-4425-ac6d-6dab8d363241 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:37.124583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 102/197] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:06:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:37.124752 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4c37f-4dd1-4f13-8f70-1b581abd5173 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:37.125378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f9720-1fb8-4425-ac6d-6dab8d363241 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:37.147638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:37.167372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47d312-a49b-4fd9-801e-38be55afa1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:37.168262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d312-a49b-4fd9-801e-38be55afa1fe None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:37.168546 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d312-a49b-4fd9-801e-38be55afa1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:37.168822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d312-a49b-4fd9-801e-38be55afa1fe None admin] PATH_INFO: `/v3/users/8a53f0842dd94d659976e09f9e003e72` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:37.170078 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47d312-a49b-4fd9-801e-38be55afa1fe None admin] RBAC: Authorizing `identity:get_user(user_id=8a53f0842dd94d659976e09f9e003e72)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:37.171679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47d312-a49b-4fd9-801e-38be55afa1fe None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:37.175854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 96/198] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:37 2022] GET /identity/v3/users/8a53f0842dd94d659976e09f9e003e72 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:37.175854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47d312-a49b-4fd9-801e-38be55afa1fe None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:37.254757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f9720-1fb8-4425-ac6d-6dab8d363241 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:37.271386 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:37.299842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635ae41-4638-472b-a9a7-4cf9c2f0b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:37.300504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635ae41-4638-472b-a9a7-4cf9c2f0b075 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:37.300784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635ae41-4638-472b-a9a7-4cf9c2f0b075 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:37.301057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635ae41-4638-472b-a9a7-4cf9c2f0b075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:37.301958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635ae41-4638-472b-a9a7-4cf9c2f0b075 None admin] RBAC: Adding query filter params (role.id=118677ef2dfa4e808ddc78b083c01059, scope.project.id=0af8f49c5b1742ef8455f029a9842d76, user.id=4b27b1bc486d4913b619fc0b63c6c425) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:37.302243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635ae41-4638-472b-a9a7-4cf9c2f0b075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:37.303747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635ae41-4638-472b-a9a7-4cf9c2f0b075 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:37.311850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 103/199] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:37 2022] GET /identity/v3/role_assignments?user.id=4b27b1bc486d4913b619fc0b63c6c425&scope.project.id=0af8f49c5b1742ef8455f029a9842d76&role.id=118677ef2dfa4e808ddc78b083c01059 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:37.312688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635ae41-4638-472b-a9a7-4cf9c2f0b075 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:37.320195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47d312-a49b-4fd9-801e-38be55afa1fe None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:37.381459 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b3ff4-22a5-47e2-95cf-3aa42724e6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:37.382957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b3ff4-22a5-47e2-95cf-3aa42724e6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:37.383237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b3ff4-22a5-47e2-95cf-3aa42724e6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:37.383513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b3ff4-22a5-47e2-95cf-3aa42724e6c8 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:37.386414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b3ff4-22a5-47e2-95cf-3aa42724e6c8 None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:37.391578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b3ff4-22a5-47e2-95cf-3aa42724e6c8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:37.394958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 97/200] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:37 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:37.396669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b3ff4-22a5-47e2-95cf-3aa42724e6c8 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:37.476476 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635ae41-4638-472b-a9a7-4cf9c2f0b075 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:37.497751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:37.526135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32438195-79e9-487c-8410-72fb7e689354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:37.527046 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32438195-79e9-487c-8410-72fb7e689354 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:37.527538 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32438195-79e9-487c-8410-72fb7e689354 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:37.527804 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32438195-79e9-487c-8410-72fb7e689354 None admin] PATH_INFO: `/v3/users/f85a99a2a3fb4e2f813dee4765602c76` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:37.531385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32438195-79e9-487c-8410-72fb7e689354 None admin] RBAC: Authorizing `identity:get_user(user_id=f85a99a2a3fb4e2f813dee4765602c76)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:37.533583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32438195-79e9-487c-8410-72fb7e689354 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:37.542718 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 104/201] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:37 2022] GET /identity/v3/users/f85a99a2a3fb4e2f813dee4765602c76 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:37.543645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32438195-79e9-487c-8410-72fb7e689354 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:37.580106 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b3ff4-22a5-47e2-95cf-3aa42724e6c8 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:37.600061 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:37.620088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99dd61-3e4a-42a8-996a-37f6bbefcfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:37.620776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99dd61-3e4a-42a8-996a-37f6bbefcfae None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:37.621062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99dd61-3e4a-42a8-996a-37f6bbefcfae None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:37.621386 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99dd61-3e4a-42a8-996a-37f6bbefcfae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:37.683030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32438195-79e9-487c-8410-72fb7e689354 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:37.715706 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99dd61-3e4a-42a8-996a-37f6bbefcfae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:37.717201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99dd61-3e4a-42a8-996a-37f6bbefcfae None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:37.728778 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391802bb-0f78-4fa9-9ebd-6c36d24ea4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:37.730301 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391802bb-0f78-4fa9-9ebd-6c36d24ea4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:37.730807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391802bb-0f78-4fa9-9ebd-6c36d24ea4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:37.731700 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391802bb-0f78-4fa9-9ebd-6c36d24ea4e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:37.733029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391802bb-0f78-4fa9-9ebd-6c36d24ea4e4 None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=609cac1f44f0468f95e1a23aa0389ca2, user.id=f85a99a2a3fb4e2f813dee4765602c76) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:37.733592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391802bb-0f78-4fa9-9ebd-6c36d24ea4e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:37.736193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391802bb-0f78-4fa9-9ebd-6c36d24ea4e4 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:37.745108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 105/202] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:37 2022] GET /identity/v3/role_assignments?user.id=f85a99a2a3fb4e2f813dee4765602c76&scope.project.id=609cac1f44f0468f95e1a23aa0389ca2&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:37.746343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391802bb-0f78-4fa9-9ebd-6c36d24ea4e4 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:37.823182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:37.928361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 98/203] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:37.935733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99dd61-3e4a-42a8-996a-37f6bbefcfae None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:37.942795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391802bb-0f78-4fa9-9ebd-6c36d24ea4e4 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:37.963278 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:37.997977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95901660-f6d1-4ab3-a27e-8c3658520ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:37.999881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95901660-f6d1-4ab3-a27e-8c3658520ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:38.000363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95901660-f6d1-4ab3-a27e-8c3658520ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:38.000840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95901660-f6d1-4ab3-a27e-8c3658520ca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:38.124684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99dd61-3e4a-42a8-996a-37f6bbefcfae None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:38.139475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95901660-f6d1-4ab3-a27e-8c3658520ca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:38.141047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95901660-f6d1-4ab3-a27e-8c3658520ca4 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:38.165431 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed16d55-ecf7-412d-9242-ad8ffe8318c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:38.166903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed16d55-ecf7-412d-9242-ad8ffe8318c2 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:38.167363 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed16d55-ecf7-412d-9242-ad8ffe8318c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:38.167803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed16d55-ecf7-412d-9242-ad8ffe8318c2 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:38.169468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed16d55-ecf7-412d-9242-ad8ffe8318c2 None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:38.171162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed16d55-ecf7-412d-9242-ad8ffe8318c2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:38.173352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 99/204] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:37 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:38.182480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed16d55-ecf7-412d-9242-ad8ffe8318c2 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:38.229716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:38.318067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 106/205] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:38.324303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95901660-f6d1-4ab3-a27e-8c3658520ca4 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:38.334864 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:38.391163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed16d55-ecf7-412d-9242-ad8ffe8318c2 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:38.441610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95901660-f6d1-4ab3-a27e-8c3658520ca4 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:38.477549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91135230-8ad0-4f3f-81fa-8da7b64f1396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:38.478418 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91135230-8ad0-4f3f-81fa-8da7b64f1396 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:38.478700 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91135230-8ad0-4f3f-81fa-8da7b64f1396 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:38.479026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91135230-8ad0-4f3f-81fa-8da7b64f1396 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:38.480279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91135230-8ad0-4f3f-81fa-8da7b64f1396 None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:38.481839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91135230-8ad0-4f3f-81fa-8da7b64f1396 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:38.483586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 107/206] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:38 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:38.485416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da4869-dc87-4204-bc8e-798370dd8f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:38.486087 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4869-dc87-4204-bc8e-798370dd8f25 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:38.486365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4869-dc87-4204-bc8e-798370dd8f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:38.486637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4869-dc87-4204-bc8e-798370dd8f25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:38.487470 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da4869-dc87-4204-bc8e-798370dd8f25 None admin] RBAC: Adding query filter params (role.id=a4709d01dc6b4ff6a2471497008b7808, scope.project.id=02a8a5b7d75b4de4b84070e456454f06, user.id=8a53f0842dd94d659976e09f9e003e72) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:38.487778 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da4869-dc87-4204-bc8e-798370dd8f25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:38.489302 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91135230-8ad0-4f3f-81fa-8da7b64f1396 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:38.494649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da4869-dc87-4204-bc8e-798370dd8f25 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:38.508507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 100/207] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:38 2022] GET /identity/v3/role_assignments?user.id=8a53f0842dd94d659976e09f9e003e72&scope.project.id=02a8a5b7d75b4de4b84070e456454f06&role.id=a4709d01dc6b4ff6a2471497008b7808 => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:38.609527 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:38.636435 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91135230-8ad0-4f3f-81fa-8da7b64f1396 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:38.674181 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a570409-0183-40a3-a61f-48e310784e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:38.674954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570409-0183-40a3-a61f-48e310784e46 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:38.675238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570409-0183-40a3-a61f-48e310784e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:38.675512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570409-0183-40a3-a61f-48e310784e46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:38.676417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a570409-0183-40a3-a61f-48e310784e46 None admin] RBAC: Adding query filter params (role.id=5c9f98a938a74f35857ce032dd9e06b1, scope.project.id=609cac1f44f0468f95e1a23aa0389ca2, user.id=f85a99a2a3fb4e2f813dee4765602c76) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:38.676736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a570409-0183-40a3-a61f-48e310784e46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:38.678284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a570409-0183-40a3-a61f-48e310784e46 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:38.684916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 108/208] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:38 2022] GET /identity/v3/role_assignments?user.id=f85a99a2a3fb4e2f813dee4765602c76&scope.project.id=609cac1f44f0468f95e1a23aa0389ca2&role.id=5c9f98a938a74f35857ce032dd9e06b1 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:39.352740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9bc6-8ae3-44bb-90b6-7f44f2bb78be None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:39.353150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9bc6-8ae3-44bb-90b6-7f44f2bb78be None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:39.353337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9bc6-8ae3-44bb-90b6-7f44f2bb78be None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:39.355033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 101/209] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:39.360459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58938fa4-0446-43f2-b96e-00ca8054e71e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:39.360753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58938fa4-0446-43f2-b96e-00ca8054e71e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:39.361033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58938fa4-0446-43f2-b96e-00ca8054e71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:39.365903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aef5b-5881-4acd-894a-f52c6856ca0a None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:39.366194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aef5b-5881-4acd-894a-f52c6856ca0a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:39.366465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aef5b-5881-4acd-894a-f52c6856ca0a None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:39.368106 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 102/210] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:39.378755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1dff2-f00b-4ff6-a36e-ddd63d02b1fb None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:39.379046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1dff2-f00b-4ff6-a36e-ddd63d02b1fb None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:39.379361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1dff2-f00b-4ff6-a36e-ddd63d02b1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:39.380346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-58938fa4-0446-43f2-b96e-00ca8054e71e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:39.381969 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-58938fa4-0446-43f2-b96e-00ca8054e71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:39.396840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e4b1dff2-f00b-4ff6-a36e-ddd63d02b1fb None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:39.398050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e4b1dff2-f00b-4ff6-a36e-ddd63d02b1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:39.477455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 109/211] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:39.482854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 103/212] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:39.502010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58938fa4-0446-43f2-b96e-00ca8054e71e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:39.505896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1dff2-f00b-4ff6-a36e-ddd63d02b1fb None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:39.526596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:39.580466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:39.614963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58938fa4-0446-43f2-b96e-00ca8054e71e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:39.636471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1dff2-f00b-4ff6-a36e-ddd63d02b1fb None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:39.656768 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0109d-2dd3-4025-ab21-44a496e035d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:39.657852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0109d-2dd3-4025-ab21-44a496e035d0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:39.658138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0109d-2dd3-4025-ab21-44a496e035d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:39.658415 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0109d-2dd3-4025-ab21-44a496e035d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:39.659998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0109d-2dd3-4025-ab21-44a496e035d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:39.661525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0109d-2dd3-4025-ab21-44a496e035d0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:39.665303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 110/213] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:39.669680 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0109d-2dd3-4025-ab21-44a496e035d0 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:39.684252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0a1ff-4dd7-447c-abc0-e2567b3d5f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:39.685337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0a1ff-4dd7-447c-abc0-e2567b3d5f05 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:39.685620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0a1ff-4dd7-447c-abc0-e2567b3d5f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:39.685896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0a1ff-4dd7-447c-abc0-e2567b3d5f05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:39.701118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0a1ff-4dd7-447c-abc0-e2567b3d5f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-45e0a1ff-4dd7-447c-abc0-e2567b3d5f05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:39.711310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:39.713033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:39.714114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 104/214] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:39.719199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0a1ff-4dd7-447c-abc0-e2567b3d5f05 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:39.782237 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0109d-2dd3-4025-ab21-44a496e035d0 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:39.819525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:39.825665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03fd6-59e5-476f-9194-7f04c122421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:39.826378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03fd6-59e5-476f-9194-7f04c122421e None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:39.826663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03fd6-59e5-476f-9194-7f04c122421e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:39.826939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03fd6-59e5-476f-9194-7f04c122421e None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:39.827684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d03fd6-59e5-476f-9194-7f04c122421e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:39.829431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d03fd6-59e5-476f-9194-7f04c122421e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:39.839727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:39.860279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 111/215] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:06:39 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:06:39.860613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0a1ff-4dd7-447c-abc0-e2567b3d5f05 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:39.903145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f3059-3323-4e4c-b4ce-a600c97d1bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:39.903758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f3059-3323-4e4c-b4ce-a600c97d1bcc None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:39.904040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f3059-3323-4e4c-b4ce-a600c97d1bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:39.904317 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f3059-3323-4e4c-b4ce-a600c97d1bcc None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:39.905197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f3059-3323-4e4c-b4ce-a600c97d1bcc None admin] RBAC: Adding query filter params (name=member) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:39.905529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f3059-3323-4e4c-b4ce-a600c97d1bcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:39.907026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f3059-3323-4e4c-b4ce-a600c97d1bcc None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:39.918449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 105/216] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:39.923982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03fd6-59e5-476f-9194-7f04c122421e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:40.045414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03fd6-59e5-476f-9194-7f04c122421e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:40.060699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e579d-bf15-479f-8f96-7f6dbf0cf366 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:40.061052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e579d-bf15-479f-8f96-7f6dbf0cf366 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:40.061457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e579d-bf15-479f-8f96-7f6dbf0cf366 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:40.062889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 106/217] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:40.070380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14056-a370-410a-a3df-c4d984a1b226 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:40.070688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14056-a370-410a-a3df-c4d984a1b226 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:40.070972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14056-a370-410a-a3df-c4d984a1b226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:40.085619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10874534-6e94-4661-9182-8a30b77307b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:40.087429 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10874534-6e94-4661-9182-8a30b77307b5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:40.087884 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10874534-6e94-4661-9182-8a30b77307b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:40.088500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10874534-6e94-4661-9182-8a30b77307b5 None admin] PATH_INFO: `/v3/users/3e96d2605e4144b6894b0aaecc871a56` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:40.093634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-79c14056-a370-410a-a3df-c4d984a1b226 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:40.094866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-79c14056-a370-410a-a3df-c4d984a1b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:40.103356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10874534-6e94-4661-9182-8a30b77307b5 None admin] RBAC: Authorizing `identity:get_user(user_id=3e96d2605e4144b6894b0aaecc871a56)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:40.105052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10874534-6e94-4661-9182-8a30b77307b5 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:40.107404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 112/218] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:39 2022] GET /identity/v3/users/3e96d2605e4144b6894b0aaecc871a56 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:40.113901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10874534-6e94-4661-9182-8a30b77307b5 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:40.178745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 107/219] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:40.180363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:40.202993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c14056-a370-410a-a3df-c4d984a1b226 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:40.236032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10874534-6e94-4661-9182-8a30b77307b5 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:40.272080 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd19ac-3daa-4415-95d4-e39edb180edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:40.272973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd19ac-3daa-4415-95d4-e39edb180edb None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:40.273081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd19ac-3daa-4415-95d4-e39edb180edb None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:40.273317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd19ac-3daa-4415-95d4-e39edb180edb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:40.287559 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:40.320932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c14056-a370-410a-a3df-c4d984a1b226 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:40.358744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd19ac-3daa-4415-95d4-e39edb180edb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:40.360716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd19ac-3daa-4415-95d4-e39edb180edb None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:40.361315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143eced-7e6e-41cf-801d-f80732f3b418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:40.362345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143eced-7e6e-41cf-801d-f80732f3b418 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:40.362808 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143eced-7e6e-41cf-801d-f80732f3b418 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:40.363260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143eced-7e6e-41cf-801d-f80732f3b418 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:40.382054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143eced-7e6e-41cf-801d-f80732f3b418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-0143eced-7e6e-41cf-801d-f80732f3b418 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:40.393993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:40.395008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:40.395774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:40.395774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:40.395774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:40.395774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:40.395774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:40.395774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:40.395774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:40.395774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:40.395774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:40.395774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:40.395774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:40.395774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:40.398272 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 108/220] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:06:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:40.405017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143eced-7e6e-41cf-801d-f80732f3b418 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:40.425353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:40.526901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 113/221] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 07:06:40.533184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd19ac-3daa-4415-95d4-e39edb180edb None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:40.588493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143eced-7e6e-41cf-801d-f80732f3b418 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:40.643736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:40.674919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf920a5-dd4b-4f99-9412-493b270adc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:40.676056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf920a5-dd4b-4f99-9412-493b270adc39 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:40.676539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf920a5-dd4b-4f99-9412-493b270adc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:40.677008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf920a5-dd4b-4f99-9412-493b270adc39 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:40.677997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf920a5-dd4b-4f99-9412-493b270adc39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:40.678515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf920a5-dd4b-4f99-9412-493b270adc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:40.680180 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf920a5-dd4b-4f99-9412-493b270adc39 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:40.683704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd19ac-3daa-4415-95d4-e39edb180edb None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:40.699974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 109/222] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:40.714824 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf920a5-dd4b-4f99-9412-493b270adc39 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:40.732207 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f3025-5e08-4504-872f-bf63eb6ed20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:40.733566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f3025-5e08-4504-872f-bf63eb6ed20e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:40.734041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f3025-5e08-4504-872f-bf63eb6ed20e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:40.734498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f3025-5e08-4504-872f-bf63eb6ed20e None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:40.737089 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f3025-5e08-4504-872f-bf63eb6ed20e None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:40.738828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f3025-5e08-4504-872f-bf63eb6ed20e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:40.742167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 114/223] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:40 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:40.750187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f3025-5e08-4504-872f-bf63eb6ed20e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:40.772660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:40.855896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f3025-5e08-4504-872f-bf63eb6ed20e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:40.889059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf920a5-dd4b-4f99-9412-493b270adc39 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:40.894939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb6198-d83c-485e-bd31-ff33748ed750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:40.895884 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb6198-d83c-485e-bd31-ff33748ed750 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:40.896399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb6198-d83c-485e-bd31-ff33748ed750 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:40.896858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb6198-d83c-485e-bd31-ff33748ed750 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:40.897917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb6198-d83c-485e-bd31-ff33748ed750 None admin] RBAC: Adding query filter params (role.id=118677ef2dfa4e808ddc78b083c01059, scope.project.id=609cac1f44f0468f95e1a23aa0389ca2, user.id=3e96d2605e4144b6894b0aaecc871a56) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:40.898431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb6198-d83c-485e-bd31-ff33748ed750 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:40.900064 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb6198-d83c-485e-bd31-ff33748ed750 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:40.906877 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 115/224] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:40 2022] GET /identity/v3/role_assignments?user.id=3e96d2605e4144b6894b0aaecc871a56&scope.project.id=609cac1f44f0468f95e1a23aa0389ca2&role.id=118677ef2dfa4e808ddc78b083c01059 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:40.933603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f0d57-3770-48ee-86dd-be04c1d46d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:40.934896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f0d57-3770-48ee-86dd-be04c1d46d45 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:40.935388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f0d57-3770-48ee-86dd-be04c1d46d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:40.935865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f0d57-3770-48ee-86dd-be04c1d46d45 None admin] PATH_INFO: `/v3/users/f85a99a2a3fb4e2f813dee4765602c76` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:40.937562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f0d57-3770-48ee-86dd-be04c1d46d45 None admin] RBAC: Authorizing `identity:get_user(user_id=f85a99a2a3fb4e2f813dee4765602c76)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:40.939342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f0d57-3770-48ee-86dd-be04c1d46d45 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:40.941857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 110/225] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:40 2022] GET /identity/v3/users/f85a99a2a3fb4e2f813dee4765602c76 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:40.950427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb6198-d83c-485e-bd31-ff33748ed750 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:40.995373 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb45ba-f229-4cee-82a9-979ff70c6409 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:40.995733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb45ba-f229-4cee-82a9-979ff70c6409 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:40.995954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb45ba-f229-4cee-82a9-979ff70c6409 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:40.997681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 111/226] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:06:41.007278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1145b4-b257-45b3-810c-5929df578216 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:41.007577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1145b4-b257-45b3-810c-5929df578216 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:41.007853 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1145b4-b257-45b3-810c-5929df578216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:41.049315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-2b1145b4-b257-45b3-810c-5929df578216 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:41.050869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-2b1145b4-b257-45b3-810c-5929df578216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:41.078605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:41.093971 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb6198-d83c-485e-bd31-ff33748ed750 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:41.127725 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:41.147784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 112/227] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:41.157192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24a90c-58d9-4086-9294-8d8499e74e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:41.158298 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24a90c-58d9-4086-9294-8d8499e74e11 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:41.158747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24a90c-58d9-4086-9294-8d8499e74e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:41.159155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24a90c-58d9-4086-9294-8d8499e74e11 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:41.160498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24a90c-58d9-4086-9294-8d8499e74e11 None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:41.162173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24a90c-58d9-4086-9294-8d8499e74e11 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:41.164096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 116/228] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:40 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:41.174420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1145b4-b257-45b3-810c-5929df578216 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:41.186153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24a90c-58d9-4086-9294-8d8499e74e11 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:41.308968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24a90c-58d9-4086-9294-8d8499e74e11 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:41.350324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a005a-c0af-425e-8d5d-cb227589a397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:41.351542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a005a-c0af-425e-8d5d-cb227589a397 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:41.351995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a005a-c0af-425e-8d5d-cb227589a397 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:41.352409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a005a-c0af-425e-8d5d-cb227589a397 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:41.364639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a005a-c0af-425e-8d5d-cb227589a397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-494a005a-c0af-425e-8d5d-cb227589a397 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:41.373935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:41.375049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:41.376030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:41.376030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:41.376030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:41.376030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:41.376030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:41.376030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:41.376030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:41.376030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:41.376030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:41.376030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:41.376030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:41.376030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:41.379201 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 117/229] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:06:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:41.394928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a005a-c0af-425e-8d5d-cb227589a397 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:41.412300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:41.464130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1145b4-b257-45b3-810c-5929df578216 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:41.516185 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a005a-c0af-425e-8d5d-cb227589a397 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:41.557340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc5227-180c-4210-a5ba-59c57d8b0ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:41.560661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc5227-180c-4210-a5ba-59c57d8b0ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:41.561123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc5227-180c-4210-a5ba-59c57d8b0ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:41.561871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc5227-180c-4210-a5ba-59c57d8b0ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:41.563330 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc5227-180c-4210-a5ba-59c57d8b0ea8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:41.564138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b610326-0472-4fd5-9c74-32a1b90782b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:41.564615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc5227-180c-4210-a5ba-59c57d8b0ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:41.565690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b610326-0472-4fd5-9c74-32a1b90782b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:41.567340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc5227-180c-4210-a5ba-59c57d8b0ea8 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:41.567862 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b610326-0472-4fd5-9c74-32a1b90782b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:41.568636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b610326-0472-4fd5-9c74-32a1b90782b9 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2/users/f85a99a2a3fb4e2f813dee4765602c76/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:41.572359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b610326-0472-4fd5-9c74-32a1b90782b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=609cac1f44f0468f95e1a23aa0389ca2, user_id=f85a99a2a3fb4e2f813dee4765602c76, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:41.577544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b610326-0472-4fd5-9c74-32a1b90782b9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:41.589318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 118/230] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:06:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:41.592996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc5227-180c-4210-a5ba-59c57d8b0ea8 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:41.605160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 113/231] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:06:41 2022] PUT /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2/users/f85a99a2a3fb4e2f813dee4765602c76/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:06:41.685744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:41.723572 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc5227-180c-4210-a5ba-59c57d8b0ea8 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:41.779646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ee4a2-97b7-42c3-97c6-c1336dc09d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:41.780560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ee4a2-97b7-42c3-97c6-c1336dc09d05 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:41.780845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ee4a2-97b7-42c3-97c6-c1336dc09d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:41.781121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ee4a2-97b7-42c3-97c6-c1336dc09d05 None admin] PATH_INFO: `/v3/users/f85a99a2a3fb4e2f813dee4765602c76` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:41.782402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ee4a2-97b7-42c3-97c6-c1336dc09d05 None admin] RBAC: Authorizing `identity:get_user(user_id=f85a99a2a3fb4e2f813dee4765602c76)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:41.783899 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ee4a2-97b7-42c3-97c6-c1336dc09d05 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:41.785915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 119/232] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:41 2022] GET /identity/v3/users/f85a99a2a3fb4e2f813dee4765602c76 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:41.791943 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b610326-0472-4fd5-9c74-32a1b90782b9 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:41.857248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:41.918589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b610326-0472-4fd5-9c74-32a1b90782b9 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:41.962698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca592c-96c6-4c06-b381-0a34d54d66e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:41.963565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca592c-96c6-4c06-b381-0a34d54d66e1 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:41.963851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca592c-96c6-4c06-b381-0a34d54d66e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:41.964129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca592c-96c6-4c06-b381-0a34d54d66e1 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:41.965380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca592c-96c6-4c06-b381-0a34d54d66e1 None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:41.966864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca592c-96c6-4c06-b381-0a34d54d66e1 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:41.968637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 114/233] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:41 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:41.974449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ee4a2-97b7-42c3-97c6-c1336dc09d05 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:42.090499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ee4a2-97b7-42c3-97c6-c1336dc09d05 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:42.128602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ccb19-9a14-44f5-b0c9-3b834a3d5f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:42.129545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ccb19-9a14-44f5-b0c9-3b834a3d5f41 None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:42.129827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ccb19-9a14-44f5-b0c9-3b834a3d5f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:42.130130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ccb19-9a14-44f5-b0c9-3b834a3d5f41 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2/users/f85a99a2a3fb4e2f813dee4765602c76/roles/5c9f98a938a74f35857ce032dd9e06b1` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:42.132398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ccb19-9a14-44f5-b0c9-3b834a3d5f41 None admin] RBAC: Authorizing `identity:create_grant(project_id=609cac1f44f0468f95e1a23aa0389ca2, user_id=f85a99a2a3fb4e2f813dee4765602c76, role_id=5c9f98a938a74f35857ce032dd9e06b1)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:42.133904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ccb19-9a14-44f5-b0c9-3b834a3d5f41 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:42.151383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 120/234] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:06:41 2022] PUT /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2/users/f85a99a2a3fb4e2f813dee4765602c76/roles/5c9f98a938a74f35857ce032dd9e06b1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:06:42.496158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ada38-ecba-44fc-9f9f-f1b9d9100390 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:42.496508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ada38-ecba-44fc-9f9f-f1b9d9100390 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:42.496713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ada38-ecba-44fc-9f9f-f1b9d9100390 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:42.498541 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 115/235] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:42.510013 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dbb3-531a-4dc4-aaf8-9a576706a978 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:42.510342 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dbb3-531a-4dc4-aaf8-9a576706a978 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:42.510619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dbb3-531a-4dc4-aaf8-9a576706a978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:42.515902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:42.535045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-b228dbb3-531a-4dc4-aaf8-9a576706a978 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:42.536249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b228dbb3-531a-4dc4-aaf8-9a576706a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:42.627189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 121/236] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:42.659802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a031cb-7fa4-46b2-a8d0-77679daba7f9 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:42.660293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a031cb-7fa4-46b2-a8d0-77679daba7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:42.660293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a031cb-7fa4-46b2-a8d0-77679daba7f9 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:42.662021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 116/237] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:42.666823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228dbb3-531a-4dc4-aaf8-9a576706a978 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:42.667403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a30a69-20ae-4cb1-8930-94cfc5f0516e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:42.667693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a30a69-20ae-4cb1-8930-94cfc5f0516e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:42.667962 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a30a69-20ae-4cb1-8930-94cfc5f0516e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:42.703015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a0a30a69-20ae-4cb1-8930-94cfc5f0516e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:42.704258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a0a30a69-20ae-4cb1-8930-94cfc5f0516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:42.812991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228dbb3-531a-4dc4-aaf8-9a576706a978 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:42.826693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 117/238] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:42.845965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:42.856706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d0ec6-7a3f-4bb8-b32a-c8f7ee96dad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:42.857838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d0ec6-7a3f-4bb8-b32a-c8f7ee96dad3 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:42.858424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d0ec6-7a3f-4bb8-b32a-c8f7ee96dad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:42.858889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d0ec6-7a3f-4bb8-b32a-c8f7ee96dad3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:42.861625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a30a69-20ae-4cb1-8930-94cfc5f0516e None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:42.877589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d0ec6-7a3f-4bb8-b32a-c8f7ee96dad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-1e3d0ec6-7a3f-4bb8-b32a-c8f7ee96dad3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:42.897118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:42.898067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:42.898861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:42.898861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:42.898861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:42.898861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:42.898861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:42.898861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:42.898861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:42.898861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:42.898861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:42.898861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:42.898861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:42.898861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:42.901523 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 122/239] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:42.908150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d0ec6-7a3f-4bb8-b32a-c8f7ee96dad3 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:42.909005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:43.018501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a30a69-20ae-4cb1-8930-94cfc5f0516e None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:43.096179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5aac2-dd9e-4908-91b8-da152c83464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:43.097518 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5aac2-dd9e-4908-91b8-da152c83464c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:43.098004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5aac2-dd9e-4908-91b8-da152c83464c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:43.099894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5aac2-dd9e-4908-91b8-da152c83464c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:43.102346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5aac2-dd9e-4908-91b8-da152c83464c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:43.104092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5aac2-dd9e-4908-91b8-da152c83464c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:43.107054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d0ec6-7a3f-4bb8-b32a-c8f7ee96dad3 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:43.110403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 118/240] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:43.114439 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5aac2-dd9e-4908-91b8-da152c83464c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:43.189019 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da29e2c-7d45-4a12-bb21-4ee52db252de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:43.190882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da29e2c-7d45-4a12-bb21-4ee52db252de None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:43.191364 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da29e2c-7d45-4a12-bb21-4ee52db252de None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:43.192068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da29e2c-7d45-4a12-bb21-4ee52db252de None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:43.193605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da29e2c-7d45-4a12-bb21-4ee52db252de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:43.194526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da29e2c-7d45-4a12-bb21-4ee52db252de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:43.196659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da29e2c-7d45-4a12-bb21-4ee52db252de None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:43.214400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 123/241] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:43.215047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb4491-3bf9-4643-ba0b-05d0801a9d6b None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:43.217297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb4491-3bf9-4643-ba0b-05d0801a9d6b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:43.217502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb4491-3bf9-4643-ba0b-05d0801a9d6b None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:43.219022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 124/242] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:43.220406 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb4491-3bf9-4643-ba0b-05d0801a9d6b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:43.248718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5aac2-dd9e-4908-91b8-da152c83464c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:43.265795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:43.290176 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:43.294349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316ccf3-0fec-4816-94de-d0ca7cd6af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:43.295307 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316ccf3-0fec-4816-94de-d0ca7cd6af1d None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:43.295812 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316ccf3-0fec-4816-94de-d0ca7cd6af1d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:43.296383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316ccf3-0fec-4816-94de-d0ca7cd6af1d None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:43.297411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316ccf3-0fec-4816-94de-d0ca7cd6af1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:43.299252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316ccf3-0fec-4816-94de-d0ca7cd6af1d None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:43.323485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 119/243] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:06:43 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:06:43.325594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8718f6-27c3-4bec-9b22-74c598c18ce3 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:43.326166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8718f6-27c3-4bec-9b22-74c598c18ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:43.326714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8718f6-27c3-4bec-9b22-74c598c18ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:43.338790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb4491-3bf9-4643-ba0b-05d0801a9d6b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:43.347633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-ac8718f6-27c3-4bec-9b22-74c598c18ce3 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:43.349433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ac8718f6-27c3-4bec-9b22-74c598c18ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:43.375472 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f8477-4461-471a-b65f-b1f02d19830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:43.376355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f8477-4461-471a-b65f-b1f02d19830a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:43.376624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f8477-4461-471a-b65f-b1f02d19830a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:43.376895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f8477-4461-471a-b65f-b1f02d19830a None admin] PATH_INFO: `/v3/users/95d974326fea49c59e7e45b3bbe45a6b` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:43.391865 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f8477-4461-471a-b65f-b1f02d19830a None admin] RBAC: Authorizing `identity:get_user(user_id=95d974326fea49c59e7e45b3bbe45a6b)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:43.393441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f8477-4461-471a-b65f-b1f02d19830a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:43.395629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 125/244] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:43 2022] GET /identity/v3/users/95d974326fea49c59e7e45b3bbe45a6b => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:43.401063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f8477-4461-471a-b65f-b1f02d19830a None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:43.444231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 120/245] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:43.511851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8718f6-27c3-4bec-9b22-74c598c18ce3 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:43.541388 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f8477-4461-471a-b65f-b1f02d19830a None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:43.548113 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:43.570187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441edc5-f136-4afa-8090-7d36506331f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:43.570853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441edc5-f136-4afa-8090-7d36506331f9 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:43.576477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441edc5-f136-4afa-8090-7d36506331f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:43.576477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441edc5-f136-4afa-8090-7d36506331f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:43.646675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441edc5-f136-4afa-8090-7d36506331f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:43.648429 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441edc5-f136-4afa-8090-7d36506331f9 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:43.652823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:43.657798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8718f6-27c3-4bec-9b22-74c598c18ce3 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:43.696138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea190ad-388a-45d6-af3c-9dfc5d35eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:43.697926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea190ad-388a-45d6-af3c-9dfc5d35eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:43.698443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea190ad-388a-45d6-af3c-9dfc5d35eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:43.698927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea190ad-388a-45d6-af3c-9dfc5d35eaf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:43.711608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea190ad-388a-45d6-af3c-9dfc5d35eaf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-0ea190ad-388a-45d6-af3c-9dfc5d35eaf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:43.720324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:43.721291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:43.722048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:43.722048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:43.722048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:43.722048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:43.722048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:43.722048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:43.722048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:43.722048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:43.722048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:43.722048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:43.722048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:43.722048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:43.725528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 121/246] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:43.731113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea190ad-388a-45d6-af3c-9dfc5d35eaf6 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:43.760671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 126/247] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 07:06:43.767252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441edc5-f136-4afa-8090-7d36506331f9 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:43.782128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:43.843851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea190ad-388a-45d6-af3c-9dfc5d35eaf6 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:43.881502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d0cc8-38ae-4aa3-8208-5513a2caf107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:43.882564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d0cc8-38ae-4aa3-8208-5513a2caf107 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:43.883035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d0cc8-38ae-4aa3-8208-5513a2caf107 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:43.883538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d0cc8-38ae-4aa3-8208-5513a2caf107 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:43.884973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d0cc8-38ae-4aa3-8208-5513a2caf107 None admin] RBAC: Adding query filter params (name=member) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:43.885513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d0cc8-38ae-4aa3-8208-5513a2caf107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:43.887382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d0cc8-38ae-4aa3-8208-5513a2caf107 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:43.891473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441edc5-f136-4afa-8090-7d36506331f9 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:43.899004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 122/248] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:43.905336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d0cc8-38ae-4aa3-8208-5513a2caf107 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:43.934820 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:43.936128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad3242-360d-4574-82b6-e5a4b4cdb995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:43.937527 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad3242-360d-4574-82b6-e5a4b4cdb995 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:43.937983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad3242-360d-4574-82b6-e5a4b4cdb995 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:43.938454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad3242-360d-4574-82b6-e5a4b4cdb995 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:43.940808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad3242-360d-4574-82b6-e5a4b4cdb995 None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:43.942779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad3242-360d-4574-82b6-e5a4b4cdb995 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:43.945568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 127/249] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:43 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:43.951918 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad3242-360d-4574-82b6-e5a4b4cdb995 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:44.042100 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d0cc8-38ae-4aa3-8208-5513a2caf107 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:44.063529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:44.091928 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2db6-86fe-4673-a952-51c51964d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:44.093202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2db6-86fe-4673-a952-51c51964d139 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:44.093712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2db6-86fe-4673-a952-51c51964d139 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:44.094225 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2db6-86fe-4673-a952-51c51964d139 None admin] PATH_INFO: `/v3/users/3e96d2605e4144b6894b0aaecc871a56` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:44.094409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad3242-360d-4574-82b6-e5a4b4cdb995 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:44.096058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2db6-86fe-4673-a952-51c51964d139 None admin] RBAC: Authorizing `identity:get_user(user_id=3e96d2605e4144b6894b0aaecc871a56)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:44.097908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2db6-86fe-4673-a952-51c51964d139 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:44.100231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 123/250] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:43 2022] GET /identity/v3/users/3e96d2605e4144b6894b0aaecc871a56 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:44.107156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2db6-86fe-4673-a952-51c51964d139 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:44.140429 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef6c20-38b4-4c0a-a6d2-e95888d0e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:44.141380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef6c20-38b4-4c0a-a6d2-e95888d0e41a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:44.141666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef6c20-38b4-4c0a-a6d2-e95888d0e41a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:44.141947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef6c20-38b4-4c0a-a6d2-e95888d0e41a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:44.143041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef6c20-38b4-4c0a-a6d2-e95888d0e41a None admin] RBAC: Adding query filter params (role.id=a4709d01dc6b4ff6a2471497008b7808, scope.project.id=609cac1f44f0468f95e1a23aa0389ca2, user.id=95d974326fea49c59e7e45b3bbe45a6b) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:44.143357 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef6c20-38b4-4c0a-a6d2-e95888d0e41a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:44.145591 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef6c20-38b4-4c0a-a6d2-e95888d0e41a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:44.154125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 128/251] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:43 2022] GET /identity/v3/role_assignments?user.id=95d974326fea49c59e7e45b3bbe45a6b&scope.project.id=609cac1f44f0468f95e1a23aa0389ca2&role.id=a4709d01dc6b4ff6a2471497008b7808 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:44.219932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050a761-1bba-4ac6-8526-fb08d4a28c22 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:44.220270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050a761-1bba-4ac6-8526-fb08d4a28c22 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:44.220503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050a761-1bba-4ac6-8526-fb08d4a28c22 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:44.223538 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 129/252] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:44.228881 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:44.237321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303b36b-4d61-4848-b87a-6b2dcbe5b368 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:44.237963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303b36b-4d61-4848-b87a-6b2dcbe5b368 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:44.238646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303b36b-4d61-4848-b87a-6b2dcbe5b368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:44.245884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2db6-86fe-4673-a952-51c51964d139 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:44.264787 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-2303b36b-4d61-4848-b87a-6b2dcbe5b368 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:44.266056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2303b36b-4d61-4848-b87a-6b2dcbe5b368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:44.301987 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ae4d5-481a-4257-acb9-073aebf738b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:44.303247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ae4d5-481a-4257-acb9-073aebf738b3 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:44.305076 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ae4d5-481a-4257-acb9-073aebf738b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:44.305625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ae4d5-481a-4257-acb9-073aebf738b3 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:44.308061 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ae4d5-481a-4257-acb9-073aebf738b3 None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:44.311127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ae4d5-481a-4257-acb9-073aebf738b3 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:44.318537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 124/253] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:44 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:44.328623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ae4d5-481a-4257-acb9-073aebf738b3 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:44.393319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 130/254] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:44.415613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303b36b-4d61-4848-b87a-6b2dcbe5b368 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:44.469402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ae4d5-481a-4257-acb9-073aebf738b3 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:44.509798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdff6d-cf46-435f-aaec-91d1d6b0e2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:44.511125 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdff6d-cf46-435f-aaec-91d1d6b0e2d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:44.511600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdff6d-cf46-435f-aaec-91d1d6b0e2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:44.512060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdff6d-cf46-435f-aaec-91d1d6b0e2d7 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2/users/3e96d2605e4144b6894b0aaecc871a56/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:44.514806 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdff6d-cf46-435f-aaec-91d1d6b0e2d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=609cac1f44f0468f95e1a23aa0389ca2, user_id=3e96d2605e4144b6894b0aaecc871a56, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:44.516617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdff6d-cf46-435f-aaec-91d1d6b0e2d7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:44.534323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 125/255] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:06:44 2022] PUT /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2/users/3e96d2605e4144b6894b0aaecc871a56/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:06:44.542652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:44.578412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303b36b-4d61-4848-b87a-6b2dcbe5b368 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:44.621608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063409d-1bdd-4732-9b74-28f9147c2fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:44.622868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063409d-1bdd-4732-9b74-28f9147c2fed None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:44.623395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063409d-1bdd-4732-9b74-28f9147c2fed None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:44.623907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063409d-1bdd-4732-9b74-28f9147c2fed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:44.639305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063409d-1bdd-4732-9b74-28f9147c2fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-7063409d-1bdd-4732-9b74-28f9147c2fed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:44.648051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:44.653785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:44.654580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:44.654580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:44.654580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:44.654580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:44.654580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:44.654580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:44.654580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:44.654580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:44.654580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:44.654580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:44.654580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:44.654580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:44.657034 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 131/256] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:06:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:44.663317 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdff6d-cf46-435f-aaec-91d1d6b0e2d7 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:44.701658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:44.804065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdff6d-cf46-435f-aaec-91d1d6b0e2d7 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:44.836088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9357f-dcfb-4735-8217-77e88b2dd2fb None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:44.836741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9357f-dcfb-4735-8217-77e88b2dd2fb None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:44.837274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9357f-dcfb-4735-8217-77e88b2dd2fb None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:44.839090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 132/257] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:06:44.845984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aefc5-bbfe-4909-b927-3eab18645198 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:44.847014 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aefc5-bbfe-4909-b927-3eab18645198 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:44.847724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aefc5-bbfe-4909-b927-3eab18645198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:44.860984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188112dd-198a-4cf7-a2c7-ddd87e09bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:44.861684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188112dd-198a-4cf7-a2c7-ddd87e09bf94 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:44.862024 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188112dd-198a-4cf7-a2c7-ddd87e09bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:44.862297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188112dd-198a-4cf7-a2c7-ddd87e09bf94 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:44.863057 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188112dd-198a-4cf7-a2c7-ddd87e09bf94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:44.863363 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188112dd-198a-4cf7-a2c7-ddd87e09bf94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:44.864765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188112dd-198a-4cf7-a2c7-ddd87e09bf94 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:44.868491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-074aefc5-bbfe-4909-b927-3eab18645198 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:44.870116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-074aefc5-bbfe-4909-b927-3eab18645198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:44.888135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 126/258] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:44.894428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188112dd-198a-4cf7-a2c7-ddd87e09bf94 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:44.970577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 133/259] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:45.004714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074aefc5-bbfe-4909-b927-3eab18645198 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:45.052565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:45.102447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188112dd-198a-4cf7-a2c7-ddd87e09bf94 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:45.128225 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:45.173679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a38c4-d7e1-44df-ba67-e7d2344ed36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:45.174941 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a38c4-d7e1-44df-ba67-e7d2344ed36e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:45.175421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a38c4-d7e1-44df-ba67-e7d2344ed36e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:45.175894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a38c4-d7e1-44df-ba67-e7d2344ed36e None admin] PATH_INFO: `/v3/users/f85a99a2a3fb4e2f813dee4765602c76` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:45.177347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a38c4-d7e1-44df-ba67-e7d2344ed36e None admin] RBAC: Authorizing `identity:get_user(user_id=f85a99a2a3fb4e2f813dee4765602c76)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:45.180116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a38c4-d7e1-44df-ba67-e7d2344ed36e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:45.184714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 127/260] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:44 2022] GET /identity/v3/users/f85a99a2a3fb4e2f813dee4765602c76 => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:45.189068 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a38c4-d7e1-44df-ba67-e7d2344ed36e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:45.204198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074aefc5-bbfe-4909-b927-3eab18645198 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:45.266817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a1494-f6c0-468b-be68-d6dc5f603055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:45.269240 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a1494-f6c0-468b-be68-d6dc5f603055 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:45.269735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a1494-f6c0-468b-be68-d6dc5f603055 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:45.270203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a1494-f6c0-468b-be68-d6dc5f603055 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:45.291203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a1494-f6c0-468b-be68-d6dc5f603055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-428a1494-f6c0-468b-be68-d6dc5f603055 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:45.303965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:45.304938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:45.305745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:45.305745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:45.305745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:45.305745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:45.305745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:45.305745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:45.305745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:45.305745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:45.305745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:45.305745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:45.305745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:45.305745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:45.312957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 134/261] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:06:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:45.323620 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a1494-f6c0-468b-be68-d6dc5f603055 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:45.361720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a38c4-d7e1-44df-ba67-e7d2344ed36e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:45.410208 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddf8ef-9bad-453a-95d2-e08b9c302d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:45.411696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddf8ef-9bad-453a-95d2-e08b9c302d40 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:45.412187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddf8ef-9bad-453a-95d2-e08b9c302d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:45.412660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddf8ef-9bad-453a-95d2-e08b9c302d40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:45.444408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:45.507697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddf8ef-9bad-453a-95d2-e08b9c302d40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:45.509663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddf8ef-9bad-453a-95d2-e08b9c302d40 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:45.573638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a1494-f6c0-468b-be68-d6dc5f603055 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:45.599109 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:45.612678 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f1b91-a8b1-4afc-a0e2-098e5e51f751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:45.613756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f1b91-a8b1-4afc-a0e2-098e5e51f751 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:45.614239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f1b91-a8b1-4afc-a0e2-098e5e51f751 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:45.614709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f1b91-a8b1-4afc-a0e2-098e5e51f751 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:45.615719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f1b91-a8b1-4afc-a0e2-098e5e51f751 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:45.616241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f1b91-a8b1-4afc-a0e2-098e5e51f751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:45.617890 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f1b91-a8b1-4afc-a0e2-098e5e51f751 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:45.627445 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 135/262] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:06:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:45.633344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f1b91-a8b1-4afc-a0e2-098e5e51f751 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:45.690033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 128/263] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 07:06:45.695852 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddf8ef-9bad-453a-95d2-e08b9c302d40 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:45.740266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f1b91-a8b1-4afc-a0e2-098e5e51f751 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:45.779359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6413fbe-2111-4a4c-a138-0293afa8d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:45.780650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6413fbe-2111-4a4c-a138-0293afa8d14c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:45.781159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6413fbe-2111-4a4c-a138-0293afa8d14c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:45.781673 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6413fbe-2111-4a4c-a138-0293afa8d14c None admin] PATH_INFO: `/v3/users/f85a99a2a3fb4e2f813dee4765602c76` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:45.783309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6413fbe-2111-4a4c-a138-0293afa8d14c None admin] RBAC: Authorizing `identity:get_user(user_id=f85a99a2a3fb4e2f813dee4765602c76)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:45.785146 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6413fbe-2111-4a4c-a138-0293afa8d14c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:45.787512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 136/264] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:45 2022] GET /identity/v3/users/f85a99a2a3fb4e2f813dee4765602c76 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:45.793567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6413fbe-2111-4a4c-a138-0293afa8d14c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:45.799005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:45.857153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:45.903925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6413fbe-2111-4a4c-a138-0293afa8d14c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:45.940011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b241b-b275-4b38-86d3-bb4e7b50ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:45.940669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b241b-b275-4b38-86d3-bb4e7b50ac4f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:45.940952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b241b-b275-4b38-86d3-bb4e7b50ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:45.941244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b241b-b275-4b38-86d3-bb4e7b50ac4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:45.955150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddf8ef-9bad-453a-95d2-e08b9c302d40 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:46.014249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b241b-b275-4b38-86d3-bb4e7b50ac4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:46.016210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b241b-b275-4b38-86d3-bb4e7b50ac4f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:46.029960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33079e-c280-49c3-a4a4-4f836d77f6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:46.030857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33079e-c280-49c3-a4a4-4f836d77f6ab None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:46.031139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33079e-c280-49c3-a4a4-4f836d77f6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:46.031413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33079e-c280-49c3-a4a4-4f836d77f6ab None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:46.032745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33079e-c280-49c3-a4a4-4f836d77f6ab None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:46.034323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33079e-c280-49c3-a4a4-4f836d77f6ab None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:46.037390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 129/265] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:45 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:46.042202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33079e-c280-49c3-a4a4-4f836d77f6ab None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:46.075086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:46.176484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 137/266] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 07:06:46.181742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b241b-b275-4b38-86d3-bb4e7b50ac4f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:46.188638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33079e-c280-49c3-a4a4-4f836d77f6ab None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:46.205167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:46.232912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98993532-d39d-40da-9537-debc3067841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:46.233624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993532-d39d-40da-9537-debc3067841a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:46.233914 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993532-d39d-40da-9537-debc3067841a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:46.234191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993532-d39d-40da-9537-debc3067841a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:46.235071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98993532-d39d-40da-9537-debc3067841a None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=609cac1f44f0468f95e1a23aa0389ca2, user.id=f85a99a2a3fb4e2f813dee4765602c76) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:46.235381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98993532-d39d-40da-9537-debc3067841a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:46.236847 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98993532-d39d-40da-9537-debc3067841a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:46.244544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 130/267] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:46 2022] GET /identity/v3/role_assignments?user.id=f85a99a2a3fb4e2f813dee4765602c76&scope.project.id=609cac1f44f0468f95e1a23aa0389ca2&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:46.372451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b241b-b275-4b38-86d3-bb4e7b50ac4f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:46.416773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db94b83-fe71-4ab5-9a2a-9e89749f3897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:46.417705 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db94b83-fe71-4ab5-9a2a-9e89749f3897 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:46.417987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db94b83-fe71-4ab5-9a2a-9e89749f3897 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:46.418310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db94b83-fe71-4ab5-9a2a-9e89749f3897 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:46.419549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db94b83-fe71-4ab5-9a2a-9e89749f3897 None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:46.421041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db94b83-fe71-4ab5-9a2a-9e89749f3897 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:46.423276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 138/268] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:46 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:46.429370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98993532-d39d-40da-9537-debc3067841a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:46.589137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98993532-d39d-40da-9537-debc3067841a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:46.634035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab02d0-f0f6-47be-928a-32ceef061097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:46.635127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab02d0-f0f6-47be-928a-32ceef061097 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:46.635554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab02d0-f0f6-47be-928a-32ceef061097 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:46.635971 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab02d0-f0f6-47be-928a-32ceef061097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:46.637366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab02d0-f0f6-47be-928a-32ceef061097 None admin] RBAC: Adding query filter params (role.id=5c9f98a938a74f35857ce032dd9e06b1, scope.project.id=609cac1f44f0468f95e1a23aa0389ca2, user.id=f85a99a2a3fb4e2f813dee4765602c76) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:46.637834 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab02d0-f0f6-47be-928a-32ceef061097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:46.639449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab02d0-f0f6-47be-928a-32ceef061097 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:46.650174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 131/269] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:46 2022] GET /identity/v3/role_assignments?user.id=f85a99a2a3fb4e2f813dee4765602c76&scope.project.id=609cac1f44f0468f95e1a23aa0389ca2&role.id=5c9f98a938a74f35857ce032dd9e06b1 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:46.944595 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10d378-6bcb-4211-b59e-b9de3433458e None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:46.945179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10d378-6bcb-4211-b59e-b9de3433458e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:46.945476 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10d378-6bcb-4211-b59e-b9de3433458e None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:46.947012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 139/270] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:46.956212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d241-cb1a-4428-a5bc-2315e0bdef84 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:46.956702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d241-cb1a-4428-a5bc-2315e0bdef84 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:46.956773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d241-cb1a-4428-a5bc-2315e0bdef84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:46.975498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0b93d241-cb1a-4428-a5bc-2315e0bdef84 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:46.976694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0b93d241-cb1a-4428-a5bc-2315e0bdef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:47.015365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:47.020931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362caf-59ac-45ee-930a-e320fe1062bb None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.021640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362caf-59ac-45ee-930a-e320fe1062bb None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.022668 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362caf-59ac-45ee-930a-e320fe1062bb None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.024784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 140/271] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:47.029818 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2ac0f-e41a-47c2-a0c6-9e98bff39741 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.030377 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2ac0f-e41a-47c2-a0c6-9e98bff39741 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.030680 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2ac0f-e41a-47c2-a0c6-9e98bff39741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.051873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-0de2ac0f-e41a-47c2-a0c6-9e98bff39741 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:47.053498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0de2ac0f-e41a-47c2-a0c6-9e98bff39741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:47.065332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 132/272] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:47.081121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:47.116314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93d241-cb1a-4428-a5bc-2315e0bdef84 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:47.154519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 141/273] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:47.179400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2ac0f-e41a-47c2-a0c6-9e98bff39741 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:47.249006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93d241-cb1a-4428-a5bc-2315e0bdef84 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:47.297451 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a409bc3-a008-42ff-8c48-0f971d15d151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:47.298258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a409bc3-a008-42ff-8c48-0f971d15d151 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.298540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a409bc3-a008-42ff-8c48-0f971d15d151 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.298813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a409bc3-a008-42ff-8c48-0f971d15d151 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.299915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2ac0f-e41a-47c2-a0c6-9e98bff39741 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:47.300105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a409bc3-a008-42ff-8c48-0f971d15d151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:47.301598 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a409bc3-a008-42ff-8c48-0f971d15d151 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:47.303453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 133/274] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:47.309460 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32285-d85a-457d-8196-dbd6965f4778 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.309760 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32285-d85a-457d-8196-dbd6965f4778 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.310147 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32285-d85a-457d-8196-dbd6965f4778 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.311790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 134/275] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:47.312332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae32285-d85a-457d-8196-dbd6965f4778 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:47.341911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd88017-3e29-4d1c-8c70-7e68f94811f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:47.343118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88017-3e29-4d1c-8c70-7e68f94811f2 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.343396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88017-3e29-4d1c-8c70-7e68f94811f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.343665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88017-3e29-4d1c-8c70-7e68f94811f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.354075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd88017-3e29-4d1c-8c70-7e68f94811f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:47.362162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-1bd88017-3e29-4d1c-8c70-7e68f94811f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:47.364830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:47.365776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 142/276] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:47.372122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f97f2-fc55-4209-9a30-1ff287e3bd3a None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.372926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f97f2-fc55-4209-9a30-1ff287e3bd3a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.372926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f97f2-fc55-4209-9a30-1ff287e3bd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.387615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c30f97f2-fc55-4209-9a30-1ff287e3bd3a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:47.389288 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c30f97f2-fc55-4209-9a30-1ff287e3bd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:47.398514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:47.437596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae32285-d85a-457d-8196-dbd6965f4778 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:47.483119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 143/277] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:47.483916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f97f2-fc55-4209-9a30-1ff287e3bd3a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:47.495713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3620-cc37-4a6e-868f-515340af2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:47.496787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3620-cc37-4a6e-868f-515340af2a61 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.497302 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3620-cc37-4a6e-868f-515340af2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.497894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3620-cc37-4a6e-868f-515340af2a61 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.498856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3620-cc37-4a6e-868f-515340af2a61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:47.500709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3620-cc37-4a6e-868f-515340af2a61 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:47.525060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 135/278] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:06:47 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:06:47.526340 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3620-cc37-4a6e-868f-515340af2a61 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:47.631257 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f97f2-fc55-4209-9a30-1ff287e3bd3a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:47.658314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:47.675931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3620-cc37-4a6e-868f-515340af2a61 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:47.686552 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc23634-c61e-45ab-bad9-554ff99563cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:47.687378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc23634-c61e-45ab-bad9-554ff99563cc None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.687726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc23634-c61e-45ab-bad9-554ff99563cc None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.688123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc23634-c61e-45ab-bad9-554ff99563cc None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.689084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc23634-c61e-45ab-bad9-554ff99563cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:47.689485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc23634-c61e-45ab-bad9-554ff99563cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:47.691001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc23634-c61e-45ab-bad9-554ff99563cc None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:47.703339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 144/279] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:47.709007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc23634-c61e-45ab-bad9-554ff99563cc None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:47.714276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:47.732944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed151ad-178e-4ef5-8bbb-100513e56845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:47.734079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed151ad-178e-4ef5-8bbb-100513e56845 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.734622 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed151ad-178e-4ef5-8bbb-100513e56845 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.734946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed151ad-178e-4ef5-8bbb-100513e56845 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.746536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed151ad-178e-4ef5-8bbb-100513e56845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-bed151ad-178e-4ef5-8bbb-100513e56845 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:47.755362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:47.756286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:47.757096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 136/280] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:47.758539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd911c68-5b97-42f3-bd97-376a36a9e478 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.758828 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd911c68-5b97-42f3-bd97-376a36a9e478 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.759142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd911c68-5b97-42f3-bd97-376a36a9e478 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.760833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 137/281] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:47.770566 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd911c68-5b97-42f3-bd97-376a36a9e478 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:47.870166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc23634-c61e-45ab-bad9-554ff99563cc None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:47.912940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9825b2-a083-43ef-b0c8-785857d5bbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:47.913991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9825b2-a083-43ef-b0c8-785857d5bbcd None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.914341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9825b2-a083-43ef-b0c8-785857d5bbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.914711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9825b2-a083-43ef-b0c8-785857d5bbcd None admin] PATH_INFO: `/v3/users/35619c8212974b83a7a37511b532e3be` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.926313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd911c68-5b97-42f3-bd97-376a36a9e478 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:47.930108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9825b2-a083-43ef-b0c8-785857d5bbcd None admin] RBAC: Authorizing `identity:get_user(user_id=35619c8212974b83a7a37511b532e3be)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:47.931828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9825b2-a083-43ef-b0c8-785857d5bbcd None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:47.934006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 145/282] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:47 2022] GET /identity/v3/users/35619c8212974b83a7a37511b532e3be => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:47.937477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848863a-da0e-4fe1-a08a-20fa6a6b5449 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.937477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848863a-da0e-4fe1-a08a-20fa6a6b5449 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.937477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848863a-da0e-4fe1-a08a-20fa6a6b5449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.959979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-2848863a-da0e-4fe1-a08a-20fa6a6b5449 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:47.961844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2848863a-da0e-4fe1-a08a-20fa6a6b5449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:47.969953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ba780-db1c-4069-aea5-6df5449d5dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:47.970805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ba780-db1c-4069-aea5-6df5449d5dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:47.971161 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ba780-db1c-4069-aea5-6df5449d5dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:47.971517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ba780-db1c-4069-aea5-6df5449d5dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:47.972361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ba780-db1c-4069-aea5-6df5449d5dc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:47.972677 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ba780-db1c-4069-aea5-6df5449d5dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:47.974192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ba780-db1c-4069-aea5-6df5449d5dc5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:47.984543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 138/283] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:47.985464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ba780-db1c-4069-aea5-6df5449d5dc5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:48.009316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:48.044561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:48.056675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 146/284] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:48.058043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848863a-da0e-4fe1-a08a-20fa6a6b5449 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:48.130396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ba780-db1c-4069-aea5-6df5449d5dc5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:48.166611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848863a-da0e-4fe1-a08a-20fa6a6b5449 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:48.174073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932582eb-bb43-49a7-ab39-f32fc6cb0e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:48.174753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932582eb-bb43-49a7-ab39-f32fc6cb0e2b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:48.175033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932582eb-bb43-49a7-ab39-f32fc6cb0e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:48.175309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932582eb-bb43-49a7-ab39-f32fc6cb0e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:48.176791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932582eb-bb43-49a7-ab39-f32fc6cb0e2b None admin] RBAC: Adding query filter params (role.id=118677ef2dfa4e808ddc78b083c01059, user.id=35619c8212974b83a7a37511b532e3be, scope.system=all) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:48.177104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932582eb-bb43-49a7-ab39-f32fc6cb0e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:48.179111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932582eb-bb43-49a7-ab39-f32fc6cb0e2b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:48.186970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 139/285] 10.222.0.62 () {56 vars in 1308 bytes} [Thu Jul 7 07:06:47 2022] GET /identity/v3/role_assignments?user.id=35619c8212974b83a7a37511b532e3be&scope.system=all&role.id=118677ef2dfa4e808ddc78b083c01059 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:48.188310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932582eb-bb43-49a7-ab39-f32fc6cb0e2b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:48.220621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a7568-13e1-4a7f-b5ee-ef1ee4af472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:48.221578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a7568-13e1-4a7f-b5ee-ef1ee4af472e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:48.221864 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a7568-13e1-4a7f-b5ee-ef1ee4af472e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:48.222230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a7568-13e1-4a7f-b5ee-ef1ee4af472e None admin] PATH_INFO: `/v3/users/95d974326fea49c59e7e45b3bbe45a6b` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:48.223742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a7568-13e1-4a7f-b5ee-ef1ee4af472e None admin] RBAC: Authorizing `identity:get_user(user_id=95d974326fea49c59e7e45b3bbe45a6b)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:48.226225 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a7568-13e1-4a7f-b5ee-ef1ee4af472e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:48.229325 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 147/286] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:48 2022] GET /identity/v3/users/95d974326fea49c59e7e45b3bbe45a6b => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:48.235199 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a7568-13e1-4a7f-b5ee-ef1ee4af472e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:48.362000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:48.363084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:48.399335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932582eb-bb43-49a7-ab39-f32fc6cb0e2b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:48.440135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a7568-13e1-4a7f-b5ee-ef1ee4af472e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:48.463454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bdb5e-ae18-4d48-8019-0ef46ea00814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:48.464270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bdb5e-ae18-4d48-8019-0ef46ea00814 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:48.464552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bdb5e-ae18-4d48-8019-0ef46ea00814 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:48.464827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bdb5e-ae18-4d48-8019-0ef46ea00814 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:48.483776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bdb5e-ae18-4d48-8019-0ef46ea00814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-c17bdb5e-ae18-4d48-8019-0ef46ea00814 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:48.491711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:48.492595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:48.493410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 140/287] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:48.505464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bdb5e-ae18-4d48-8019-0ef46ea00814 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:48.509967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb561a-d77d-48f3-b564-c9447bf88627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:48.510859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb561a-d77d-48f3-b564-c9447bf88627 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:48.511142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb561a-d77d-48f3-b564-c9447bf88627 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:48.511419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb561a-d77d-48f3-b564-c9447bf88627 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:48.514496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb561a-d77d-48f3-b564-c9447bf88627 None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:48.515971 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb561a-d77d-48f3-b564-c9447bf88627 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:48.528388 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 148/288] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:48 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:48.529482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb561a-d77d-48f3-b564-c9447bf88627 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:48.680895 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bdb5e-ae18-4d48-8019-0ef46ea00814 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:48.715271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6096ce-d241-4c0a-8846-8ed35a7dddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:48.715944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6096ce-d241-4c0a-8846-8ed35a7dddc3 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:48.716230 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6096ce-d241-4c0a-8846-8ed35a7dddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:48.716512 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6096ce-d241-4c0a-8846-8ed35a7dddc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:48.717285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6096ce-d241-4c0a-8846-8ed35a7dddc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:48.717664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6096ce-d241-4c0a-8846-8ed35a7dddc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:48.719192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6096ce-d241-4c0a-8846-8ed35a7dddc3 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:48.723378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb561a-d77d-48f3-b564-c9447bf88627 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:48.729424 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 141/289] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:48.734721 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6096ce-d241-4c0a-8846-8ed35a7dddc3 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:48.738628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:48.781599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:48.798501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdc92e-db87-4cc2-b29f-299f2e7c2b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:48.799414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdc92e-db87-4cc2-b29f-299f2e7c2b1f None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:48.799697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdc92e-db87-4cc2-b29f-299f2e7c2b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:48.799979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdc92e-db87-4cc2-b29f-299f2e7c2b1f None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2/users/95d974326fea49c59e7e45b3bbe45a6b/roles/a4709d01dc6b4ff6a2471497008b7808` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:48.806765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdc92e-db87-4cc2-b29f-299f2e7c2b1f None admin] RBAC: Authorizing `identity:create_grant(project_id=609cac1f44f0468f95e1a23aa0389ca2, user_id=95d974326fea49c59e7e45b3bbe45a6b, role_id=a4709d01dc6b4ff6a2471497008b7808)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:48.808262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdc92e-db87-4cc2-b29f-299f2e7c2b1f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:48.832073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 149/290] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:06:48 2022] PUT /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2/users/95d974326fea49c59e7e45b3bbe45a6b/roles/a4709d01dc6b4ff6a2471497008b7808 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:06:48.864302 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6096ce-d241-4c0a-8846-8ed35a7dddc3 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:48.917418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63332fd2-05af-4bc3-9c4f-5ba6e5beaa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:48.918763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63332fd2-05af-4bc3-9c4f-5ba6e5beaa67 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:48.919283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63332fd2-05af-4bc3-9c4f-5ba6e5beaa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:48.919781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63332fd2-05af-4bc3-9c4f-5ba6e5beaa67 None admin] PATH_INFO: `/v3/users/3e96d2605e4144b6894b0aaecc871a56` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:48.921419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63332fd2-05af-4bc3-9c4f-5ba6e5beaa67 None admin] RBAC: Authorizing `identity:get_user(user_id=3e96d2605e4144b6894b0aaecc871a56)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:48.923230 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63332fd2-05af-4bc3-9c4f-5ba6e5beaa67 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:48.925314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 142/291] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:48 2022] GET /identity/v3/users/3e96d2605e4144b6894b0aaecc871a56 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:48.937572 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdc92e-db87-4cc2-b29f-299f2e7c2b1f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:49.069099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdc92e-db87-4cc2-b29f-299f2e7c2b1f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:49.108082 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4fa4a-00c1-4995-b549-9e28dbefbeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:49.108735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4fa4a-00c1-4995-b549-9e28dbefbeec None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:49.109013 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4fa4a-00c1-4995-b549-9e28dbefbeec None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:49.109310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4fa4a-00c1-4995-b549-9e28dbefbeec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:49.174537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:49.195370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4fa4a-00c1-4995-b549-9e28dbefbeec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:49.196858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4fa4a-00c1-4995-b549-9e28dbefbeec None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:49.305855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 150/292] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:49.311778 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63332fd2-05af-4bc3-9c4f-5ba6e5beaa67 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:49.438773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:49.473740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63332fd2-05af-4bc3-9c4f-5ba6e5beaa67 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:49.522130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1cb27-b610-4316-a526-75f12df131c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:49.523014 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1cb27-b610-4316-a526-75f12df131c6 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:49.523299 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1cb27-b610-4316-a526-75f12df131c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:49.523575 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1cb27-b610-4316-a526-75f12df131c6 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:49.530270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1cb27-b610-4316-a526-75f12df131c6 None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:49.531795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1cb27-b610-4316-a526-75f12df131c6 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:49.534123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 143/293] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:49 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:49.539893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4fa4a-00c1-4995-b549-9e28dbefbeec None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:49.680536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:49.695917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4fa4a-00c1-4995-b549-9e28dbefbeec None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:49.744907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ece69-2014-4ea8-8995-34a117403e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:49.745509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ece69-2014-4ea8-8995-34a117403e0c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:49.745787 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ece69-2014-4ea8-8995-34a117403e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:49.746060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ece69-2014-4ea8-8995-34a117403e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:49.746887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ece69-2014-4ea8-8995-34a117403e0c None admin] RBAC: Adding query filter params (role.id=118677ef2dfa4e808ddc78b083c01059, scope.project.id=609cac1f44f0468f95e1a23aa0389ca2, user.id=3e96d2605e4144b6894b0aaecc871a56) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:49.747192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ece69-2014-4ea8-8995-34a117403e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:49.748771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ece69-2014-4ea8-8995-34a117403e0c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:49.756915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 151/294] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:49 2022] GET /identity/v3/role_assignments?user.id=3e96d2605e4144b6894b0aaecc871a56&scope.project.id=609cac1f44f0468f95e1a23aa0389ca2&role.id=118677ef2dfa4e808ddc78b083c01059 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:50.015655 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8f500-4796-463c-97d7-880ce81b11f1 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:50.016336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8f500-4796-463c-97d7-880ce81b11f1 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:50.016815 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8f500-4796-463c-97d7-880ce81b11f1 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:50.018749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 144/295] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:50.024001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e59ba-dc8c-4e42-9d7a-cf99e8e18297 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:50.024531 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e59ba-dc8c-4e42-9d7a-cf99e8e18297 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:50.025018 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e59ba-dc8c-4e42-9d7a-cf99e8e18297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:50.044670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a50e59ba-dc8c-4e42-9d7a-cf99e8e18297 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:50.048636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a50e59ba-dc8c-4e42-9d7a-cf99e8e18297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:50.119248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 152/296] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:50.141959 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8f500-4796-463c-97d7-880ce81b11f1 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:50.176669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29492bf-ee11-4200-9352-97432c541c57 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:50.177195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29492bf-ee11-4200-9352-97432c541c57 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:50.177517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29492bf-ee11-4200-9352-97432c541c57 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:50.179090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 153/297] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:50.185779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fdfbc-b247-4b49-b5ea-cb91ccf2e53a None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:50.186064 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fdfbc-b247-4b49-b5ea-cb91ccf2e53a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:50.186348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fdfbc-b247-4b49-b5ea-cb91ccf2e53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:50.210740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-521fdfbc-b247-4b49-b5ea-cb91ccf2e53a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:50.211964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-521fdfbc-b247-4b49-b5ea-cb91ccf2e53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:50.280389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8f500-4796-463c-97d7-880ce81b11f1 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:50.300603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 154/298] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:50.328998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fdfbc-b247-4b49-b5ea-cb91ccf2e53a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:50.336575 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b13c6-e57f-4ea3-bbbf-9897f0fd3305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:50.338613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b13c6-e57f-4ea3-bbbf-9897f0fd3305 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:50.339120 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b13c6-e57f-4ea3-bbbf-9897f0fd3305 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:50.340094 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b13c6-e57f-4ea3-bbbf-9897f0fd3305 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:50.342042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b13c6-e57f-4ea3-bbbf-9897f0fd3305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:50.344395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:50.344738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b13c6-e57f-4ea3-bbbf-9897f0fd3305 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:50.346878 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 145/299] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:50.352511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b13c6-e57f-4ea3-bbbf-9897f0fd3305 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:50.369619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:50.443505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fdfbc-b247-4b49-b5ea-cb91ccf2e53a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:50.479609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6aeb6-089d-4868-9a2a-9fb73fceeea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:50.480569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6aeb6-089d-4868-9a2a-9fb73fceeea7 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:50.480946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6aeb6-089d-4868-9a2a-9fb73fceeea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:50.481358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6aeb6-089d-4868-9a2a-9fb73fceeea7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:50.493592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6aeb6-089d-4868-9a2a-9fb73fceeea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:50.494369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b13c6-e57f-4ea3-bbbf-9897f0fd3305 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-f0b6aeb6-089d-4868-9a2a-9fb73fceeea7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:50.502556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:50.503560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:50.504332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:50.504332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:50.504332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:50.504332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:50.504332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:50.504332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:50.504332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:50.504332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:50.504332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:50.504332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:50.504332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:50.504332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:50.509156 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 155/300] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:50.510110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6aeb6-089d-4868-9a2a-9fb73fceeea7 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:50.534818 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464691b-a5c4-4c9d-b761-3c2a00fcfb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:50.535624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464691b-a5c4-4c9d-b761-3c2a00fcfb8b None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:50.535998 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464691b-a5c4-4c9d-b761-3c2a00fcfb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:50.536403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464691b-a5c4-4c9d-b761-3c2a00fcfb8b None admin] PATH_INFO: `/v3/groups` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:50.537189 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464691b-a5c4-4c9d-b761-3c2a00fcfb8b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:50.539163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464691b-a5c4-4c9d-b761-3c2a00fcfb8b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:50.558321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 146/301] 10.222.0.62 () {60 vars in 1134 bytes} [Thu Jul 7 07:06:50 2022] POST /identity/v3/groups => generated 229 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:06:50.572174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0b9ed-b04f-44ff-87a1-732e1a6804d8 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:50.572559 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0b9ed-b04f-44ff-87a1-732e1a6804d8 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:50.572760 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0b9ed-b04f-44ff-87a1-732e1a6804d8 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:50.574656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 147/302] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:06:50.580839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4263f-cdea-421d-9767-413482b2df3b None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:50.581168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4263f-cdea-421d-9767-413482b2df3b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:50.581500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4263f-cdea-421d-9767-413482b2df3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:50.601683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:50.609200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-b5a4263f-cdea-421d-9767-413482b2df3b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:50.611245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b5a4263f-cdea-421d-9767-413482b2df3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:50.632187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6aeb6-089d-4868-9a2a-9fb73fceeea7 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:50.672255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b33c7-83fb-448e-8d1e-95b7e43a2d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:50.673092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b33c7-83fb-448e-8d1e-95b7e43a2d05 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:50.673453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b33c7-83fb-448e-8d1e-95b7e43a2d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:50.673735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b33c7-83fb-448e-8d1e-95b7e43a2d05 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:50.674560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b33c7-83fb-448e-8d1e-95b7e43a2d05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:50.674880 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b33c7-83fb-448e-8d1e-95b7e43a2d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:50.676417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b33c7-83fb-448e-8d1e-95b7e43a2d05 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:50.686545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 156/303] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:50.692713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b33c7-83fb-448e-8d1e-95b7e43a2d05 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:50.695331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:50.702920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 148/304] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 07 07:06:50.725766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4263f-cdea-421d-9767-413482b2df3b None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:50.820056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b33c7-83fb-448e-8d1e-95b7e43a2d05 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:50.847696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4263f-cdea-421d-9767-413482b2df3b None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:50.866529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b499b-6425-47c5-8254-183d52123004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:50.867809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b499b-6425-47c5-8254-183d52123004 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:50.868094 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b499b-6425-47c5-8254-183d52123004 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:50.868372 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b499b-6425-47c5-8254-183d52123004 None admin] PATH_INFO: `/v3/users/af4562229c654137b167a6607f1e5246` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:50.870626 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:50.888744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b499b-6425-47c5-8254-183d52123004 None admin] RBAC: Authorizing `identity:get_user(user_id=af4562229c654137b167a6607f1e5246)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:50.890493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b499b-6425-47c5-8254-183d52123004 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:50.891358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69182065-6c33-47ff-9e4e-24c613a8f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:50.892321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69182065-6c33-47ff-9e4e-24c613a8f8ba None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:50.892623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 157/305] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:50 2022] GET /identity/v3/users/af4562229c654137b167a6607f1e5246 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:50.892929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69182065-6c33-47ff-9e4e-24c613a8f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:50.893383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69182065-6c33-47ff-9e4e-24c613a8f8ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:50.897902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b499b-6425-47c5-8254-183d52123004 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:50.906340 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69182065-6c33-47ff-9e4e-24c613a8f8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-69182065-6c33-47ff-9e4e-24c613a8f8ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:50.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:50.919101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:50.920075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:50.920075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:50.920075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:50.920075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:50.920075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:50.920075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:50.920075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:50.920075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:50.920075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:50.920075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:50.920075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:50.920075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:50.922556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 149/306] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:50.928409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69182065-6c33-47ff-9e4e-24c613a8f8ba None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:50.990118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:51.009395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b499b-6425-47c5-8254-183d52123004 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:51.035124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69182065-6c33-47ff-9e4e-24c613a8f8ba None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:51.045847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347fe89-b6c2-4525-83d5-5ff0aa6ca2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:51.046511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347fe89-b6c2-4525-83d5-5ff0aa6ca2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:51.046795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347fe89-b6c2-4525-83d5-5ff0aa6ca2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:51.047073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347fe89-b6c2-4525-83d5-5ff0aa6ca2e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:51.048292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347fe89-b6c2-4525-83d5-5ff0aa6ca2e9 None admin] RBAC: Adding query filter params (role.id=a4709d01dc6b4ff6a2471497008b7808, user.id=af4562229c654137b167a6607f1e5246, scope.system=all) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:51.048403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347fe89-b6c2-4525-83d5-5ff0aa6ca2e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:51.049853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347fe89-b6c2-4525-83d5-5ff0aa6ca2e9 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:51.055920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 158/307] 10.222.0.62 () {56 vars in 1308 bytes} [Thu Jul 7 07:06:50 2022] GET /identity/v3/role_assignments?user.id=af4562229c654137b167a6607f1e5246&scope.system=all&role.id=a4709d01dc6b4ff6a2471497008b7808 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:51.075885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e643c-703d-4f41-bd85-ec5a7f76084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:51.077015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e643c-703d-4f41-bd85-ec5a7f76084a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:51.077557 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e643c-703d-4f41-bd85-ec5a7f76084a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:51.078118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e643c-703d-4f41-bd85-ec5a7f76084a None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:51.079108 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e643c-703d-4f41-bd85-ec5a7f76084a None admin] RBAC: Adding query filter params (name=member) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:51.079635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e643c-703d-4f41-bd85-ec5a7f76084a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:51.081383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e643c-703d-4f41-bd85-ec5a7f76084a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:51.092629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 150/308] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:51.098606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347fe89-b6c2-4525-83d5-5ff0aa6ca2e9 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:51.162631 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:51.211858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347fe89-b6c2-4525-83d5-5ff0aa6ca2e9 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:51.252485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec018c2-dcd7-48bc-a7a9-770347238cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:51.253578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec018c2-dcd7-48bc-a7a9-770347238cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:51.253863 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec018c2-dcd7-48bc-a7a9-770347238cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:51.254137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec018c2-dcd7-48bc-a7a9-770347238cb0 None admin] PATH_INFO: `/v3/users/35619c8212974b83a7a37511b532e3be` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:51.255346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec018c2-dcd7-48bc-a7a9-770347238cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=35619c8212974b83a7a37511b532e3be)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:51.256805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec018c2-dcd7-48bc-a7a9-770347238cb0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:51.258815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 159/309] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:51 2022] GET /identity/v3/users/35619c8212974b83a7a37511b532e3be => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:51.264516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e643c-703d-4f41-bd85-ec5a7f76084a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:51.372843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e643c-703d-4f41-bd85-ec5a7f76084a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:51.397823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:51.416339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e06f7-1b39-4980-8dc3-6f40122ec2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:51.417248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e06f7-1b39-4980-8dc3-6f40122ec2da None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:51.417549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e06f7-1b39-4980-8dc3-6f40122ec2da None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:51.417830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e06f7-1b39-4980-8dc3-6f40122ec2da None admin] PATH_INFO: `/v3/system/users/35619c8212974b83a7a37511b532e3be/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:51.419385 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e06f7-1b39-4980-8dc3-6f40122ec2da None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=35619c8212974b83a7a37511b532e3be, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:51.420777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e06f7-1b39-4980-8dc3-6f40122ec2da None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:51.433764 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5d8c6-c9a1-4937-8862-db28f2f081bd None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:51.433764 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5d8c6-c9a1-4937-8862-db28f2f081bd None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:51.433999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 151/310] 10.222.0.62 () {58 vars in 1334 bytes} [Thu Jul 7 07:06:51 2022] PUT /identity/v3/system/users/35619c8212974b83a7a37511b532e3be/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:06:51.434072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5d8c6-c9a1-4937-8862-db28f2f081bd None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:51.436618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 160/311] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:51.445145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b59d7-1bc7-473e-a5ff-626abe42f01d None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:51.445145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b59d7-1bc7-473e-a5ff-626abe42f01d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:51.445145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b59d7-1bc7-473e-a5ff-626abe42f01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:51.463072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-017b59d7-1bc7-473e-a5ff-626abe42f01d None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:51.464731 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-017b59d7-1bc7-473e-a5ff-626abe42f01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:51.544997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 152/312] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:51.563790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5d8c6-c9a1-4937-8862-db28f2f081bd None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:51.677742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5d8c6-c9a1-4937-8862-db28f2f081bd None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:51.705169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:51.718580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f30fd4-dae6-4cfa-9144-523796b4d9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:51.719453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f30fd4-dae6-4cfa-9144-523796b4d9df None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:51.719736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f30fd4-dae6-4cfa-9144-523796b4d9df None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:51.720009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f30fd4-dae6-4cfa-9144-523796b4d9df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:51.731843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f30fd4-dae6-4cfa-9144-523796b4d9df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-58f30fd4-dae6-4cfa-9144-523796b4d9df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:51.739875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:51.740763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:51.741578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:51.741578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:51.741578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:51.741578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:51.741578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:51.741578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:51.741578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:51.741578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:51.741578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:51.741578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:51.741578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:51.741578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:51.745409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 161/313] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:51.749768 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b59d7-1bc7-473e-a5ff-626abe42f01d None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:51.861956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b59d7-1bc7-473e-a5ff-626abe42f01d None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:51.876822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:51.897770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5febf-f8c5-44c1-973a-2cf86106bcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:51.898989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5febf-f8c5-44c1-973a-2cf86106bcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:51.899316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5febf-f8c5-44c1-973a-2cf86106bcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:51.899591 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5febf-f8c5-44c1-973a-2cf86106bcc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:51.900421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5febf-f8c5-44c1-973a-2cf86106bcc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:51.900732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5febf-f8c5-44c1-973a-2cf86106bcc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:51.902166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5febf-f8c5-44c1-973a-2cf86106bcc2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:51.910402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 153/314] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:51.916375 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f30fd4-dae6-4cfa-9144-523796b4d9df None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:52.024037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f30fd4-dae6-4cfa-9144-523796b4d9df None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:52.058311 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf747e7-fe2f-4bfb-be92-b29eb0c65d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:52.059195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf747e7-fe2f-4bfb-be92-b29eb0c65d99 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:52.059473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf747e7-fe2f-4bfb-be92-b29eb0c65d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:52.059744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf747e7-fe2f-4bfb-be92-b29eb0c65d99 None admin] PATH_INFO: `/v3/users/95d974326fea49c59e7e45b3bbe45a6b` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:52.060944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf747e7-fe2f-4bfb-be92-b29eb0c65d99 None admin] RBAC: Authorizing `identity:get_user(user_id=95d974326fea49c59e7e45b3bbe45a6b)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:52.062508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf747e7-fe2f-4bfb-be92-b29eb0c65d99 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:52.064486 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 162/315] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:51 2022] GET /identity/v3/users/95d974326fea49c59e7e45b3bbe45a6b => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:52.070835 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5febf-f8c5-44c1-973a-2cf86106bcc2 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:52.175788 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5febf-f8c5-44c1-973a-2cf86106bcc2 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:52.211447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bf42e-d3ca-4c35-85d0-7ec89cd3bc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:52.212385 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bf42e-d3ca-4c35-85d0-7ec89cd3bc4d None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:52.212849 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bf42e-d3ca-4c35-85d0-7ec89cd3bc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:52.213329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bf42e-d3ca-4c35-85d0-7ec89cd3bc4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:52.262982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:52.288082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bf42e-d3ca-4c35-85d0-7ec89cd3bc4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:52.289605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bf42e-d3ca-4c35-85d0-7ec89cd3bc4d None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:52.392080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 154/316] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:52.397995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf747e7-fe2f-4bfb-be92-b29eb0c65d99 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:52.452137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:52.500825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf747e7-fe2f-4bfb-be92-b29eb0c65d99 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:52.535449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd8fdc-ccdc-44b1-a4d1-351b90b81c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:52.536329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd8fdc-ccdc-44b1-a4d1-351b90b81c8e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:52.536613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd8fdc-ccdc-44b1-a4d1-351b90b81c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:52.536891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd8fdc-ccdc-44b1-a4d1-351b90b81c8e None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:52.538170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd8fdc-ccdc-44b1-a4d1-351b90b81c8e None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:52.539586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd8fdc-ccdc-44b1-a4d1-351b90b81c8e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:52.541777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 163/317] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:52 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:52.550383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bf42e-d3ca-4c35-85d0-7ec89cd3bc4d None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:52.629687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:52.653962 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bf42e-d3ca-4c35-85d0-7ec89cd3bc4d None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:52.688657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f431a95-d982-4d2a-9f68-949c5fcbe8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:52.689353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431a95-d982-4d2a-9f68-949c5fcbe8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:52.689638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431a95-d982-4d2a-9f68-949c5fcbe8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:52.689912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431a95-d982-4d2a-9f68-949c5fcbe8d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:52.690747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f431a95-d982-4d2a-9f68-949c5fcbe8d8 None admin] RBAC: Adding query filter params (role.id=a4709d01dc6b4ff6a2471497008b7808, scope.project.id=609cac1f44f0468f95e1a23aa0389ca2, user.id=95d974326fea49c59e7e45b3bbe45a6b) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:52.691056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f431a95-d982-4d2a-9f68-949c5fcbe8d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:52.692565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f431a95-d982-4d2a-9f68-949c5fcbe8d8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:52.705411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 155/318] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:06:52 2022] GET /identity/v3/role_assignments?user.id=95d974326fea49c59e7e45b3bbe45a6b&scope.project.id=609cac1f44f0468f95e1a23aa0389ca2&role.id=a4709d01dc6b4ff6a2471497008b7808 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:52.715665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bba16e-d9d4-4f86-b57f-b084e7bf6830 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:52.716005 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bba16e-d9d4-4f86-b57f-b084e7bf6830 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:52.716236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bba16e-d9d4-4f86-b57f-b084e7bf6830 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:52.718209 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 164/319] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:52.723939 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6dfdb-3c06-4d78-b72d-eae14923b023 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:52.724258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6dfdb-3c06-4d78-b72d-eae14923b023 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:52.724502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6dfdb-3c06-4d78-b72d-eae14923b023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:52.742967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-64a6dfdb-3c06-4d78-b72d-eae14923b023 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:52.744407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-64a6dfdb-3c06-4d78-b72d-eae14923b023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:52.825584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 156/320] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:52.848633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bba16e-d9d4-4f86-b57f-b084e7bf6830 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:52.954092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bba16e-d9d4-4f86-b57f-b084e7bf6830 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:52.975104 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:52.990020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcd0d4-940d-461e-a10c-83cbdc37f254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:52.991037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcd0d4-940d-461e-a10c-83cbdc37f254 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:52.991322 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcd0d4-940d-461e-a10c-83cbdc37f254 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:52.991601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcd0d4-940d-461e-a10c-83cbdc37f254 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:52.992757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcd0d4-940d-461e-a10c-83cbdc37f254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:52.994325 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcd0d4-940d-461e-a10c-83cbdc37f254 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:52.996148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 165/321] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:06:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:53.001614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6dfdb-3c06-4d78-b72d-eae14923b023 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:53.072016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:53.106291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6dfdb-3c06-4d78-b72d-eae14923b023 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:53.141064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53c158-9b20-41de-b282-3bebad72f035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:53.141769 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53c158-9b20-41de-b282-3bebad72f035 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:53.142056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53c158-9b20-41de-b282-3bebad72f035 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:53.142333 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53c158-9b20-41de-b282-3bebad72f035 None admin] PATH_INFO: `/v3/groups` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:53.143039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53c158-9b20-41de-b282-3bebad72f035 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:53.144578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53c158-9b20-41de-b282-3bebad72f035 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:53.160542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 157/322] 10.222.0.62 () {60 vars in 1134 bytes} [Thu Jul 7 07:06:53 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:06:53.265832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882d3ba-b0d7-4989-ad24-cad80251fa3a None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:53.265832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882d3ba-b0d7-4989-ad24-cad80251fa3a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:53.265832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882d3ba-b0d7-4989-ad24-cad80251fa3a None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:53.266912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 166/323] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:53.274367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e076d-f622-41a6-9bbe-8e91e0a9526f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:53.274367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e076d-f622-41a6-9bbe-8e91e0a9526f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:53.274669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e076d-f622-41a6-9bbe-8e91e0a9526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:53.295588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0f7e076d-f622-41a6-9bbe-8e91e0a9526f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:53.296802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0f7e076d-f622-41a6-9bbe-8e91e0a9526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:53.376097 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 158/324] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:53.399146 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882d3ba-b0d7-4989-ad24-cad80251fa3a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:53.511662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882d3ba-b0d7-4989-ad24-cad80251fa3a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:53.547041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde992bd-c84a-4183-b08e-180693f2b844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:53.547859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde992bd-c84a-4183-b08e-180693f2b844 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:53.548144 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde992bd-c84a-4183-b08e-180693f2b844 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:53.548422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde992bd-c84a-4183-b08e-180693f2b844 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:53.559631 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde992bd-c84a-4183-b08e-180693f2b844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-cde992bd-c84a-4183-b08e-180693f2b844 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:53.567675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:53.568930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:53.569730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 167/325] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:53.575660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e076d-f622-41a6-9bbe-8e91e0a9526f None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:53.656562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:53.680959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4d9f5-60a6-4199-b968-626e02d67b4c None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:53.681386 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4d9f5-60a6-4199-b968-626e02d67b4c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:53.681811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4d9f5-60a6-4199-b968-626e02d67b4c None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:53.683511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 168/326] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:53.690646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cd9ce-9711-4260-9bd3-7c26d618436b None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:53.691456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cd9ce-9711-4260-9bd3-7c26d618436b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:53.691940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cd9ce-9711-4260-9bd3-7c26d618436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:53.702471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e076d-f622-41a6-9bbe-8e91e0a9526f None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:53.715855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-986cd9ce-9711-4260-9bd3-7c26d618436b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:53.718093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-986cd9ce-9711-4260-9bd3-7c26d618436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:53.748721 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec29981-6307-45cf-8c0f-197aeaad8674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:53.749905 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec29981-6307-45cf-8c0f-197aeaad8674 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:53.750421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec29981-6307-45cf-8c0f-197aeaad8674 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:53.750922 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec29981-6307-45cf-8c0f-197aeaad8674 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:53.751885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec29981-6307-45cf-8c0f-197aeaad8674 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:53.752411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec29981-6307-45cf-8c0f-197aeaad8674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:53.754955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec29981-6307-45cf-8c0f-197aeaad8674 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:53.766603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 159/327] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:53.772157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec29981-6307-45cf-8c0f-197aeaad8674 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:53.781443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:53.811848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 169/328] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:53.852100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cd9ce-9711-4260-9bd3-7c26d618436b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:53.897793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec29981-6307-45cf-8c0f-197aeaad8674 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:53.933672 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:53.940217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e9a0-dcc6-4efa-8435-afb749314cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:53.943647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e9a0-dcc6-4efa-8435-afb749314cdf None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:53.943943 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e9a0-dcc6-4efa-8435-afb749314cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:53.944227 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e9a0-dcc6-4efa-8435-afb749314cdf None admin] PATH_INFO: `/v3/users/af4562229c654137b167a6607f1e5246` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:53.947311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8e9a0-dcc6-4efa-8435-afb749314cdf None admin] RBAC: Authorizing `identity:get_user(user_id=af4562229c654137b167a6607f1e5246)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:53.948813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8e9a0-dcc6-4efa-8435-afb749314cdf None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:53.950675 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 160/329] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:53 2022] GET /identity/v3/users/af4562229c654137b167a6607f1e5246 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:53.956942 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e9a0-dcc6-4efa-8435-afb749314cdf None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:53.976828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cd9ce-9711-4260-9bd3-7c26d618436b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:54.018114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73abc0b-2364-4d2a-b8b7-d929898d7178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:54.019268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73abc0b-2364-4d2a-b8b7-d929898d7178 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:54.019732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73abc0b-2364-4d2a-b8b7-d929898d7178 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:54.020240 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73abc0b-2364-4d2a-b8b7-d929898d7178 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:54.034913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73abc0b-2364-4d2a-b8b7-d929898d7178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-a73abc0b-2364-4d2a-b8b7-d929898d7178 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:54.044639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:54.045621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:54.046403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:54.046403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:54.046403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:54.046403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:54.046403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:54.046403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:54.046403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:54.046403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:54.046403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:54.046403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:54.046403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:54.046403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:54.048941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 170/330] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:54.066769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73abc0b-2364-4d2a-b8b7-d929898d7178 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:54.074772 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e9a0-dcc6-4efa-8435-afb749314cdf None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:54.121671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:54.148807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2b075-c520-4e5c-8c14-c7c28f7fe6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:54.150372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2b075-c520-4e5c-8c14-c7c28f7fe6af None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:54.150863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2b075-c520-4e5c-8c14-c7c28f7fe6af None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:54.151350 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2b075-c520-4e5c-8c14-c7c28f7fe6af None admin] PATH_INFO: `/v3/system/users/af4562229c654137b167a6607f1e5246/roles/a4709d01dc6b4ff6a2471497008b7808` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:54.158681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2b075-c520-4e5c-8c14-c7c28f7fe6af None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=af4562229c654137b167a6607f1e5246, role_id=a4709d01dc6b4ff6a2471497008b7808)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:54.161033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2b075-c520-4e5c-8c14-c7c28f7fe6af None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:54.175847 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 161/331] 10.222.0.62 () {58 vars in 1334 bytes} [Thu Jul 7 07:06:53 2022] PUT /identity/v3/system/users/af4562229c654137b167a6607f1e5246/roles/a4709d01dc6b4ff6a2471497008b7808 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:06:54.196909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73abc0b-2364-4d2a-b8b7-d929898d7178 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:54.239434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c88f6-8118-4b2f-85ea-dd9f975916b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:54.240433 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c88f6-8118-4b2f-85ea-dd9f975916b1 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:54.240928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c88f6-8118-4b2f-85ea-dd9f975916b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:54.241420 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c88f6-8118-4b2f-85ea-dd9f975916b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:54.242325 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c88f6-8118-4b2f-85ea-dd9f975916b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:54.242776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c88f6-8118-4b2f-85ea-dd9f975916b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:54.244401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c88f6-8118-4b2f-85ea-dd9f975916b1 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:54.255026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 171/332] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:54.264026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2b075-c520-4e5c-8c14-c7c28f7fe6af None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:54.399110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:54.496443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2b075-c520-4e5c-8c14-c7c28f7fe6af None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:54.558179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44220a5f-17e2-4869-8906-6ae89f9aed92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:54.560056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44220a5f-17e2-4869-8906-6ae89f9aed92 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:54.560742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44220a5f-17e2-4869-8906-6ae89f9aed92 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:54.561454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44220a5f-17e2-4869-8906-6ae89f9aed92 None admin] PATH_INFO: `/v3/users/35619c8212974b83a7a37511b532e3be` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:54.563884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44220a5f-17e2-4869-8906-6ae89f9aed92 None admin] RBAC: Authorizing `identity:get_user(user_id=35619c8212974b83a7a37511b532e3be)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:54.566754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44220a5f-17e2-4869-8906-6ae89f9aed92 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:54.577365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 162/333] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:54 2022] GET /identity/v3/users/35619c8212974b83a7a37511b532e3be => generated 293 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:54.580863 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c88f6-8118-4b2f-85ea-dd9f975916b1 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:54.757507 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:54.763230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c88f6-8118-4b2f-85ea-dd9f975916b1 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:54.823592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d7f26-3fe5-41f5-ae98-34bda25cabb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:54.825066 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7f26-3fe5-41f5-ae98-34bda25cabb6 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:54.825788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7f26-3fe5-41f5-ae98-34bda25cabb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:54.826459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7f26-3fe5-41f5-ae98-34bda25cabb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:54.828168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d7f26-3fe5-41f5-ae98-34bda25cabb6 None admin] RBAC: Adding query filter params (role.id=118677ef2dfa4e808ddc78b083c01059, user.id=35619c8212974b83a7a37511b532e3be, scope.system=all) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:54.829061 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d7f26-3fe5-41f5-ae98-34bda25cabb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:54.831997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d7f26-3fe5-41f5-ae98-34bda25cabb6 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:54.856060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 172/334] 10.222.0.62 () {56 vars in 1308 bytes} [Thu Jul 7 07:06:54 2022] GET /identity/v3/role_assignments?user.id=35619c8212974b83a7a37511b532e3be&scope.system=all&role.id=118677ef2dfa4e808ddc78b083c01059 => generated 510 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:56.017669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814959b2-a4aa-4481-be2f-a71ce29f242c None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:56.019228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814959b2-a4aa-4481-be2f-a71ce29f242c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:56.020032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814959b2-a4aa-4481-be2f-a71ce29f242c None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:56.023403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 163/335] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:56.045310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492540e9-84f6-4d2d-a5ec-aa8faccc1865 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:56.046775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492540e9-84f6-4d2d-a5ec-aa8faccc1865 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:56.047535 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492540e9-84f6-4d2d-a5ec-aa8faccc1865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:56.083283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-492540e9-84f6-4d2d-a5ec-aa8faccc1865 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:56.085911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-492540e9-84f6-4d2d-a5ec-aa8faccc1865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:56.174991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 173/336] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:56.213258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814959b2-a4aa-4481-be2f-a71ce29f242c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:56.325252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814959b2-a4aa-4481-be2f-a71ce29f242c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:56.350130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:56.365592 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93468f-bb11-43d8-99d1-b259bfd8c509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:56.366787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93468f-bb11-43d8-99d1-b259bfd8c509 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:56.367285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93468f-bb11-43d8-99d1-b259bfd8c509 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:56.367750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93468f-bb11-43d8-99d1-b259bfd8c509 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:56.381310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93468f-bb11-43d8-99d1-b259bfd8c509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-7f93468f-bb11-43d8-99d1-b259bfd8c509 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:56.396127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:56.397039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:56.397843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:56.397843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:56.397843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:56.397843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:56.397843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:56.397843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:56.397843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:56.397843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:56.397843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:56.397843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:56.397843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:56.397843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:56.411149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492540e9-84f6-4d2d-a5ec-aa8faccc1865 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:56.411474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 164/337] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:56.450490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706f2fd-df5b-47b4-b72e-fe72de983ab4 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:56.450820 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706f2fd-df5b-47b4-b72e-fe72de983ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:56.451075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706f2fd-df5b-47b4-b72e-fe72de983ab4 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:56.452612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 165/338] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:06:56.459892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c0641-6284-4bd1-b018-b53c5517194c None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:56.460478 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c0641-6284-4bd1-b018-b53c5517194c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:56.460963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c0641-6284-4bd1-b018-b53c5517194c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:56.490380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-603c0641-6284-4bd1-b018-b53c5517194c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:56.493468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-603c0641-6284-4bd1-b018-b53c5517194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:56.580529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:56.606359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492540e9-84f6-4d2d-a5ec-aa8faccc1865 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:56.647012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 166/339] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:56.672848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95ed02-47d8-4bb1-8452-5506153d408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:56.673917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95ed02-47d8-4bb1-8452-5506153d408f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:56.674401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95ed02-47d8-4bb1-8452-5506153d408f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:56.674896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95ed02-47d8-4bb1-8452-5506153d408f None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:56.675867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95ed02-47d8-4bb1-8452-5506153d408f None admin] RBAC: Adding query filter params (name=member) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:56.676368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95ed02-47d8-4bb1-8452-5506153d408f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:56.677982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95ed02-47d8-4bb1-8452-5506153d408f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:56.687741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 174/340] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:56.693908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c0641-6284-4bd1-b018-b53c5517194c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:56.706842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95ed02-47d8-4bb1-8452-5506153d408f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:56.818543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95ed02-47d8-4bb1-8452-5506153d408f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:56.855703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86597735-9a3e-4798-bc3a-4aedd8254946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:56.856851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86597735-9a3e-4798-bc3a-4aedd8254946 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:56.857317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86597735-9a3e-4798-bc3a-4aedd8254946 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:56.857835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86597735-9a3e-4798-bc3a-4aedd8254946 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:56.869423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86597735-9a3e-4798-bc3a-4aedd8254946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-86597735-9a3e-4798-bc3a-4aedd8254946 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:56.877679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:56.878569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:56.879336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:56.879336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:56.879336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:56.879336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:56.879336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:56.879336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:56.879336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:56.879336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:56.879336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:56.879336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:56.879336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:06:56.879336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:56.882206 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 175/341] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:06:56.888404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86597735-9a3e-4798-bc3a-4aedd8254946 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:56.897049 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c0641-6284-4bd1-b018-b53c5517194c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:56.902788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:56.915671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:56.960752 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc940a2-ab31-4c82-b446-1d45756ff1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:56.961447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc940a2-ab31-4c82-b446-1d45756ff1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:56.961926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc940a2-ab31-4c82-b446-1d45756ff1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:56.962372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc940a2-ab31-4c82-b446-1d45756ff1f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:57.003152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86597735-9a3e-4798-bc3a-4aedd8254946 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:57.040674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6bbee-7b37-4aef-a4c2-323f7800993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:57.041763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6bbee-7b37-4aef-a4c2-323f7800993f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:57.042189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6bbee-7b37-4aef-a4c2-323f7800993f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:57.042606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6bbee-7b37-4aef-a4c2-323f7800993f None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:57.043522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6bbee-7b37-4aef-a4c2-323f7800993f None admin] RBAC: Adding query filter params (name=member) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:57.044017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6bbee-7b37-4aef-a4c2-323f7800993f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:57.045723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6bbee-7b37-4aef-a4c2-323f7800993f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:57.056115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 176/342] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:57.061912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6bbee-7b37-4aef-a4c2-323f7800993f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:57.064143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc940a2-ab31-4c82-b446-1d45756ff1f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:57.065759 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc940a2-ab31-4c82-b446-1d45756ff1f7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:57.145031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:57.181042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6bbee-7b37-4aef-a4c2-323f7800993f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:57.187647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 167/343] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:57.194931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc940a2-ab31-4c82-b446-1d45756ff1f7 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:57.210276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:57.225296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce556d38-e7d9-429d-b522-987a1ad02a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:57.226518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce556d38-e7d9-429d-b522-987a1ad02a6a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:57.226960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce556d38-e7d9-429d-b522-987a1ad02a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:57.227391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce556d38-e7d9-429d-b522-987a1ad02a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:57.305163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce556d38-e7d9-429d-b522-987a1ad02a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:57.306902 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc940a2-ab31-4c82-b446-1d45756ff1f7 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:57.307172 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce556d38-e7d9-429d-b522-987a1ad02a6a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:57.359022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360eb436-f929-428b-9d69-4d11c56a13e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:57.359999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360eb436-f929-428b-9d69-4d11c56a13e0 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:57.360348 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360eb436-f929-428b-9d69-4d11c56a13e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:57.360687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360eb436-f929-428b-9d69-4d11c56a13e0 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:57.362026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360eb436-f929-428b-9d69-4d11c56a13e0 None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:57.363540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360eb436-f929-428b-9d69-4d11c56a13e0 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:57.365395 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 168/344] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:57 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:57.371082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360eb436-f929-428b-9d69-4d11c56a13e0 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:57.385108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:57.422071 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 177/345] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 07:06:57.428083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce556d38-e7d9-429d-b522-987a1ad02a6a None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:57.488353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:57.517482 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360eb436-f929-428b-9d69-4d11c56a13e0 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:57.540606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce556d38-e7d9-429d-b522-987a1ad02a6a None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:57.570837 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56384de4-ce69-4c7f-a88f-c33ca4b5c9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:57.572068 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56384de4-ce69-4c7f-a88f-c33ca4b5c9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:57.572523 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56384de4-ce69-4c7f-a88f-c33ca4b5c9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:57.572986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56384de4-ce69-4c7f-a88f-c33ca4b5c9d6 None admin] PATH_INFO: `/v3/groups/59e3a85f3d8046408ea5818a4ed79100` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:57.579150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102304e-0612-4c98-8bef-4bdece00fc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:57.580032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102304e-0612-4c98-8bef-4bdece00fc4d None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:57.580322 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102304e-0612-4c98-8bef-4bdece00fc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:57.580602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102304e-0612-4c98-8bef-4bdece00fc4d None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:57.581009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56384de4-ce69-4c7f-a88f-c33ca4b5c9d6 None admin] RBAC: Authorizing `identity:get_group(group_id=59e3a85f3d8046408ea5818a4ed79100)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:57.581872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102304e-0612-4c98-8bef-4bdece00fc4d None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:57.589244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56384de4-ce69-4c7f-a88f-c33ca4b5c9d6 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:57.589416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102304e-0612-4c98-8bef-4bdece00fc4d None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:57.589416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 178/346] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:57 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:57.590817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102304e-0612-4c98-8bef-4bdece00fc4d None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:57.592258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 169/347] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:06:57 2022] GET /identity/v3/groups/59e3a85f3d8046408ea5818a4ed79100 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:57.598109 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56384de4-ce69-4c7f-a88f-c33ca4b5c9d6 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:57.637266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:57.708078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102304e-0612-4c98-8bef-4bdece00fc4d None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:57.745958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b3c2c-509b-4c2d-9c30-e7b0dbde2def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:57.747129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b3c2c-509b-4c2d-9c30-e7b0dbde2def None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:57.747830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b3c2c-509b-4c2d-9c30-e7b0dbde2def None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:57.748255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b3c2c-509b-4c2d-9c30-e7b0dbde2def None admin] PATH_INFO: `/v3/groups/59e3a85f3d8046408ea5818a4ed79100` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:57.749659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b3c2c-509b-4c2d-9c30-e7b0dbde2def None admin] RBAC: Authorizing `identity:get_group(group_id=59e3a85f3d8046408ea5818a4ed79100)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:57.751341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b3c2c-509b-4c2d-9c30-e7b0dbde2def None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:57.753425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 179/348] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:06:57 2022] GET /identity/v3/groups/59e3a85f3d8046408ea5818a4ed79100 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:57.759663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b3c2c-509b-4c2d-9c30-e7b0dbde2def None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:57.793324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56384de4-ce69-4c7f-a88f-c33ca4b5c9d6 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:57.877729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b3c2c-509b-4c2d-9c30-e7b0dbde2def None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:57.878989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231be9d-666a-46f5-89ec-f661d67fa721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:57.879781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231be9d-666a-46f5-89ec-f661d67fa721 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:57.879957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231be9d-666a-46f5-89ec-f661d67fa721 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:57.880245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231be9d-666a-46f5-89ec-f661d67fa721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:57.881847 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231be9d-666a-46f5-89ec-f661d67fa721 None admin] RBAC: Adding query filter params (group.id=59e3a85f3d8046408ea5818a4ed79100, role.id=118677ef2dfa4e808ddc78b083c01059, scope.project.id=02a8a5b7d75b4de4b84070e456454f06) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:57.881847 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231be9d-666a-46f5-89ec-f661d67fa721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:57.882886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231be9d-666a-46f5-89ec-f661d67fa721 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:57.889309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:57.899667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 170/349] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Jul 7 07:06:57 2022] GET /identity/v3/role_assignments?group.id=59e3a85f3d8046408ea5818a4ed79100&scope.project.id=02a8a5b7d75b4de4b84070e456454f06&role.id=118677ef2dfa4e808ddc78b083c01059 => generated 260 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:57.901205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c54fc-2693-4c99-96ef-1429e6634d8e None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:57.901516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c54fc-2693-4c99-96ef-1429e6634d8e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:57.901795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c54fc-2693-4c99-96ef-1429e6634d8e None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:57.906997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 171/350] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:57.908993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815b23b-eb60-4ac9-8d42-40b47b2aef9b None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:57.908993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815b23b-eb60-4ac9-8d42-40b47b2aef9b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:57.909254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815b23b-eb60-4ac9-8d42-40b47b2aef9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:57.920810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39593552-c3b5-4722-b9a5-38aa4471d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:57.921902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39593552-c3b5-4722-b9a5-38aa4471d14c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:57.922345 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39593552-c3b5-4722-b9a5-38aa4471d14c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:57.922775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39593552-c3b5-4722-b9a5-38aa4471d14c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:57.923783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39593552-c3b5-4722-b9a5-38aa4471d14c None admin] RBAC: Adding query filter params (group.id=59e3a85f3d8046408ea5818a4ed79100, role.id=118677ef2dfa4e808ddc78b083c01059, scope.project.id=609cac1f44f0468f95e1a23aa0389ca2) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:57.924258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39593552-c3b5-4722-b9a5-38aa4471d14c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:57.925926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39593552-c3b5-4722-b9a5-38aa4471d14c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:57.933017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 180/351] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Jul 7 07:06:57 2022] GET /identity/v3/role_assignments?group.id=59e3a85f3d8046408ea5818a4ed79100&scope.project.id=609cac1f44f0468f95e1a23aa0389ca2&role.id=118677ef2dfa4e808ddc78b083c01059 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:06:57.950574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1815b23b-eb60-4ac9-8d42-40b47b2aef9b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:57.951881 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1815b23b-eb60-4ac9-8d42-40b47b2aef9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:57.954311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:58.046994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 172/352] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:58.079234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39593552-c3b5-4722-b9a5-38aa4471d14c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:58.233891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555450c6-d9de-44ad-958a-8a8681fdcb88 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:58.235220 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555450c6-d9de-44ad-958a-8a8681fdcb88 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:58.236001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555450c6-d9de-44ad-958a-8a8681fdcb88 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:58.237681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 173/353] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:06:58.237812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39593552-c3b5-4722-b9a5-38aa4471d14c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:58.244720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408886b-085e-44d8-871f-39d9c648aeae None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:58.245318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408886b-085e-44d8-871f-39d9c648aeae None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:58.245794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408886b-085e-44d8-871f-39d9c648aeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:58.277000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-b408886b-085e-44d8-871f-39d9c648aeae None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:58.281009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b408886b-085e-44d8-871f-39d9c648aeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:58.296645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ca8c4-3377-4725-964b-cde9b5a39324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:58.297577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ca8c4-3377-4725-964b-cde9b5a39324 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:58.297809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ca8c4-3377-4725-964b-cde9b5a39324 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:58.298089 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ca8c4-3377-4725-964b-cde9b5a39324 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:58.323013 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ca8c4-3377-4725-964b-cde9b5a39324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-265ca8c4-3377-4725-964b-cde9b5a39324 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:58.338308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:58.339362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:58.340198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:58.340198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:58.340198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:58.340198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:58.340198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:58.340198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:58.340198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:58.340198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:58.340198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:58.340198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:58.340198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:58.340198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:58.347113 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 181/354] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:06:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:58.350656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b120cf-ad44-4d3e-9888-0d13e40b98d4 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:58.351869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b120cf-ad44-4d3e-9888-0d13e40b98d4 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:58.352363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b120cf-ad44-4d3e-9888-0d13e40b98d4 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:58.354434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 182/355] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:58.355412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b120cf-ad44-4d3e-9888-0d13e40b98d4 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:58.392472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 174/356] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:06:58.392472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc96e82-6fe1-4acf-85d5-a92ebc7ddef5 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:58.392472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc96e82-6fe1-4acf-85d5-a92ebc7ddef5 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:58.392472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc96e82-6fe1-4acf-85d5-a92ebc7ddef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:58.400674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:58.408088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-abc96e82-6fe1-4acf-85d5-a92ebc7ddef5 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:58.411758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-abc96e82-6fe1-4acf-85d5-a92ebc7ddef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:58.477391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:58.485385 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 175/357] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:58.486280 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc96e82-6fe1-4acf-85d5-a92ebc7ddef5 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:58.512935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b120cf-ad44-4d3e-9888-0d13e40b98d4 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:58.553051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e932671-459d-4570-9721-6063fb9c31e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:58.554097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e932671-459d-4570-9721-6063fb9c31e1 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:58.554593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e932671-459d-4570-9721-6063fb9c31e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:58.555081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e932671-459d-4570-9721-6063fb9c31e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:58.556142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e932671-459d-4570-9721-6063fb9c31e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:58.556713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e932671-459d-4570-9721-6063fb9c31e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:58.558450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e932671-459d-4570-9721-6063fb9c31e1 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:58.568768 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 183/358] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:06:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:58.570284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e932671-459d-4570-9721-6063fb9c31e1 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:58.626214 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc96e82-6fe1-4acf-85d5-a92ebc7ddef5 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:58.661841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62340612-1224-4ed8-ba99-553e9b8c86f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:58.662668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62340612-1224-4ed8-ba99-553e9b8c86f1 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:58.662957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62340612-1224-4ed8-ba99-553e9b8c86f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:58.663334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62340612-1224-4ed8-ba99-553e9b8c86f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:58.674096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62340612-1224-4ed8-ba99-553e9b8c86f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:58.677912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-62340612-1224-4ed8-ba99-553e9b8c86f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:58.682369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:58.683298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:06:58.684090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 176/359] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:06:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:58.684729 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62340612-1224-4ed8-ba99-553e9b8c86f1 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:58.690348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e932671-459d-4570-9721-6063fb9c31e1 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:58.729440 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdd1ef-4688-49e3-a394-ef79df57cc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:58.730642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdd1ef-4688-49e3-a394-ef79df57cc0c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:58.731119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdd1ef-4688-49e3-a394-ef79df57cc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:58.731617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdd1ef-4688-49e3-a394-ef79df57cc0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:58.744406 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdd1ef-4688-49e3-a394-ef79df57cc0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:58.751741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-c4fdd1ef-4688-49e3-a394-ef79df57cc0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:58.754769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:58.756111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:58.757196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:58.757196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:58.757196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:58.757196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:58.757196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:58.757196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:58.757196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:58.757196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:58.757196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:58.757196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:58.757196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 07:06:58.757196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:58.759943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 184/360] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:58.761473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdd1ef-4688-49e3-a394-ef79df57cc0c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:58.801107 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62340612-1224-4ed8-ba99-553e9b8c86f1 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:58.836553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07633b-1f6b-471a-8ef1-6694cf70ac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:58.837143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07633b-1f6b-471a-8ef1-6694cf70ac95 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:58.837449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07633b-1f6b-471a-8ef1-6694cf70ac95 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:58.837792 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07633b-1f6b-471a-8ef1-6694cf70ac95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:58.877082 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdd1ef-4688-49e3-a394-ef79df57cc0c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:58.915441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07633b-1f6b-471a-8ef1-6694cf70ac95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:58.916688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57fbdf-14b5-4e23-b111-ace4c100b186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:58.917201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07633b-1f6b-471a-8ef1-6694cf70ac95 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:58.917893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57fbdf-14b5-4e23-b111-ace4c100b186 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:58.918385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57fbdf-14b5-4e23-b111-ace4c100b186 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:58.918894 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57fbdf-14b5-4e23-b111-ace4c100b186 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:58.919994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57fbdf-14b5-4e23-b111-ace4c100b186 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:58.920529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57fbdf-14b5-4e23-b111-ace4c100b186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:58.922161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57fbdf-14b5-4e23-b111-ace4c100b186 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:58.933112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 185/361] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:06:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:58.934400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57fbdf-14b5-4e23-b111-ace4c100b186 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:58.955872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:58.982561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:59.028114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 177/362] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:59.029006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07633b-1f6b-471a-8ef1-6694cf70ac95 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:59.055549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57fbdf-14b5-4e23-b111-ace4c100b186 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:59.094777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678e161-098f-4b0b-999e-0a0eaa1636b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:59.096277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678e161-098f-4b0b-999e-0a0eaa1636b3 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:59.096805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678e161-098f-4b0b-999e-0a0eaa1636b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:59.097317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678e161-098f-4b0b-999e-0a0eaa1636b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:59.098291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678e161-098f-4b0b-999e-0a0eaa1636b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:59.098796 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678e161-098f-4b0b-999e-0a0eaa1636b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:59.100394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678e161-098f-4b0b-999e-0a0eaa1636b3 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:59.110495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 186/363] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:06:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:59.111609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678e161-098f-4b0b-999e-0a0eaa1636b3 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:59.136796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07633b-1f6b-471a-8ef1-6694cf70ac95 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:59.173325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155ca6-9434-4646-aa4d-6ee9c080b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:59.173911 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155ca6-9434-4646-aa4d-6ee9c080b719 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:59.174197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155ca6-9434-4646-aa4d-6ee9c080b719 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:59.174471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155ca6-9434-4646-aa4d-6ee9c080b719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:59.199625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:59.205784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:59.225921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678e161-098f-4b0b-999e-0a0eaa1636b3 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:59.250157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e155ca6-9434-4646-aa4d-6ee9c080b719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:59.251604 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e155ca6-9434-4646-aa4d-6ee9c080b719 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:59.268068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59912897-345f-4938-a7c7-f48088fff30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:59.269404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59912897-345f-4938-a7c7-f48088fff30a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:59.270182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59912897-345f-4938-a7c7-f48088fff30a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:59.270663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59912897-345f-4938-a7c7-f48088fff30a None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:59.272183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59912897-345f-4938-a7c7-f48088fff30a None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:59.273867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59912897-345f-4938-a7c7-f48088fff30a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:59.276266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 187/364] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:59 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:59.278874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e7a01-590e-4046-8999-bc7a7d787e2a None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:59.279374 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e7a01-590e-4046-8999-bc7a7d787e2a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:59.279875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e7a01-590e-4046-8999-bc7a7d787e2a None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:59.281916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 188/365] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:06:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:06:59.282851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e7a01-590e-4046-8999-bc7a7d787e2a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:59.368557 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 178/366] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:06:59.370493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155ca6-9434-4646-aa4d-6ee9c080b719 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:59.399769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e7a01-590e-4046-8999-bc7a7d787e2a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:59.436892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fda7e-3809-4989-9654-d0d13a26eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:59.438205 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fda7e-3809-4989-9654-d0d13a26eefc None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:59.438707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fda7e-3809-4989-9654-d0d13a26eefc None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:59.439189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fda7e-3809-4989-9654-d0d13a26eefc None admin] PATH_INFO: `/v3/users/af4562229c654137b167a6607f1e5246` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:59.440652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fda7e-3809-4989-9654-d0d13a26eefc None admin] RBAC: Authorizing `identity:get_user(user_id=af4562229c654137b167a6607f1e5246)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:59.442374 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fda7e-3809-4989-9654-d0d13a26eefc None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:59.442679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:59.445173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 189/367] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:06:59 2022] GET /identity/v3/users/af4562229c654137b167a6607f1e5246 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:59.446911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a8874-a0f5-468e-9c96-c351a98dbcb0 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:59.447632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a8874-a0f5-468e-9c96-c351a98dbcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:59.448104 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a8874-a0f5-468e-9c96-c351a98dbcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:59.465384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e85a8874-a0f5-468e-9c96-c351a98dbcb0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:06:59.466917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e85a8874-a0f5-468e-9c96-c351a98dbcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:06:59.476947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:59.489075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155ca6-9434-4646-aa4d-6ee9c080b719 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:59.526447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89208fb6-0479-431b-ba4a-ca691b64fb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:59.527316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89208fb6-0479-431b-ba4a-ca691b64fb6c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:59.527639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89208fb6-0479-431b-ba4a-ca691b64fb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:59.527915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89208fb6-0479-431b-ba4a-ca691b64fb6c None admin] PATH_INFO: `/v3/groups/59e3a85f3d8046408ea5818a4ed79100` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:59.529150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89208fb6-0479-431b-ba4a-ca691b64fb6c None admin] RBAC: Authorizing `identity:get_group(group_id=59e3a85f3d8046408ea5818a4ed79100)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:59.530696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89208fb6-0479-431b-ba4a-ca691b64fb6c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:59.532538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 179/368] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:06:59 2022] GET /identity/v3/groups/59e3a85f3d8046408ea5818a4ed79100 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:59.533402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89208fb6-0479-431b-ba4a-ca691b64fb6c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:59.541177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 190/369] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:06:59.542357 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a8874-a0f5-468e-9c96-c351a98dbcb0 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:59.640140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89208fb6-0479-431b-ba4a-ca691b64fb6c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:59.644853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a8874-a0f5-468e-9c96-c351a98dbcb0 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:59.666931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:59.675925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83be76a-6cee-4f20-94c1-44af19847c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:59.676787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83be76a-6cee-4f20-94c1-44af19847c80 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:59.677069 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83be76a-6cee-4f20-94c1-44af19847c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:59.677419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83be76a-6cee-4f20-94c1-44af19847c80 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:59.678624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83be76a-6cee-4f20-94c1-44af19847c80 None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:59.680137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83be76a-6cee-4f20-94c1-44af19847c80 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:59.682607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 180/370] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:06:59 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:59.683903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83be76a-6cee-4f20-94c1-44af19847c80 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:59.686849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855f305-de4a-4ff3-b7a6-419a93a68183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:59.688057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855f305-de4a-4ff3-b7a6-419a93a68183 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:59.688820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855f305-de4a-4ff3-b7a6-419a93a68183 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:59.689564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855f305-de4a-4ff3-b7a6-419a93a68183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:59.690628 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855f305-de4a-4ff3-b7a6-419a93a68183 None admin] RBAC: Adding query filter params (role.id=a4709d01dc6b4ff6a2471497008b7808, user.id=af4562229c654137b167a6607f1e5246, scope.system=all) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:59.691139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855f305-de4a-4ff3-b7a6-419a93a68183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:59.692799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855f305-de4a-4ff3-b7a6-419a93a68183 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:59.706624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 191/371] 10.222.0.62 () {56 vars in 1308 bytes} [Thu Jul 7 07:06:59 2022] GET /identity/v3/role_assignments?user.id=af4562229c654137b167a6607f1e5246&scope.system=all&role.id=a4709d01dc6b4ff6a2471497008b7808 => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:59.707812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855f305-de4a-4ff3-b7a6-419a93a68183 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:59.717597 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:59.835095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855f305-de4a-4ff3-b7a6-419a93a68183 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:59.840252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83be76a-6cee-4f20-94c1-44af19847c80 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:06:59.873817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f77fcb-a149-4a5f-8565-cda5d7cb23cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:59.874992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f77fcb-a149-4a5f-8565-cda5d7cb23cd None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:59.875474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f77fcb-a149-4a5f-8565-cda5d7cb23cd None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:59.875936 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f77fcb-a149-4a5f-8565-cda5d7cb23cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:59.887882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f77fcb-a149-4a5f-8565-cda5d7cb23cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-00f77fcb-a149-4a5f-8565-cda5d7cb23cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:06:59.896419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:06:59.897356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:06:59.898143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:06:59.898143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:06:59.898143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:06:59.898143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:06:59.898143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:06:59.898143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:06:59.898143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:06:59.898143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:06:59.898143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:06:59.898143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:06:59.898143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:06:59.898143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:06:59.898716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d9d2c-99b8-441f-b19d-b972f86e5eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:06:59.898716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d9d2c-99b8-441f-b19d-b972f86e5eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:06:59.898716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d9d2c-99b8-441f-b19d-b972f86e5eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:06:59.898716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d9d2c-99b8-441f-b19d-b972f86e5eb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:06:59.898971 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d9d2c-99b8-441f-b19d-b972f86e5eb2 None admin] RBAC: Adding query filter params (group.id=59e3a85f3d8046408ea5818a4ed79100, role.id=5c9f98a938a74f35857ce032dd9e06b1, scope.project.id=02a8a5b7d75b4de4b84070e456454f06) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:06:59.899600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d9d2c-99b8-441f-b19d-b972f86e5eb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:06:59.900696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d9d2c-99b8-441f-b19d-b972f86e5eb2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:06:59.901648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 192/372] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:06:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:06:59.902644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f77fcb-a149-4a5f-8565-cda5d7cb23cd None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:59.907866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 181/373] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Jul 7 07:06:59 2022] GET /identity/v3/role_assignments?group.id=59e3a85f3d8046408ea5818a4ed79100&scope.project.id=02a8a5b7d75b4de4b84070e456454f06&role.id=5c9f98a938a74f35857ce032dd9e06b1 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:06:59.908181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d9d2c-99b8-441f-b19d-b972f86e5eb2 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:06:59.980544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:06:59.983177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:00.030006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d9d2c-99b8-441f-b19d-b972f86e5eb2 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:00.058427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f77fcb-a149-4a5f-8565-cda5d7cb23cd None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:00.070499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19582cb-ec04-4911-8042-7438cb18df93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:00.071235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19582cb-ec04-4911-8042-7438cb18df93 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:00.071525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19582cb-ec04-4911-8042-7438cb18df93 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:00.071790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19582cb-ec04-4911-8042-7438cb18df93 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:00.072636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19582cb-ec04-4911-8042-7438cb18df93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:00.072940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19582cb-ec04-4911-8042-7438cb18df93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:00.074374 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19582cb-ec04-4911-8042-7438cb18df93 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:00.084621 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 182/374] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:00.095293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19582cb-ec04-4911-8042-7438cb18df93 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:00.122826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471f2a3-50cd-4f42-9ce1-3cb2b956fef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:00.123717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471f2a3-50cd-4f42-9ce1-3cb2b956fef4 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:00.124004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471f2a3-50cd-4f42-9ce1-3cb2b956fef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:00.124385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471f2a3-50cd-4f42-9ce1-3cb2b956fef4 None admin] PATH_INFO: `/v3/groups/59e3a85f3d8046408ea5818a4ed79100` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:00.125653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471f2a3-50cd-4f42-9ce1-3cb2b956fef4 None admin] RBAC: Authorizing `identity:get_group(group_id=59e3a85f3d8046408ea5818a4ed79100)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:00.127128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471f2a3-50cd-4f42-9ce1-3cb2b956fef4 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:00.135679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 193/375] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:06:59 2022] GET /identity/v3/groups/59e3a85f3d8046408ea5818a4ed79100 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:00.136793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471f2a3-50cd-4f42-9ce1-3cb2b956fef4 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:00.207396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19582cb-ec04-4911-8042-7438cb18df93 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:00.230613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:00.246012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23505cf-44ac-4059-b219-b7e8b02a3e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:00.246676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23505cf-44ac-4059-b219-b7e8b02a3e94 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:00.246956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23505cf-44ac-4059-b219-b7e8b02a3e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:00.247233 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23505cf-44ac-4059-b219-b7e8b02a3e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:00.279541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471f2a3-50cd-4f42-9ce1-3cb2b956fef4 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:00.315078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:00.323032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23505cf-44ac-4059-b219-b7e8b02a3e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:00.324358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1f5a8-d3bf-4ce3-8b1d-46f6ba35234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:00.324499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23505cf-44ac-4059-b219-b7e8b02a3e94 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:00.325031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1f5a8-d3bf-4ce3-8b1d-46f6ba35234b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:00.325366 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1f5a8-d3bf-4ce3-8b1d-46f6ba35234b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:00.325811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1f5a8-d3bf-4ce3-8b1d-46f6ba35234b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:00.326774 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1f5a8-d3bf-4ce3-8b1d-46f6ba35234b None admin] RBAC: Adding query filter params (group.id=59e3a85f3d8046408ea5818a4ed79100, role.id=5c9f98a938a74f35857ce032dd9e06b1, scope.project.id=609cac1f44f0468f95e1a23aa0389ca2) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:00.327093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1f5a8-d3bf-4ce3-8b1d-46f6ba35234b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:00.328674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1f5a8-d3bf-4ce3-8b1d-46f6ba35234b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:00.335810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 194/376] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Jul 7 07:07:00 2022] GET /identity/v3/role_assignments?group.id=59e3a85f3d8046408ea5818a4ed79100&scope.project.id=609cac1f44f0468f95e1a23aa0389ca2&role.id=5c9f98a938a74f35857ce032dd9e06b1 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:00.432903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 183/377] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 07:07:00.438589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1f5a8-d3bf-4ce3-8b1d-46f6ba35234b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:00.567495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1f5a8-d3bf-4ce3-8b1d-46f6ba35234b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:00.609501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9e17-6512-4708-bbc0-758143bde8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:00.610392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9e17-6512-4708-bbc0-758143bde8ff None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:00.610676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9e17-6512-4708-bbc0-758143bde8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:00.610953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9e17-6512-4708-bbc0-758143bde8ff None admin] PATH_INFO: `/v3/projects/b5d565ccc8d74ff1978b89c064272f84` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:00.612266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e9e17-6512-4708-bbc0-758143bde8ff None admin] RBAC: Authorizing `identity:get_project(project_id=b5d565ccc8d74ff1978b89c064272f84)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:00.613826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e9e17-6512-4708-bbc0-758143bde8ff None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:00.620710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 195/378] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:07:00 2022] GET /identity/v3/projects/b5d565ccc8d74ff1978b89c064272f84 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:00.622391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23505cf-44ac-4059-b219-b7e8b02a3e94 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:00.649684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:00.756950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23505cf-44ac-4059-b219-b7e8b02a3e94 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:00.798970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c3384-be78-455b-a846-de5b069495f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:00.799832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c3384-be78-455b-a846-de5b069495f0 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:00.800113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c3384-be78-455b-a846-de5b069495f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:00.800388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c3384-be78-455b-a846-de5b069495f0 None admin] PATH_INFO: `/v3/groups/b3995036eb7349398178587be2f3a68e` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:00.808746 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c3384-be78-455b-a846-de5b069495f0 None admin] RBAC: Authorizing `identity:get_group(group_id=b3995036eb7349398178587be2f3a68e)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:00.810253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c3384-be78-455b-a846-de5b069495f0 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:00.812346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 184/379] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:07:00 2022] GET /identity/v3/groups/b3995036eb7349398178587be2f3a68e => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:00.818593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9e17-6512-4708-bbc0-758143bde8ff None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:00.910234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:00.968887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9e17-6512-4708-bbc0-758143bde8ff None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:01.001078 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c13063-a4db-4386-bd58-39d8c98620d4 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:01.001736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c13063-a4db-4386-bd58-39d8c98620d4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:01.002224 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c13063-a4db-4386-bd58-39d8c98620d4 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:01.004133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 185/380] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:07:01.010740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43818a3-7744-4b0e-b773-3bde41c79d24 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:01.011295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43818a3-7744-4b0e-b773-3bde41c79d24 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:01.011589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594bda9-088c-4916-a19a-4696ac849444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:01.012015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43818a3-7744-4b0e-b773-3bde41c79d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:01.012266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594bda9-088c-4916-a19a-4696ac849444 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:01.012552 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594bda9-088c-4916-a19a-4696ac849444 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:01.012842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594bda9-088c-4916-a19a-4696ac849444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:01.013731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594bda9-088c-4916-a19a-4696ac849444 None admin] RBAC: Adding query filter params (group.id=b3995036eb7349398178587be2f3a68e, role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=b5d565ccc8d74ff1978b89c064272f84) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:01.014048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594bda9-088c-4916-a19a-4696ac849444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:01.017240 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594bda9-088c-4916-a19a-4696ac849444 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:01.027540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 196/381] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Jul 7 07:07:00 2022] GET /identity/v3/role_assignments?group.id=b3995036eb7349398178587be2f3a68e&scope.project.id=b5d565ccc8d74ff1978b89c064272f84&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:01.045769 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e43818a3-7744-4b0e-b773-3bde41c79d24 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:01.047354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e43818a3-7744-4b0e-b773-3bde41c79d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:01.183840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 186/382] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:07:01.222773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594bda9-088c-4916-a19a-4696ac849444 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:01.254982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384a5c-f3ed-4e6b-ab82-d91e3b664961 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:01.255611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384a5c-f3ed-4e6b-ab82-d91e3b664961 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:01.256078 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384a5c-f3ed-4e6b-ab82-d91e3b664961 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:01.257797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 187/383] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:07:01.264055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5d726-93fd-49f6-a632-fe44cc4b44d2 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:01.264607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5d726-93fd-49f6-a632-fe44cc4b44d2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:01.265069 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5d726-93fd-49f6-a632-fe44cc4b44d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:01.286831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-83d5d726-93fd-49f6-a632-fe44cc4b44d2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:01.288353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-83d5d726-93fd-49f6-a632-fe44cc4b44d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:01.304696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:01.379805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594bda9-088c-4916-a19a-4696ac849444 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:01.429833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 188/384] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:07:01.437395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:01.451223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49023d81-1253-4d46-b0f0-914813590938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:01.452380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49023d81-1253-4d46-b0f0-914813590938 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:01.452840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49023d81-1253-4d46-b0f0-914813590938 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:01.453327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49023d81-1253-4d46-b0f0-914813590938 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:01.467569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49023d81-1253-4d46-b0f0-914813590938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:01.468896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5d726-93fd-49f6-a632-fe44cc4b44d2 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-49023d81-1253-4d46-b0f0-914813590938 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:01.476528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:01.477545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:01.478714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 197/385] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:01.489245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49023d81-1253-4d46-b0f0-914813590938 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:01.639909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5d726-93fd-49f6-a632-fe44cc4b44d2 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:01.674798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacbf3a-122e-47d7-ac4a-89c2f2e17148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:01.675608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacbf3a-122e-47d7-ac4a-89c2f2e17148 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:01.675888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacbf3a-122e-47d7-ac4a-89c2f2e17148 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:01.676162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacbf3a-122e-47d7-ac4a-89c2f2e17148 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:01.689901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacbf3a-122e-47d7-ac4a-89c2f2e17148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:01.703954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49023d81-1253-4d46-b0f0-914813590938 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-ffacbf3a-122e-47d7-ac4a-89c2f2e17148 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:01.707779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:01.708665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:01.709487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:01.709487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:01.709487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:01.709487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:01.709487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:01.709487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:01.709487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:01.709487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:01.709487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:01.709487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:01.709487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:07:01.709487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:01.714448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 189/386] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:01.723637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacbf3a-122e-47d7-ac4a-89c2f2e17148 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:01.724946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:01.782009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0964e-a539-4ebe-9024-5ae68775cc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:01.782708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0964e-a539-4ebe-9024-5ae68775cc2c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:01.783000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0964e-a539-4ebe-9024-5ae68775cc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:01.783282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0964e-a539-4ebe-9024-5ae68775cc2c None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:01.784055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0964e-a539-4ebe-9024-5ae68775cc2c None admin] RBAC: Adding query filter params (name=member) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:01.784365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0964e-a539-4ebe-9024-5ae68775cc2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:01.785817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0964e-a539-4ebe-9024-5ae68775cc2c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:01.804873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 198/387] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:07:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:01.827299 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0964e-a539-4ebe-9024-5ae68775cc2c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:01.838272 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacbf3a-122e-47d7-ac4a-89c2f2e17148 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:01.874595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec04f8-0283-414b-a5c7-e2b053ca7a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:01.875336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec04f8-0283-414b-a5c7-e2b053ca7a8b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:01.875619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec04f8-0283-414b-a5c7-e2b053ca7a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:01.875891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec04f8-0283-414b-a5c7-e2b053ca7a8b None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:01.876640 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec04f8-0283-414b-a5c7-e2b053ca7a8b None admin] RBAC: Adding query filter params (name=member) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:01.876941 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec04f8-0283-414b-a5c7-e2b053ca7a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:01.878421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec04f8-0283-414b-a5c7-e2b053ca7a8b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:01.889114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 190/388] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:07:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:01.895991 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec04f8-0283-414b-a5c7-e2b053ca7a8b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:01.931119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:01.977929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:02.023118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec04f8-0283-414b-a5c7-e2b053ca7a8b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:02.063384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a876a-f018-4114-8ceb-2e00aa6367df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:02.064530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a876a-f018-4114-8ceb-2e00aa6367df None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:02.064945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a876a-f018-4114-8ceb-2e00aa6367df None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:02.065412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a876a-f018-4114-8ceb-2e00aa6367df None admin] PATH_INFO: `/v3/groups/59e3a85f3d8046408ea5818a4ed79100` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:02.067236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a876a-f018-4114-8ceb-2e00aa6367df None admin] RBAC: Authorizing `identity:get_group(group_id=59e3a85f3d8046408ea5818a4ed79100)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:02.069194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a876a-f018-4114-8ceb-2e00aa6367df None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:02.071807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 191/389] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:07:01 2022] GET /identity/v3/groups/59e3a85f3d8046408ea5818a4ed79100 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:02.078159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a876a-f018-4114-8ceb-2e00aa6367df None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:02.084145 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0964e-a539-4ebe-9024-5ae68775cc2c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:02.139796 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb1618-d190-43b1-be4a-d5445e1b0617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:02.140807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb1618-d190-43b1-be4a-d5445e1b0617 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:02.140942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb1618-d190-43b1-be4a-d5445e1b0617 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:02.141243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb1618-d190-43b1-be4a-d5445e1b0617 None admin] PATH_INFO: `/v3/groups/59e3a85f3d8046408ea5818a4ed79100` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:02.145935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb1618-d190-43b1-be4a-d5445e1b0617 None admin] RBAC: Authorizing `identity:get_group(group_id=59e3a85f3d8046408ea5818a4ed79100)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:02.147433 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb1618-d190-43b1-be4a-d5445e1b0617 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:02.149462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 199/390] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:07:01 2022] GET /identity/v3/groups/59e3a85f3d8046408ea5818a4ed79100 => generated 226 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:02.166995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb1618-d190-43b1-be4a-d5445e1b0617 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:02.197299 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a876a-f018-4114-8ceb-2e00aa6367df None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:02.238144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f75ec-011f-4383-96b6-db0ac54d3ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:02.238956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f75ec-011f-4383-96b6-db0ac54d3ada None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:02.241646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f75ec-011f-4383-96b6-db0ac54d3ada None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:02.241947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f75ec-011f-4383-96b6-db0ac54d3ada None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:02.246506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f75ec-011f-4383-96b6-db0ac54d3ada None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:02.247982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f75ec-011f-4383-96b6-db0ac54d3ada None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:02.253137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 192/391] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:07:02 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:02.256549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f75ec-011f-4383-96b6-db0ac54d3ada None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:02.262311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:02.346327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb1618-d190-43b1-be4a-d5445e1b0617 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:02.368949 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:02.415851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe0e7e-4d65-4540-906d-9739313b0dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:02.416824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe0e7e-4d65-4540-906d-9739313b0dcd None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:02.417133 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe0e7e-4d65-4540-906d-9739313b0dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:02.417461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe0e7e-4d65-4540-906d-9739313b0dcd None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:02.419086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe0e7e-4d65-4540-906d-9739313b0dcd None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:02.420517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe0e7e-4d65-4540-906d-9739313b0dcd None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:02.422759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 200/392] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:07:02 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:02.429104 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe0e7e-4d65-4540-906d-9739313b0dcd None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:02.459765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f75ec-011f-4383-96b6-db0ac54d3ada None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:02.531119 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5ca0d-845a-46a6-93b6-906fe297bc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:02.532403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5ca0d-845a-46a6-93b6-906fe297bc5d None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:02.532899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5ca0d-845a-46a6-93b6-906fe297bc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:02.533469 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5ca0d-845a-46a6-93b6-906fe297bc5d None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2/groups/59e3a85f3d8046408ea5818a4ed79100/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:02.535716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5ca0d-845a-46a6-93b6-906fe297bc5d None admin] RBAC: Authorizing `identity:create_grant(project_id=609cac1f44f0468f95e1a23aa0389ca2, group_id=59e3a85f3d8046408ea5818a4ed79100, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:02.538745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5ca0d-845a-46a6-93b6-906fe297bc5d None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:02.564544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 193/393] 10.222.0.62 () {58 vars in 1442 bytes} [Thu Jul 7 07:07:02 2022] PUT /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2/groups/59e3a85f3d8046408ea5818a4ed79100/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:07:02.603029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe0e7e-4d65-4540-906d-9739313b0dcd None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:02.642277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de4b5b-af14-4846-be6a-ec7a741bdfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:02.643590 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de4b5b-af14-4846-be6a-ec7a741bdfd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:02.644074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de4b5b-af14-4846-be6a-ec7a741bdfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:02.644544 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de4b5b-af14-4846-be6a-ec7a741bdfd2 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06/groups/59e3a85f3d8046408ea5818a4ed79100/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:02.646863 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de4b5b-af14-4846-be6a-ec7a741bdfd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=02a8a5b7d75b4de4b84070e456454f06, group_id=59e3a85f3d8046408ea5818a4ed79100, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:02.648765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de4b5b-af14-4846-be6a-ec7a741bdfd2 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:02.667577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 201/394] 10.222.0.62 () {58 vars in 1442 bytes} [Thu Jul 7 07:07:02 2022] PUT /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06/groups/59e3a85f3d8046408ea5818a4ed79100/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:07:02.892743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54ab40-da30-4655-908a-8710f9271277 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:02.893538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54ab40-da30-4655-908a-8710f9271277 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:02.894040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54ab40-da30-4655-908a-8710f9271277 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:02.895887 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 194/395] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:02.902428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42387593-66f3-4638-9259-38686c3c9c27 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:02.902736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42387593-66f3-4638-9259-38686c3c9c27 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:02.902988 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42387593-66f3-4638-9259-38686c3c9c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:02.930417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-42387593-66f3-4638-9259-38686c3c9c27 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:02.931691 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-42387593-66f3-4638-9259-38686c3c9c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:02.976875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:03.011406 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 202/396] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:03.057610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54ab40-da30-4655-908a-8710f9271277 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:03.112117 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503580a-58bd-4b13-8c02-41011f096162 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:03.112444 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503580a-58bd-4b13-8c02-41011f096162 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:03.112664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503580a-58bd-4b13-8c02-41011f096162 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:03.117250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 203/397] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:03.122820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463674-10c4-40fa-a13b-398b16ba49f4 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:03.123121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463674-10c4-40fa-a13b-398b16ba49f4 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:03.123382 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463674-10c4-40fa-a13b-398b16ba49f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:03.154961 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-aa463674-10c4-40fa-a13b-398b16ba49f4 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:03.156034 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-aa463674-10c4-40fa-a13b-398b16ba49f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:03.192839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54ab40-da30-4655-908a-8710f9271277 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:03.225481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:03.233534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf570f2-f75c-4056-bb12-aa810865760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:03.236004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf570f2-f75c-4056-bb12-aa810865760d None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:03.236524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf570f2-f75c-4056-bb12-aa810865760d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:03.237052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf570f2-f75c-4056-bb12-aa810865760d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:03.250406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf570f2-f75c-4056-bb12-aa810865760d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-7bf570f2-f75c-4056-bb12-aa810865760d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:03.260594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:03.261697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:03.262531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:03.262531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:03.262531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:03.262531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:03.262531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:03.262531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:03.262531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:03.262531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:03.262531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:03.262531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:03.262531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:07:03.262531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:03.269429 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 195/398] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:07:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:03.271616 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf570f2-f75c-4056-bb12-aa810865760d None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:03.354786 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 204/399] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:03.385783 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf570f2-f75c-4056-bb12-aa810865760d None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:03.390357 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463674-10c4-40fa-a13b-398b16ba49f4 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:03.433660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:03.448333 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597053dd-f06e-468b-9f87-f3d271f066e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:03.449142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597053dd-f06e-468b-9f87-f3d271f066e2 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:03.449459 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597053dd-f06e-468b-9f87-f3d271f066e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:03.449743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597053dd-f06e-468b-9f87-f3d271f066e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:03.450517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597053dd-f06e-468b-9f87-f3d271f066e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:03.450829 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597053dd-f06e-468b-9f87-f3d271f066e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:03.452246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597053dd-f06e-468b-9f87-f3d271f066e2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:03.464454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 196/400] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:03.484268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597053dd-f06e-468b-9f87-f3d271f066e2 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:03.525211 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463674-10c4-40fa-a13b-398b16ba49f4 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:03.528590 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:03.562432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0208fe6-9e95-42b5-a582-ef44d12f18c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:03.563723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0208fe6-9e95-42b5-a582-ef44d12f18c1 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:03.564355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0208fe6-9e95-42b5-a582-ef44d12f18c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:03.564849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0208fe6-9e95-42b5-a582-ef44d12f18c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:03.577775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0208fe6-9e95-42b5-a582-ef44d12f18c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-f0208fe6-9e95-42b5-a582-ef44d12f18c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:03.587866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:03.588807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:03.589618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:03.589618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:03.589618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:03.589618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:03.589618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:03.589618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:03.589618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:03.589618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:03.589618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:03.589618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:03.589618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:07:03.589618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:03.592355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 205/401] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:07:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:03.593982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c95fe7-0af2-437f-bf30-ec4bfb482f97 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:03.594486 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c95fe7-0af2-437f-bf30-ec4bfb482f97 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:03.594970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c95fe7-0af2-437f-bf30-ec4bfb482f97 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:03.596701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 206/402] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:03.602445 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7dfde-e26d-408d-bdbe-adaf4339b9f2 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:03.603127 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7dfde-e26d-408d-bdbe-adaf4339b9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:03.603667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7dfde-e26d-408d-bdbe-adaf4339b9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:03.607456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597053dd-f06e-468b-9f87-f3d271f066e2 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:03.623304 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-91a7dfde-e26d-408d-bdbe-adaf4339b9f2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:03.624935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-91a7dfde-e26d-408d-bdbe-adaf4339b9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:03.647475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dd696-4ac9-4ef2-b469-72488a919a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:03.647475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dd696-4ac9-4ef2-b469-72488a919a5c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:03.647475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dd696-4ac9-4ef2-b469-72488a919a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:03.647475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dd696-4ac9-4ef2-b469-72488a919a5c None admin] PATH_INFO: `/v3/groups/59e3a85f3d8046408ea5818a4ed79100` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:03.649352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8dd696-4ac9-4ef2-b469-72488a919a5c None admin] RBAC: Authorizing `identity:get_group(group_id=59e3a85f3d8046408ea5818a4ed79100)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:03.651101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8dd696-4ac9-4ef2-b469-72488a919a5c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:03.653463 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 197/403] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:07:03 2022] GET /identity/v3/groups/59e3a85f3d8046408ea5818a4ed79100 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:03.654562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dd696-4ac9-4ef2-b469-72488a919a5c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:03.729114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:03.745368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 207/404] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:03.746614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7dfde-e26d-408d-bdbe-adaf4339b9f2 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:03.810111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dd696-4ac9-4ef2-b469-72488a919a5c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:03.854435 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a8694-b45c-442e-8630-a6a21fd1f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:03.855149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a8694-b45c-442e-8630-a6a21fd1f722 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:03.855431 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a8694-b45c-442e-8630-a6a21fd1f722 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:03.855722 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a8694-b45c-442e-8630-a6a21fd1f722 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:03.856481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a8694-b45c-442e-8630-a6a21fd1f722 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:03.856790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a8694-b45c-442e-8630-a6a21fd1f722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:03.860016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a8694-b45c-442e-8630-a6a21fd1f722 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:03.874430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 198/405] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:03.875388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a8694-b45c-442e-8630-a6a21fd1f722 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:03.882410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:03.892285 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7dfde-e26d-408d-bdbe-adaf4339b9f2 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:03.951516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b372f6-e251-4685-9d78-968e026a7a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:03.952395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b372f6-e251-4685-9d78-968e026a7a9b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:03.952670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b372f6-e251-4685-9d78-968e026a7a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:03.952938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b372f6-e251-4685-9d78-968e026a7a9b None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:03.955224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b372f6-e251-4685-9d78-968e026a7a9b None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:03.956729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b372f6-e251-4685-9d78-968e026a7a9b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:03.959875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 208/406] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:07:03 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:03.960732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b372f6-e251-4685-9d78-968e026a7a9b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:04.012219 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a8694-b45c-442e-8630-a6a21fd1f722 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:04.033589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:04.057493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa261e-ec76-473e-9fb9-f8b503324089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:04.058311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa261e-ec76-473e-9fb9-f8b503324089 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:04.058591 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa261e-ec76-473e-9fb9-f8b503324089 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:04.058864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa261e-ec76-473e-9fb9-f8b503324089 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:04.070684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa261e-ec76-473e-9fb9-f8b503324089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-91aa261e-ec76-473e-9fb9-f8b503324089 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:04.078956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:04.079964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:04.080737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 199/407] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:04.082016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa261e-ec76-473e-9fb9-f8b503324089 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:04.093270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b372f6-e251-4685-9d78-968e026a7a9b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:04.135180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6d3b1-0226-49ba-8de9-8abbbe1aed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:04.136163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6d3b1-0226-49ba-8de9-8abbbe1aed87 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:04.136449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6d3b1-0226-49ba-8de9-8abbbe1aed87 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:04.136725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6d3b1-0226-49ba-8de9-8abbbe1aed87 None admin] PATH_INFO: `/v3/groups/59e3a85f3d8046408ea5818a4ed79100` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:04.138178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6d3b1-0226-49ba-8de9-8abbbe1aed87 None admin] RBAC: Authorizing `identity:get_group(group_id=59e3a85f3d8046408ea5818a4ed79100)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:04.139750 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6d3b1-0226-49ba-8de9-8abbbe1aed87 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:04.141947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 209/408] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:07:03 2022] GET /identity/v3/groups/59e3a85f3d8046408ea5818a4ed79100 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:04.142847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6d3b1-0226-49ba-8de9-8abbbe1aed87 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:04.182867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:04.198995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa261e-ec76-473e-9fb9-f8b503324089 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:04.244755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572afe7-f1a1-4381-a856-f4317c61f822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:04.246799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572afe7-f1a1-4381-a856-f4317c61f822 None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:04.247077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572afe7-f1a1-4381-a856-f4317c61f822 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:04.247349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572afe7-f1a1-4381-a856-f4317c61f822 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06/groups/59e3a85f3d8046408ea5818a4ed79100/roles/5c9f98a938a74f35857ce032dd9e06b1` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:04.249775 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572afe7-f1a1-4381-a856-f4317c61f822 None admin] RBAC: Authorizing `identity:create_grant(project_id=02a8a5b7d75b4de4b84070e456454f06, group_id=59e3a85f3d8046408ea5818a4ed79100, role_id=5c9f98a938a74f35857ce032dd9e06b1)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:04.251342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572afe7-f1a1-4381-a856-f4317c61f822 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:04.269982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 200/409] 10.222.0.62 () {58 vars in 1442 bytes} [Thu Jul 7 07:07:04 2022] PUT /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06/groups/59e3a85f3d8046408ea5818a4ed79100/roles/5c9f98a938a74f35857ce032dd9e06b1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:07:04.271068 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572afe7-f1a1-4381-a856-f4317c61f822 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:04.281695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6d3b1-0226-49ba-8de9-8abbbe1aed87 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:04.318315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:04.338855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63eedd-c32b-4c1d-ba87-fcad20bf32ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:04.339743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63eedd-c32b-4c1d-ba87-fcad20bf32ff None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:04.340030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63eedd-c32b-4c1d-ba87-fcad20bf32ff None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:04.340306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63eedd-c32b-4c1d-ba87-fcad20bf32ff None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:04.341334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63eedd-c32b-4c1d-ba87-fcad20bf32ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:04.341648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63eedd-c32b-4c1d-ba87-fcad20bf32ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:04.343303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63eedd-c32b-4c1d-ba87-fcad20bf32ff None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:04.357157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 210/410] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:04.360324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63eedd-c32b-4c1d-ba87-fcad20bf32ff None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:04.425211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572afe7-f1a1-4381-a856-f4317c61f822 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:04.465061 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35414c-90cd-45a7-a873-730e2b6172f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:04.466718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35414c-90cd-45a7-a873-730e2b6172f9 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:04.467222 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35414c-90cd-45a7-a873-730e2b6172f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:04.467697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35414c-90cd-45a7-a873-730e2b6172f9 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:04.469452 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35414c-90cd-45a7-a873-730e2b6172f9 None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:04.471240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35414c-90cd-45a7-a873-730e2b6172f9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:04.473803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 201/411] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:07:04 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:04.480265 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35414c-90cd-45a7-a873-730e2b6172f9 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:04.502086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:04.512582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63eedd-c32b-4c1d-ba87-fcad20bf32ff None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:04.550397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3e64d-0acb-4c07-a7e3-63b2c9a34098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:04.551282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3e64d-0acb-4c07-a7e3-63b2c9a34098 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:04.551561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3e64d-0acb-4c07-a7e3-63b2c9a34098 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:04.551838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3e64d-0acb-4c07-a7e3-63b2c9a34098 None admin] PATH_INFO: `/v3/groups/b3995036eb7349398178587be2f3a68e` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:04.554811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3e64d-0acb-4c07-a7e3-63b2c9a34098 None admin] RBAC: Authorizing `identity:get_group(group_id=b3995036eb7349398178587be2f3a68e)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:04.556393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3e64d-0acb-4c07-a7e3-63b2c9a34098 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:04.562743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 211/412] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:07:04 2022] GET /identity/v3/groups/b3995036eb7349398178587be2f3a68e => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:04.563982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3e64d-0acb-4c07-a7e3-63b2c9a34098 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:04.597856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35414c-90cd-45a7-a873-730e2b6172f9 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:04.599381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:04.634070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737ce9d-b818-4a38-b36c-0d882a850b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:04.635047 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737ce9d-b818-4a38-b36c-0d882a850b68 None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:04.635327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737ce9d-b818-4a38-b36c-0d882a850b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:04.635608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737ce9d-b818-4a38-b36c-0d882a850b68 None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2/groups/59e3a85f3d8046408ea5818a4ed79100/roles/5c9f98a938a74f35857ce032dd9e06b1` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:04.637843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737ce9d-b818-4a38-b36c-0d882a850b68 None admin] RBAC: Authorizing `identity:create_grant(project_id=609cac1f44f0468f95e1a23aa0389ca2, group_id=59e3a85f3d8046408ea5818a4ed79100, role_id=5c9f98a938a74f35857ce032dd9e06b1)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:04.639600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737ce9d-b818-4a38-b36c-0d882a850b68 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:04.658382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 202/413] 10.222.0.62 () {58 vars in 1442 bytes} [Thu Jul 7 07:07:04 2022] PUT /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2/groups/59e3a85f3d8046408ea5818a4ed79100/roles/5c9f98a938a74f35857ce032dd9e06b1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:07:04.684573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3e64d-0acb-4c07-a7e3-63b2c9a34098 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:04.731044 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983b617-4b07-48ba-b328-044f50d7d769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:04.731984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983b617-4b07-48ba-b328-044f50d7d769 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:04.732268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983b617-4b07-48ba-b328-044f50d7d769 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:04.732545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983b617-4b07-48ba-b328-044f50d7d769 None admin] PATH_INFO: `/v3/projects/b5d565ccc8d74ff1978b89c064272f84` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:04.734009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983b617-4b07-48ba-b328-044f50d7d769 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d565ccc8d74ff1978b89c064272f84)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:04.736429 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983b617-4b07-48ba-b328-044f50d7d769 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:04.741908 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 212/414] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:07:04 2022] GET /identity/v3/projects/b5d565ccc8d74ff1978b89c064272f84 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:04.746256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737ce9d-b818-4a38-b36c-0d882a850b68 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:04.876048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737ce9d-b818-4a38-b36c-0d882a850b68 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:04.925093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c383e-b136-4f32-b7bd-317db5f9c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:04.926083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c383e-b136-4f32-b7bd-317db5f9c129 None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:04.926370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c383e-b136-4f32-b7bd-317db5f9c129 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:04.926741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c383e-b136-4f32-b7bd-317db5f9c129 None admin] PATH_INFO: `/v3/projects/b5d565ccc8d74ff1978b89c064272f84/groups/b3995036eb7349398178587be2f3a68e/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:04.928783 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c383e-b136-4f32-b7bd-317db5f9c129 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d565ccc8d74ff1978b89c064272f84, group_id=b3995036eb7349398178587be2f3a68e, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:04.930299 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c383e-b136-4f32-b7bd-317db5f9c129 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:04.948701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 203/415] 10.222.0.62 () {58 vars in 1442 bytes} [Thu Jul 7 07:07:04 2022] PUT /identity/v3/projects/b5d565ccc8d74ff1978b89c064272f84/groups/b3995036eb7349398178587be2f3a68e/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:07:05.301121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2808e4-3b1c-46f5-8a94-dcc672bb590f None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:05.301121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2808e4-3b1c-46f5-8a94-dcc672bb590f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:05.301121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2808e4-3b1c-46f5-8a94-dcc672bb590f None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:05.301121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 213/416] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:05.313001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629daa73-abd3-4d88-b692-42f8bc5f3151 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:05.313001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629daa73-abd3-4d88-b692-42f8bc5f3151 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:05.313001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629daa73-abd3-4d88-b692-42f8bc5f3151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:05.333885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-629daa73-abd3-4d88-b692-42f8bc5f3151 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:05.335430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-629daa73-abd3-4d88-b692-42f8bc5f3151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:05.348795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dac3cd-9edc-47bb-8686-c9e04d9267fe None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:05.349109 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dac3cd-9edc-47bb-8686-c9e04d9267fe None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:05.349386 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dac3cd-9edc-47bb-8686-c9e04d9267fe None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:05.351191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 214/417] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:07:05.356465 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483b3b-bcaf-44e2-8c59-340271c40d8f None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:05.356773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483b3b-bcaf-44e2-8c59-340271c40d8f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:05.357028 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483b3b-bcaf-44e2-8c59-340271c40d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:05.363432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:05.377399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ee483b3b-bcaf-44e2-8c59-340271c40d8f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:05.378618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ee483b3b-bcaf-44e2-8c59-340271c40d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:05.414089 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:05.465944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 215/418] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:05.479899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 204/419] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:05.512760 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483b3b-bcaf-44e2-8c59-340271c40d8f None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:05.516786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629daa73-abd3-4d88-b692-42f8bc5f3151 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:05.627048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629daa73-abd3-4d88-b692-42f8bc5f3151 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:05.664095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b10cd2-b7cc-4c4b-a345-01d2496c523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:05.665309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b10cd2-b7cc-4c4b-a345-01d2496c523b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:05.665794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b10cd2-b7cc-4c4b-a345-01d2496c523b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:05.666389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b10cd2-b7cc-4c4b-a345-01d2496c523b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:05.677583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b10cd2-b7cc-4c4b-a345-01d2496c523b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-17b10cd2-b7cc-4c4b-a345-01d2496c523b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:05.686166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:05.687065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:05.687827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:05.687827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:05.687827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:05.687827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:05.687827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:05.687827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:05.687827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:05.687827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:05.687827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:05.687827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:05.687827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:07:05.687827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:05.690563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 205/420] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:05.696805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b10cd2-b7cc-4c4b-a345-01d2496c523b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:05.713660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:05.768210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483b3b-bcaf-44e2-8c59-340271c40d8f None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:05.808104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b10cd2-b7cc-4c4b-a345-01d2496c523b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:05.844222 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fc37d-d353-44da-a9aa-0582bfe0832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:05.845661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fc37d-d353-44da-a9aa-0582bfe0832b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:05.846331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fc37d-d353-44da-a9aa-0582bfe0832b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:05.846747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fc37d-d353-44da-a9aa-0582bfe0832b None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:05.847789 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fc37d-d353-44da-a9aa-0582bfe0832b None admin] RBAC: Adding query filter params (name=member) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:05.848225 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fc37d-d353-44da-a9aa-0582bfe0832b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:05.850467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fc37d-d353-44da-a9aa-0582bfe0832b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:05.856135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835df7cc-b995-4a07-ba66-c42222be2669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:05.857137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835df7cc-b995-4a07-ba66-c42222be2669 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:05.858742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835df7cc-b995-4a07-ba66-c42222be2669 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:05.859159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835df7cc-b995-4a07-ba66-c42222be2669 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:05.877948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 206/421] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:07:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:05.879141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fc37d-d353-44da-a9aa-0582bfe0832b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:05.893893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835df7cc-b995-4a07-ba66-c42222be2669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-835df7cc-b995-4a07-ba66-c42222be2669 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:05.902021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:05.903107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:05.904069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:05.904069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:05.904069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:05.904069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:05.904069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:05.904069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:05.904069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:05.904069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:05.904069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:05.904069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:05.904069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 07:07:05.904069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:05.906491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 216/422] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:05.918236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835df7cc-b995-4a07-ba66-c42222be2669 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:05.940757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:06.009628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:06.062238 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fc37d-d353-44da-a9aa-0582bfe0832b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:06.077336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835df7cc-b995-4a07-ba66-c42222be2669 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:06.133259 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fe1ce-9db3-4250-a143-9ef3353af7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:06.133838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fe1ce-9db3-4250-a143-9ef3353af7fa None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:06.134117 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fe1ce-9db3-4250-a143-9ef3353af7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:06.134464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fe1ce-9db3-4250-a143-9ef3353af7fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:06.145514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a820c-0adf-4824-9498-361bf8f9e02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:06.146216 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a820c-0adf-4824-9498-361bf8f9e02f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:06.146503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a820c-0adf-4824-9498-361bf8f9e02f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:06.146777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a820c-0adf-4824-9498-361bf8f9e02f None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:06.147547 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a820c-0adf-4824-9498-361bf8f9e02f None admin] RBAC: Adding query filter params (name=member) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:06.147848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a820c-0adf-4824-9498-361bf8f9e02f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:06.149284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a820c-0adf-4824-9498-361bf8f9e02f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:06.159362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 217/423] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:07:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:06.166244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a820c-0adf-4824-9498-361bf8f9e02f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:06.239244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fe1ce-9db3-4250-a143-9ef3353af7fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:06.240782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fe1ce-9db3-4250-a143-9ef3353af7fa None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:06.316063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:06.337663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a820c-0adf-4824-9498-361bf8f9e02f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:06.373686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d260e-7631-46b1-95b8-2103b5447c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:06.374422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d260e-7631-46b1-95b8-2103b5447c1a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:06.374708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d260e-7631-46b1-95b8-2103b5447c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:06.374986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d260e-7631-46b1-95b8-2103b5447c1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:06.412087 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:06.458854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 207/424] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:06.464809 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fe1ce-9db3-4250-a143-9ef3353af7fa None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:06.491359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d260e-7631-46b1-95b8-2103b5447c1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:06.493558 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d260e-7631-46b1-95b8-2103b5447c1a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:06.618250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fe1ce-9db3-4250-a143-9ef3353af7fa None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:06.652529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:06.684561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4b7a3-e99a-4fe0-8430-b96059ddba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:06.686642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4b7a3-e99a-4fe0-8430-b96059ddba6a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:06.689350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 218/425] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:06.693736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4b7a3-e99a-4fe0-8430-b96059ddba6a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:06.694026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4b7a3-e99a-4fe0-8430-b96059ddba6a None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:06.696032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d260e-7631-46b1-95b8-2103b5447c1a None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:06.697990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4b7a3-e99a-4fe0-8430-b96059ddba6a None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:06.699491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4b7a3-e99a-4fe0-8430-b96059ddba6a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:06.701641 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 208/426] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:07:06 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:06.718295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4b7a3-e99a-4fe0-8430-b96059ddba6a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:06.805495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d260e-7631-46b1-95b8-2103b5447c1a None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:06.833159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:06.844593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf1205-a208-443a-9d43-ac80d7837437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:06.845990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf1205-a208-443a-9d43-ac80d7837437 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:06.847350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf1205-a208-443a-9d43-ac80d7837437 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:06.848154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf1205-a208-443a-9d43-ac80d7837437 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:06.851204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf1205-a208-443a-9d43-ac80d7837437 None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:06.854201 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf1205-a208-443a-9d43-ac80d7837437 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:06.859719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 219/427] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:07:06 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:06.866401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf1205-a208-443a-9d43-ac80d7837437 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:06.953143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:06.960384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4b7a3-e99a-4fe0-8430-b96059ddba6a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:07.010161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf1205-a208-443a-9d43-ac80d7837437 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:07.031325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832843c-ce15-4d55-8758-bc5be57c0310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:07.032219 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832843c-ce15-4d55-8758-bc5be57c0310 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.032503 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832843c-ce15-4d55-8758-bc5be57c0310 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.032774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832843c-ce15-4d55-8758-bc5be57c0310 None admin] PATH_INFO: `/v3/groups/59e3a85f3d8046408ea5818a4ed79100` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.038016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832843c-ce15-4d55-8758-bc5be57c0310 None admin] RBAC: Authorizing `identity:get_group(group_id=59e3a85f3d8046408ea5818a4ed79100)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:07.039514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832843c-ce15-4d55-8758-bc5be57c0310 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:07.041742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 209/428] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:07:06 2022] GET /identity/v3/groups/59e3a85f3d8046408ea5818a4ed79100 => generated 226 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:07.049680 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832843c-ce15-4d55-8758-bc5be57c0310 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:07.057700 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6e467-e63c-4888-841a-0c1a70c8b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:07.058586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6e467-e63c-4888-841a-0c1a70c8b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.058871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6e467-e63c-4888-841a-0c1a70c8b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.059148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6e467-e63c-4888-841a-0c1a70c8b6f8 None admin] PATH_INFO: `/v3/groups/59e3a85f3d8046408ea5818a4ed79100` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.060928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6e467-e63c-4888-841a-0c1a70c8b6f8 None admin] RBAC: Authorizing `identity:get_group(group_id=59e3a85f3d8046408ea5818a4ed79100)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:07.062466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6e467-e63c-4888-841a-0c1a70c8b6f8 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:07.069245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 220/429] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:07:06 2022] GET /identity/v3/groups/59e3a85f3d8046408ea5818a4ed79100 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:07.069245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb1ba8-2c9e-4d19-9ca8-d41b39b16633 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.069245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb1ba8-2c9e-4d19-9ca8-d41b39b16633 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.069245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb1ba8-2c9e-4d19-9ca8-d41b39b16633 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.072708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 221/430] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:07.074047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb1ba8-2c9e-4d19-9ca8-d41b39b16633 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:07.179765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832843c-ce15-4d55-8758-bc5be57c0310 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:07.191814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:07.201077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb1ba8-2c9e-4d19-9ca8-d41b39b16633 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:07.219835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:07.221650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cc61a-f341-40fe-9d01-a6c1c73f3f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:07.222704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cc61a-f341-40fe-9d01-a6c1c73f3f87 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.223371 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cc61a-f341-40fe-9d01-a6c1c73f3f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.223941 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cc61a-f341-40fe-9d01-a6c1c73f3f87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.225315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cc61a-f341-40fe-9d01-a6c1c73f3f87 None admin] RBAC: Adding query filter params (group.id=59e3a85f3d8046408ea5818a4ed79100, role.id=118677ef2dfa4e808ddc78b083c01059, scope.project.id=609cac1f44f0468f95e1a23aa0389ca2) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:07.226016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cc61a-f341-40fe-9d01-a6c1c73f3f87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:07.227903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cc61a-f341-40fe-9d01-a6c1c73f3f87 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:07.235507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 210/431] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Jul 7 07:07:07 2022] GET /identity/v3/role_assignments?group.id=59e3a85f3d8046408ea5818a4ed79100&scope.project.id=609cac1f44f0468f95e1a23aa0389ca2&role.id=118677ef2dfa4e808ddc78b083c01059 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:07.237052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08431f25-5681-4836-a1da-13da11be57c2 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.237684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08431f25-5681-4836-a1da-13da11be57c2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.238158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08431f25-5681-4836-a1da-13da11be57c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.257597 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d952c69-0e0c-41c6-824b-3b0ecbbad248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:07.258232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-08431f25-5681-4836-a1da-13da11be57c2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:07.258379 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d952c69-0e0c-41c6-824b-3b0ecbbad248 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.258573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d952c69-0e0c-41c6-824b-3b0ecbbad248 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.258836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d952c69-0e0c-41c6-824b-3b0ecbbad248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.259960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d952c69-0e0c-41c6-824b-3b0ecbbad248 None admin] RBAC: Adding query filter params (group.id=59e3a85f3d8046408ea5818a4ed79100, role.id=118677ef2dfa4e808ddc78b083c01059, scope.project.id=02a8a5b7d75b4de4b84070e456454f06) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:07.260280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d952c69-0e0c-41c6-824b-3b0ecbbad248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:07.260799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-08431f25-5681-4836-a1da-13da11be57c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:07.261831 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d952c69-0e0c-41c6-824b-3b0ecbbad248 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:07.268611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 222/432] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Jul 7 07:07:07 2022] GET /identity/v3/role_assignments?group.id=59e3a85f3d8046408ea5818a4ed79100&scope.project.id=02a8a5b7d75b4de4b84070e456454f06&role.id=118677ef2dfa4e808ddc78b083c01059 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:07.307020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c275762-4aba-4147-b8f0-196e7868188b None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.307305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c275762-4aba-4147-b8f0-196e7868188b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.307593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c275762-4aba-4147-b8f0-196e7868188b None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.309316 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 223/433] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:07:07.315753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3d080-09bc-4d36-8784-529e34088173 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.316295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3d080-09bc-4d36-8784-529e34088173 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.316723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3d080-09bc-4d36-8784-529e34088173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.338483 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a4b3d080-09bc-4d36-8784-529e34088173 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:07.340208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a4b3d080-09bc-4d36-8784-529e34088173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:07.365293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 211/434] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:07.408466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cb352-7c00-444b-b882-8e376c0395a8 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.408939 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cb352-7c00-444b-b882-8e376c0395a8 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.409477 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cb352-7c00-444b-b882-8e376c0395a8 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.413377 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 212/435] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:07.414878 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cb352-7c00-444b-b882-8e376c0395a8 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:07.456968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 224/436] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:07:07.456968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78e9bd-8f82-4c40-8222-0d9668791c67 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.456968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78e9bd-8f82-4c40-8222-0d9668791c67 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.456968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78e9bd-8f82-4c40-8222-0d9668791c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.490354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-9d78e9bd-8f82-4c40-8222-0d9668791c67 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:07.491493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9d78e9bd-8f82-4c40-8222-0d9668791c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:07.575417 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cb352-7c00-444b-b882-8e376c0395a8 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:07.576039 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 225/437] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:07.576987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78e9bd-8f82-4c40-8222-0d9668791c67 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:07.578727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:07.616419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ec53e-3b74-4377-b7b8-3b89bbcc37f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:07.617259 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ec53e-3b74-4377-b7b8-3b89bbcc37f5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.617539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ec53e-3b74-4377-b7b8-3b89bbcc37f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.617806 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ec53e-3b74-4377-b7b8-3b89bbcc37f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.623080 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:07.629249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ec53e-3b74-4377-b7b8-3b89bbcc37f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-0b5ec53e-3b74-4377-b7b8-3b89bbcc37f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:07.638200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:07.639139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:07.639964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 213/438] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:07:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:07.640607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ec53e-3b74-4377-b7b8-3b89bbcc37f5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:07.693867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78e9bd-8f82-4c40-8222-0d9668791c67 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:07.733295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545a1f0-5c2d-4801-9929-f32acaf93aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:07.734333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545a1f0-5c2d-4801-9929-f32acaf93aef None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.734691 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545a1f0-5c2d-4801-9929-f32acaf93aef None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.734976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545a1f0-5c2d-4801-9929-f32acaf93aef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.746514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545a1f0-5c2d-4801-9929-f32acaf93aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:07.751195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ec53e-3b74-4377-b7b8-3b89bbcc37f5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-a545a1f0-5c2d-4801-9929-f32acaf93aef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:07.754621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:07.755498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:07.756263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 226/439] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:07:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:07.756946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545a1f0-5c2d-4801-9929-f32acaf93aef None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:07.788026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c831d2-df4e-4200-a8a9-a08d2373d4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:07.788933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c831d2-df4e-4200-a8a9-a08d2373d4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.789252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c831d2-df4e-4200-a8a9-a08d2373d4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.789529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c831d2-df4e-4200-a8a9-a08d2373d4e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.800316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c831d2-df4e-4200-a8a9-a08d2373d4e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-c8c831d2-df4e-4200-a8a9-a08d2373d4e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:07.808141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:07.809086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:07.809945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 214/440] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:07.810594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c831d2-df4e-4200-a8a9-a08d2373d4e4 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:07.836878 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:07.863881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:07.868817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545a1f0-5c2d-4801-9929-f32acaf93aef None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:07.905536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7054c5e-dea1-4e47-9fbf-51b5051b507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:07.906205 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7054c5e-dea1-4e47-9fbf-51b5051b507a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.906494 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7054c5e-dea1-4e47-9fbf-51b5051b507a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.906769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7054c5e-dea1-4e47-9fbf-51b5051b507a None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.907526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7054c5e-dea1-4e47-9fbf-51b5051b507a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:07.907826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7054c5e-dea1-4e47-9fbf-51b5051b507a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:07.909306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7054c5e-dea1-4e47-9fbf-51b5051b507a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:07.917584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 227/441] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:07.918409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7054c5e-dea1-4e47-9fbf-51b5051b507a None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:07.918512 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c831d2-df4e-4200-a8a9-a08d2373d4e4 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:07.953898 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed95c0-6f6d-43b5-865c-eb07c0d497ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:07.954577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed95c0-6f6d-43b5-865c-eb07c0d497ed None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:07.954862 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed95c0-6f6d-43b5-865c-eb07c0d497ed None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:07.955140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed95c0-6f6d-43b5-865c-eb07c0d497ed None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:07.955950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed95c0-6f6d-43b5-865c-eb07c0d497ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:07.956194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed95c0-6f6d-43b5-865c-eb07c0d497ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:07.957628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed95c0-6f6d-43b5-865c-eb07c0d497ed None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:07.965931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 215/442] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:07.966761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed95c0-6f6d-43b5-865c-eb07c0d497ed None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:08.027131 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7054c5e-dea1-4e47-9fbf-51b5051b507a None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:08.054998 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:08.063369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc8b05-dc38-4aa4-93a6-8b425a43e06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:08.064135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc8b05-dc38-4aa4-93a6-8b425a43e06a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:08.064422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc8b05-dc38-4aa4-93a6-8b425a43e06a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:08.064700 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc8b05-dc38-4aa4-93a6-8b425a43e06a None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:08.065491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc8b05-dc38-4aa4-93a6-8b425a43e06a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:08.065802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc8b05-dc38-4aa4-93a6-8b425a43e06a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:08.067207 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc8b05-dc38-4aa4-93a6-8b425a43e06a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:08.073459 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed95c0-6f6d-43b5-865c-eb07c0d497ed None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:08.076492 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 228/443] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:08.077323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc8b05-dc38-4aa4-93a6-8b425a43e06a None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:08.103289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:08.112158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a1ba-5e6b-4f34-8ddd-b40f31748fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:08.112832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a1ba-5e6b-4f34-8ddd-b40f31748fff None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:08.113113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a1ba-5e6b-4f34-8ddd-b40f31748fff None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:08.113416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a1ba-5e6b-4f34-8ddd-b40f31748fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:08.180553 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc8b05-dc38-4aa4-93a6-8b425a43e06a None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:08.184250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95a1ba-5e6b-4f34-8ddd-b40f31748fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:08.185780 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95a1ba-5e6b-4f34-8ddd-b40f31748fff None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:08.217640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb445fe2-6138-457f-91fb-9e41d8be1ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:08.218297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb445fe2-6138-457f-91fb-9e41d8be1ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:08.218582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb445fe2-6138-457f-91fb-9e41d8be1ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:08.218883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb445fe2-6138-457f-91fb-9e41d8be1ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:08.274999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:08.293099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb445fe2-6138-457f-91fb-9e41d8be1ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:08.293583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 216/444] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:08.294473 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a1ba-5e6b-4f34-8ddd-b40f31748fff None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:08.294651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb445fe2-6138-457f-91fb-9e41d8be1ef6 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:08.323354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:08.406537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 229/445] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:08.407248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb445fe2-6138-457f-91fb-9e41d8be1ef6 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:08.421032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a1ba-5e6b-4f34-8ddd-b40f31748fff None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:08.456916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eeb18b-56eb-40f9-9239-8fc43b431c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:08.457607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eeb18b-56eb-40f9-9239-8fc43b431c06 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:08.457879 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eeb18b-56eb-40f9-9239-8fc43b431c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:08.458137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eeb18b-56eb-40f9-9239-8fc43b431c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:08.509674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb445fe2-6138-457f-91fb-9e41d8be1ef6 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:08.513758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:08.527844 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eeb18b-56eb-40f9-9239-8fc43b431c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:08.529367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eeb18b-56eb-40f9-9239-8fc43b431c06 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:08.534932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:08.546167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d1b21-0ae1-4996-8bc9-c8f56aad6d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:08.546967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d1b21-0ae1-4996-8bc9-c8f56aad6d64 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:08.547249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d1b21-0ae1-4996-8bc9-c8f56aad6d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:08.547536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d1b21-0ae1-4996-8bc9-c8f56aad6d64 None admin] PATH_INFO: `/v3/projects/02a8a5b7d75b4de4b84070e456454f06` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:08.548720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d1b21-0ae1-4996-8bc9-c8f56aad6d64 None admin] RBAC: Authorizing `identity:get_project(project_id=02a8a5b7d75b4de4b84070e456454f06)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:08.550303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d1b21-0ae1-4996-8bc9-c8f56aad6d64 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:08.552063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 230/446] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:07:08 2022] GET /identity/v3/projects/02a8a5b7d75b4de4b84070e456454f06 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:08.552831 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d1b21-0ae1-4996-8bc9-c8f56aad6d64 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:08.630775 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 217/447] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:08.631944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eeb18b-56eb-40f9-9239-8fc43b431c06 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:08.656198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d1b21-0ae1-4996-8bc9-c8f56aad6d64 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:08.690598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164b201-e1b2-4028-a80e-a543a3f1195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:08.691473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164b201-e1b2-4028-a80e-a543a3f1195c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:08.691756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164b201-e1b2-4028-a80e-a543a3f1195c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:08.692023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164b201-e1b2-4028-a80e-a543a3f1195c None admin] PATH_INFO: `/v3/projects/609cac1f44f0468f95e1a23aa0389ca2` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:08.693573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164b201-e1b2-4028-a80e-a543a3f1195c None admin] RBAC: Authorizing `identity:get_project(project_id=609cac1f44f0468f95e1a23aa0389ca2)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:08.695085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164b201-e1b2-4028-a80e-a543a3f1195c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:08.696784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 231/448] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:07:08 2022] GET /identity/v3/projects/609cac1f44f0468f95e1a23aa0389ca2 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:08.697574 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164b201-e1b2-4028-a80e-a543a3f1195c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:08.722976 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:08.738559 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eeb18b-56eb-40f9-9239-8fc43b431c06 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:08.762014 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:08.775290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abeaeb-d925-4be1-8889-33993a7493c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:08.776180 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abeaeb-d925-4be1-8889-33993a7493c1 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:08.776519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abeaeb-d925-4be1-8889-33993a7493c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:08.776739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abeaeb-d925-4be1-8889-33993a7493c1 None admin] PATH_INFO: `/v3/groups/59e3a85f3d8046408ea5818a4ed79100` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:08.778008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abeaeb-d925-4be1-8889-33993a7493c1 None admin] RBAC: Authorizing `identity:get_group(group_id=59e3a85f3d8046408ea5818a4ed79100)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:08.779487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abeaeb-d925-4be1-8889-33993a7493c1 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:08.781201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 218/449] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:07:08 2022] GET /identity/v3/groups/59e3a85f3d8046408ea5818a4ed79100 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:08.782030 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abeaeb-d925-4be1-8889-33993a7493c1 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:08.807443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164b201-e1b2-4028-a80e-a543a3f1195c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:08.846453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ac92-51d5-4767-b85c-8f2700f87eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:08.847432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ac92-51d5-4767-b85c-8f2700f87eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:08.847655 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ac92-51d5-4767-b85c-8f2700f87eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:08.847878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ac92-51d5-4767-b85c-8f2700f87eb0 None admin] PATH_INFO: `/v3/projects/b5d565ccc8d74ff1978b89c064272f84` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:08.849108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6ac92-51d5-4767-b85c-8f2700f87eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d565ccc8d74ff1978b89c064272f84)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:08.850679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6ac92-51d5-4767-b85c-8f2700f87eb0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:08.852671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 232/450] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:07:08 2022] GET /identity/v3/projects/b5d565ccc8d74ff1978b89c064272f84 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:08.853460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ac92-51d5-4767-b85c-8f2700f87eb0 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:08.902832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abeaeb-d925-4be1-8889-33993a7493c1 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:08.941695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e3f9e-b248-4ffd-92e9-77f03c76b52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:08.942624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e3f9e-b248-4ffd-92e9-77f03c76b52e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:08.943286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e3f9e-b248-4ffd-92e9-77f03c76b52e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:08.943563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e3f9e-b248-4ffd-92e9-77f03c76b52e None admin] PATH_INFO: `/v3/groups/59e3a85f3d8046408ea5818a4ed79100` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:08.944873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e3f9e-b248-4ffd-92e9-77f03c76b52e None admin] RBAC: Authorizing `identity:get_group(group_id=59e3a85f3d8046408ea5818a4ed79100)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:08.946433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e3f9e-b248-4ffd-92e9-77f03c76b52e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:08.948223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 219/451] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:07:08 2022] GET /identity/v3/groups/59e3a85f3d8046408ea5818a4ed79100 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:08.949012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e3f9e-b248-4ffd-92e9-77f03c76b52e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:08.967623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ac92-51d5-4767-b85c-8f2700f87eb0 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:08.977255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:08.994425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:09.003624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a6165-7beb-4f27-bb8d-e34320b59168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:09.004296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a6165-7beb-4f27-bb8d-e34320b59168 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:09.004561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a6165-7beb-4f27-bb8d-e34320b59168 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:09.004851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a6165-7beb-4f27-bb8d-e34320b59168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:09.005717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a6165-7beb-4f27-bb8d-e34320b59168 None admin] RBAC: Adding query filter params (group.id=59e3a85f3d8046408ea5818a4ed79100, role.id=5c9f98a938a74f35857ce032dd9e06b1, scope.project.id=02a8a5b7d75b4de4b84070e456454f06) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:09.006027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a6165-7beb-4f27-bb8d-e34320b59168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:09.007459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a6165-7beb-4f27-bb8d-e34320b59168 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:09.013559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 233/452] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Jul 7 07:07:08 2022] GET /identity/v3/role_assignments?group.id=59e3a85f3d8046408ea5818a4ed79100&scope.project.id=02a8a5b7d75b4de4b84070e456454f06&role.id=5c9f98a938a74f35857ce032dd9e06b1 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:09.014383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a6165-7beb-4f27-bb8d-e34320b59168 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:09.063943 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e3f9e-b248-4ffd-92e9-77f03c76b52e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:09.112271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc2a34-73f8-4f49-9651-0949d4e2b7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:09.113949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc2a34-73f8-4f49-9651-0949d4e2b7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:09.114271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc2a34-73f8-4f49-9651-0949d4e2b7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:09.114550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc2a34-73f8-4f49-9651-0949d4e2b7e1 None admin] PATH_INFO: `/v3/groups/b3995036eb7349398178587be2f3a68e` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:09.115980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc2a34-73f8-4f49-9651-0949d4e2b7e1 None admin] RBAC: Authorizing `identity:get_group(group_id=b3995036eb7349398178587be2f3a68e)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:09.117553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc2a34-73f8-4f49-9651-0949d4e2b7e1 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:09.119467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 220/453] 10.222.0.62 () {56 vars in 1180 bytes} [Thu Jul 7 07:07:08 2022] GET /identity/v3/groups/b3995036eb7349398178587be2f3a68e => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:09.126318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc2a34-73f8-4f49-9651-0949d4e2b7e1 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:09.157246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a6165-7beb-4f27-bb8d-e34320b59168 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:09.204629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c1cd-0a46-4558-9db2-353fdf295968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:09.205526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c1cd-0a46-4558-9db2-353fdf295968 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:09.205634 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c1cd-0a46-4558-9db2-353fdf295968 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:09.206425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c1cd-0a46-4558-9db2-353fdf295968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:09.206823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c1cd-0a46-4558-9db2-353fdf295968 None admin] RBAC: Adding query filter params (group.id=59e3a85f3d8046408ea5818a4ed79100, role.id=5c9f98a938a74f35857ce032dd9e06b1, scope.project.id=609cac1f44f0468f95e1a23aa0389ca2) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:09.207068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c1cd-0a46-4558-9db2-353fdf295968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:09.208512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c1cd-0a46-4558-9db2-353fdf295968 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:09.215650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 234/454] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Jul 7 07:07:09 2022] GET /identity/v3/role_assignments?group.id=59e3a85f3d8046408ea5818a4ed79100&scope.project.id=609cac1f44f0468f95e1a23aa0389ca2&role.id=5c9f98a938a74f35857ce032dd9e06b1 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:09.242359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:09.255696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc2a34-73f8-4f49-9651-0949d4e2b7e1 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:09.301450 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b70d7-0c4c-417f-8743-35856f06dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:09.302218 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b70d7-0c4c-417f-8743-35856f06dc55 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:09.302609 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b70d7-0c4c-417f-8743-35856f06dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:09.302778 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b70d7-0c4c-417f-8743-35856f06dc55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:09.304062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b70d7-0c4c-417f-8743-35856f06dc55 None admin] RBAC: Adding query filter params (group.id=b3995036eb7349398178587be2f3a68e, role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=b5d565ccc8d74ff1978b89c064272f84) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:09.304403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b70d7-0c4c-417f-8743-35856f06dc55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:09.306204 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b70d7-0c4c-417f-8743-35856f06dc55 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:09.314797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 221/455] 10.222.0.62 () {56 vars in 1376 bytes} [Thu Jul 7 07:07:09 2022] GET /identity/v3/role_assignments?group.id=b3995036eb7349398178587be2f3a68e&scope.project.id=b5d565ccc8d74ff1978b89c064272f84&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:11.897055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fa695-e334-44ac-b2c4-5aa93cd98a21 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:11.897625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fa695-e334-44ac-b2c4-5aa93cd98a21 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:11.897625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fa695-e334-44ac-b2c4-5aa93cd98a21 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:11.899383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 235/456] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:11.904537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf7271-33da-4379-b6bb-98408cbc6ef3 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:11.905413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf7271-33da-4379-b6bb-98408cbc6ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:11.905906 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf7271-33da-4379-b6bb-98408cbc6ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:11.930273 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e8cf7271-33da-4379-b6bb-98408cbc6ef3 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:11.931904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e8cf7271-33da-4379-b6bb-98408cbc6ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:12.027975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 222/457] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:12.063803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fa695-e334-44ac-b2c4-5aa93cd98a21 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:12.075114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad06801-232f-46b1-8278-1e042dd66f8d None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:12.075401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad06801-232f-46b1-8278-1e042dd66f8d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:12.075668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad06801-232f-46b1-8278-1e042dd66f8d None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:12.077361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 223/458] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:07:12.082524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36a54e-c5bc-4392-a608-392f7e128997 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:12.082808 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36a54e-c5bc-4392-a608-392f7e128997 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:12.083088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36a54e-c5bc-4392-a608-392f7e128997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:12.101751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0d36a54e-c5bc-4392-a608-392f7e128997 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:12.103056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0d36a54e-c5bc-4392-a608-392f7e128997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:12.172300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:12.218481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 224/459] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:07:12.252324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fa695-e334-44ac-b2c4-5aa93cd98a21 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:12.283917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36a54e-c5bc-4392-a608-392f7e128997 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:12.296419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485fa0a-db9a-4969-a677-1aafdebea41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:12.297254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485fa0a-db9a-4969-a677-1aafdebea41f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:12.297549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485fa0a-db9a-4969-a677-1aafdebea41f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:12.297827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485fa0a-db9a-4969-a677-1aafdebea41f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:12.299965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:12.311055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485fa0a-db9a-4969-a677-1aafdebea41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:12.312650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485fa0a-db9a-4969-a677-1aafdebea41f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-f485fa0a-db9a-4969-a677-1aafdebea41f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:12.332748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:12.334607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:12.334607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:12.334607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:12.334607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:12.334607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 236/460] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:12.336023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c02a7-9106-46eb-8546-ae376fbebebf None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:12.336343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c02a7-9106-46eb-8546-ae376fbebebf None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:12.336468 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c02a7-9106-46eb-8546-ae376fbebebf None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:12.343117 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 237/461] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:12.344079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c02a7-9106-46eb-8546-ae376fbebebf None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:12.396793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36a54e-c5bc-4392-a608-392f7e128997 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:12.434341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de2da0-a7e5-4280-80f5-7b948a5dc803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:12.435185 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de2da0-a7e5-4280-80f5-7b948a5dc803 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:12.435530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de2da0-a7e5-4280-80f5-7b948a5dc803 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:12.435950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de2da0-a7e5-4280-80f5-7b948a5dc803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:12.448550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de2da0-a7e5-4280-80f5-7b948a5dc803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:12.451660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de2da0-a7e5-4280-80f5-7b948a5dc803 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:12.458659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c02a7-9106-46eb-8546-ae376fbebebf None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:12.468997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-69de2da0-a7e5-4280-80f5-7b948a5dc803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:12.477231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:12.478354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:12.479889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:12.479889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:12.479889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:12.479889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:12.484859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 225/462] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:12.486456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaf002-527b-4911-b8ba-5fdba3178872 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:12.486743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaf002-527b-4911-b8ba-5fdba3178872 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:12.487015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaf002-527b-4911-b8ba-5fdba3178872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:12.502458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fdc40-3085-414c-816b-8beb4d5bee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:12.503202 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fdc40-3085-414c-816b-8beb4d5bee22 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:12.503480 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fdc40-3085-414c-816b-8beb4d5bee22 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:12.503762 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fdc40-3085-414c-816b-8beb4d5bee22 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:12.504566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fdc40-3085-414c-816b-8beb4d5bee22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:12.504870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fdc40-3085-414c-816b-8beb4d5bee22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:12.506571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fdc40-3085-414c-816b-8beb4d5bee22 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:12.507586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-84eaf002-527b-4911-b8ba-5fdba3178872 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:12.508906 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-84eaf002-527b-4911-b8ba-5fdba3178872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:12.529162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 238/463] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:12.530836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fdc40-3085-414c-816b-8beb4d5bee22 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:12.581277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:12.591149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 226/464] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:12.592094 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaf002-527b-4911-b8ba-5fdba3178872 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:12.645497 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fdc40-3085-414c-816b-8beb4d5bee22 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:12.683370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bd99f-d0e6-41f4-8b47-57dee6ff0d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:12.684047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bd99f-d0e6-41f4-8b47-57dee6ff0d99 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:12.684329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bd99f-d0e6-41f4-8b47-57dee6ff0d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:12.684695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bd99f-d0e6-41f4-8b47-57dee6ff0d99 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:12.685470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bd99f-d0e6-41f4-8b47-57dee6ff0d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:12.685872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bd99f-d0e6-41f4-8b47-57dee6ff0d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:12.687269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bd99f-d0e6-41f4-8b47-57dee6ff0d99 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:12.700516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 239/465] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:12.701391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bd99f-d0e6-41f4-8b47-57dee6ff0d99 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:12.705615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaf002-527b-4911-b8ba-5fdba3178872 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:12.731901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:12.744474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c0e56-9b66-4792-9550-85537e23afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:12.745292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c0e56-9b66-4792-9550-85537e23afa5 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:12.745578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c0e56-9b66-4792-9550-85537e23afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:12.745854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c0e56-9b66-4792-9550-85537e23afa5 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:12.746560 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c0e56-9b66-4792-9550-85537e23afa5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:12.748118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c0e56-9b66-4792-9550-85537e23afa5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:12.777051 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 227/466] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:07:12 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:07:12.778113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c0e56-9b66-4792-9550-85537e23afa5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:12.854615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bd99f-d0e6-41f4-8b47-57dee6ff0d99 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:12.857823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:12.896347 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79870c32-930b-4d07-a4c5-cdfa2ba23084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:12.897583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79870c32-930b-4d07-a4c5-cdfa2ba23084 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:12.898620 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79870c32-930b-4d07-a4c5-cdfa2ba23084 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:12.899119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79870c32-930b-4d07-a4c5-cdfa2ba23084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:12.914223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79870c32-930b-4d07-a4c5-cdfa2ba23084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:12.915159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c0e56-9b66-4792-9550-85537e23afa5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:12.917337 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79870c32-930b-4d07-a4c5-cdfa2ba23084 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-79870c32-930b-4d07-a4c5-cdfa2ba23084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:12.939990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:12.940852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:12.941712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:12.941712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:12.941712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:12.941712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:12.944450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 240/467] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:12.946211 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6225b0c-c9a2-480e-8bdb-df5ccbc5d372 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:12.946853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6225b0c-c9a2-480e-8bdb-df5ccbc5d372 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:12.947329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6225b0c-c9a2-480e-8bdb-df5ccbc5d372 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:12.949361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 241/468] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:12.950457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6225b0c-c9a2-480e-8bdb-df5ccbc5d372 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:12.965106 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a6372-6f20-4a5c-b087-13c5df94d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:12.966261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a6372-6f20-4a5c-b087-13c5df94d7ed None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:12.966543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a6372-6f20-4a5c-b087-13c5df94d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:12.966814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a6372-6f20-4a5c-b087-13c5df94d7ed None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:12.967808 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a6372-6f20-4a5c-b087-13c5df94d7ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:12.969683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a6372-6f20-4a5c-b087-13c5df94d7ed None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:12.995830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 228/469] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:07:12 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:07:12.997125 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7d2ea-a880-460a-ac26-800e0dbc4210 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:13.002092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7d2ea-a880-460a-ac26-800e0dbc4210 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:13.002092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7d2ea-a880-460a-ac26-800e0dbc4210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:13.020888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-81f7d2ea-a880-460a-ac26-800e0dbc4210 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:13.022584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-81f7d2ea-a880-460a-ac26-800e0dbc4210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:13.054811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:13.081833 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6225b0c-c9a2-480e-8bdb-df5ccbc5d372 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:13.103733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 229/470] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:13.130433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7d2ea-a880-460a-ac26-800e0dbc4210 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:13.137302 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be64d-aa24-4869-96db-1a3c5e8195e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:13.138432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be64d-aa24-4869-96db-1a3c5e8195e0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:13.139678 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be64d-aa24-4869-96db-1a3c5e8195e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:13.140184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be64d-aa24-4869-96db-1a3c5e8195e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:13.141141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185be64d-aa24-4869-96db-1a3c5e8195e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:13.142209 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185be64d-aa24-4869-96db-1a3c5e8195e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:13.144464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185be64d-aa24-4869-96db-1a3c5e8195e0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:13.163840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 242/471] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:13.169278 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be64d-aa24-4869-96db-1a3c5e8195e0 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:13.193202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:13.279893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7d2ea-a880-460a-ac26-800e0dbc4210 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:13.294471 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be64d-aa24-4869-96db-1a3c5e8195e0 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:13.326952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4cb04-ccbc-4f9b-bdea-907fdeb934e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:13.328283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4cb04-ccbc-4f9b-bdea-907fdeb934e8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:13.328840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4cb04-ccbc-4f9b-bdea-907fdeb934e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:13.329132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4cb04-ccbc-4f9b-bdea-907fdeb934e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:13.340917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae632dd3-bf63-406c-9148-71d93cbf00c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:13.341632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae632dd3-bf63-406c-9148-71d93cbf00c7 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:13.341909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae632dd3-bf63-406c-9148-71d93cbf00c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:13.342182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae632dd3-bf63-406c-9148-71d93cbf00c7 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:13.342302 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4cb04-ccbc-4f9b-bdea-907fdeb934e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:13.342890 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae632dd3-bf63-406c-9148-71d93cbf00c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:13.343700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4cb04-ccbc-4f9b-bdea-907fdeb934e8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:13.344343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae632dd3-bf63-406c-9148-71d93cbf00c7 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:13.356249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-e6c4cb04-ccbc-4f9b-bdea-907fdeb934e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:13.366352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:13.367247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:13.368130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:13.368130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:13.368130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:13.368130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:13.368130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 230/472] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:13.374229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4cb04-ccbc-4f9b-bdea-907fdeb934e8 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:13.375255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 243/473] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:07:13 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:07:13.494179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:13.505446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4cb04-ccbc-4f9b-bdea-907fdeb934e8 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:13.545075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd926d93-9d0a-44fd-aea6-d28463ffea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:13.545799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd926d93-9d0a-44fd-aea6-d28463ffea7c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:13.546079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd926d93-9d0a-44fd-aea6-d28463ffea7c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:13.546421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd926d93-9d0a-44fd-aea6-d28463ffea7c None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:13.547171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd926d93-9d0a-44fd-aea6-d28463ffea7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:13.547648 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd926d93-9d0a-44fd-aea6-d28463ffea7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:13.549781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd926d93-9d0a-44fd-aea6-d28463ffea7c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:13.563582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 231/474] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:13.569253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae632dd3-bf63-406c-9148-71d93cbf00c7 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:13.686037 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422bcb8-47df-481f-93cb-0a974cab4ebe None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:13.686363 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422bcb8-47df-481f-93cb-0a974cab4ebe None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:13.686651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422bcb8-47df-481f-93cb-0a974cab4ebe None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:13.688341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 232/475] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:07:13.690807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae632dd3-bf63-406c-9148-71d93cbf00c7 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:13.693861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7579020-e495-464b-bb34-1f3348d5dbf8 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:13.694146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7579020-e495-464b-bb34-1f3348d5dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:13.694424 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7579020-e495-464b-bb34-1f3348d5dbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:13.714623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e7579020-e495-464b-bb34-1f3348d5dbf8 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:13.716277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e7579020-e495-464b-bb34-1f3348d5dbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:13.728479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4c3f0-fd86-49d0-9407-0882b8b6e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:13.729235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4c3f0-fd86-49d0-9407-0882b8b6e861 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:13.729621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4c3f0-fd86-49d0-9407-0882b8b6e861 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:13.729914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4c3f0-fd86-49d0-9407-0882b8b6e861 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:13.730693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4c3f0-fd86-49d0-9407-0882b8b6e861 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:13.732157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4c3f0-fd86-49d0-9407-0882b8b6e861 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:13.756007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 244/476] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:07:13 2022] POST /identity/v3/users => generated 249 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:07:13.807018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 233/477] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:07:13.835633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4c3f0-fd86-49d0-9407-0882b8b6e861 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:13.898595 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:13.952234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4c3f0-fd86-49d0-9407-0882b8b6e861 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:13.987095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ac581-e494-4e81-b8cc-3212cb2eff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:13.988133 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ac581-e494-4e81-b8cc-3212cb2eff54 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:13.988613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ac581-e494-4e81-b8cc-3212cb2eff54 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:13.989199 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ac581-e494-4e81-b8cc-3212cb2eff54 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:13.990174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ac581-e494-4e81-b8cc-3212cb2eff54 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:13.991766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ac581-e494-4e81-b8cc-3212cb2eff54 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:13.998974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.sql.core [None req-e62ac581-e494-4e81-b8cc-3212cb2eff54 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 07 07:07:13.998974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 07 07:07:13.998974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [parameters: {'id': 'a7e36fe596964030b14890f4b635e0ba', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 07 07:07:13.998974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80277) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-e62ac581-e494-4e81-b8cc-3212cb2eff54 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result = self._query(query) Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application conn.query(q) Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result.read() Jul 07 07:07:14.016651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return ref.to_dict() Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 07 07:07:14.017566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application next(self.gen) Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application yield resource Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application next(self.gen) Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.session.rollback() Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.force_reraise() Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise self.value Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application session.commit() Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 07 07:07:14.018479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._prepare_impl() Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.session.flush() Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._flush(objects) Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application compat.raise_( Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application flush_context.execute() Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rec.execute(self) Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 07 07:07:14.019306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 07 07:07:14.020892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result = self._query(query) Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application conn.query(q) Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result.read() Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 07 07:07:14.021746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [parameters: {'id': 'a7e36fe596964030b14890f4b635e0ba', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:14.022525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 07 07:07:14.023309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:14.026848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 245/478] 10.222.0.62 () {60 vars in 1131 bytes} [Thu Jul 7 07:07:13 2022] POST /identity/v3/roles => generated 144 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:14.032967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7579020-e495-464b-bb34-1f3348d5dbf8 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:14.127100 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:14.148783 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7579020-e495-464b-bb34-1f3348d5dbf8 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:14.185270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f27b9-aaaf-4646-8e5b-89738da2f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:14.186123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f27b9-aaaf-4646-8e5b-89738da2f60f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:14.186406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f27b9-aaaf-4646-8e5b-89738da2f60f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:14.186677 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f27b9-aaaf-4646-8e5b-89738da2f60f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:14.198144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f27b9-aaaf-4646-8e5b-89738da2f60f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-ca4f27b9-aaaf-4646-8e5b-89738da2f60f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:14.206388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:14.207378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:14.208155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 234/479] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:07:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:14.215001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ac581-e494-4e81-b8cc-3212cb2eff54 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:14.334591 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ac581-e494-4e81-b8cc-3212cb2eff54 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:14.351792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:14.370743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a47ed1-6f4d-4a5c-817b-cf36e244c01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:14.371431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a47ed1-6f4d-4a5c-817b-cf36e244c01f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:14.371715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a47ed1-6f4d-4a5c-817b-cf36e244c01f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:14.371995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a47ed1-6f4d-4a5c-817b-cf36e244c01f None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:14.372766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a47ed1-6f4d-4a5c-817b-cf36e244c01f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:14.373075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a47ed1-6f4d-4a5c-817b-cf36e244c01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:14.374511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a47ed1-6f4d-4a5c-817b-cf36e244c01f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:14.383766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 246/480] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:15.313422 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e66a6-1356-453e-b7fb-d78b155f7d01 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:15.313958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e66a6-1356-453e-b7fb-d78b155f7d01 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:15.313958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e66a6-1356-453e-b7fb-d78b155f7d01 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:15.316225 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 235/481] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:15.322129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeee98-7397-483f-9754-47bcb58f9da6 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:15.322618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeee98-7397-483f-9754-47bcb58f9da6 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:15.322690 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeee98-7397-483f-9754-47bcb58f9da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:15.348451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-7daeee98-7397-483f-9754-47bcb58f9da6 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:15.349662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7daeee98-7397-483f-9754-47bcb58f9da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:15.445348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 247/482] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:15.476427 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e66a6-1356-453e-b7fb-d78b155f7d01 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:15.614969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e66a6-1356-453e-b7fb-d78b155f7d01 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:15.653903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e586f12-09e1-4c9b-9c37-98984dfc21ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:15.654732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586f12-09e1-4c9b-9c37-98984dfc21ee None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:15.655013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586f12-09e1-4c9b-9c37-98984dfc21ee None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:15.655284 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586f12-09e1-4c9b-9c37-98984dfc21ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:15.673600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:15.674664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e586f12-09e1-4c9b-9c37-98984dfc21ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-4e586f12-09e1-4c9b-9c37-98984dfc21ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:15.682784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:15.683707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:15.684489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 236/483] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:15.691393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeee98-7397-483f-9754-47bcb58f9da6 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:15.814531 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeee98-7397-483f-9754-47bcb58f9da6 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:15.826192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:15.862747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d7f57-4bb5-41b1-b4b6-06da7f5e7973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:15.863425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7f57-4bb5-41b1-b4b6-06da7f5e7973 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:15.863700 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7f57-4bb5-41b1-b4b6-06da7f5e7973 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:15.863970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7f57-4bb5-41b1-b4b6-06da7f5e7973 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:15.864727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d7f57-4bb5-41b1-b4b6-06da7f5e7973 None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:15.865083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d7f57-4bb5-41b1-b4b6-06da7f5e7973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:15.866500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d7f57-4bb5-41b1-b4b6-06da7f5e7973 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:15.875339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 248/484] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:15.880571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e586f12-09e1-4c9b-9c37-98984dfc21ee None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:16.015914 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e586f12-09e1-4c9b-9c37-98984dfc21ee None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:16.050831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fab4cb-9a92-43c8-8605-261c2298a285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:16.051734 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fab4cb-9a92-43c8-8605-261c2298a285 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.052028 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fab4cb-9a92-43c8-8605-261c2298a285 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.052299 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fab4cb-9a92-43c8-8605-261c2298a285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.053438 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9899e-241d-462d-b31d-f4fa3f57776f None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.053730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9899e-241d-462d-b31d-f4fa3f57776f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.054007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9899e-241d-462d-b31d-f4fa3f57776f None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.055694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 249/485] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:07:16.061117 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685073e6-d25c-42cf-932a-ad02d4f399b1 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.061429 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685073e6-d25c-42cf-932a-ad02d4f399b1 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.061711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685073e6-d25c-42cf-932a-ad02d4f399b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.064005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fab4cb-9a92-43c8-8605-261c2298a285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:16.065524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fab4cb-9a92-43c8-8605-261c2298a285 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-39fab4cb-9a92-43c8-8605-261c2298a285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:16.092927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:16.093920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:16.094736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:16.094736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:16.094736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:16.094736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:16.096296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 237/486] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:16.100497 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-685073e6-d25c-42cf-932a-ad02d4f399b1 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:16.101899 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-685073e6-d25c-42cf-932a-ad02d4f399b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:16.104777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fab4cb-9a92-43c8-8605-261c2298a285 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:16.174084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:16.212398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 250/487] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:16.221728 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bc8e5-7585-4c60-9a71-902e4ebc3ece None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.222399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bc8e5-7585-4c60-9a71-902e4ebc3ece None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.222879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bc8e5-7585-4c60-9a71-902e4ebc3ece None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.224532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 251/488] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:16.226073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fab4cb-9a92-43c8-8605-261c2298a285 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:16.229946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76274222-69dd-4b3b-8c82-b6097563d21f None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.230494 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76274222-69dd-4b3b-8c82-b6097563d21f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.230984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76274222-69dd-4b3b-8c82-b6097563d21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.261080 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-76274222-69dd-4b3b-8c82-b6097563d21f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:16.262667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-76274222-69dd-4b3b-8c82-b6097563d21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:16.263688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ddf4e-573e-421c-a1e7-1245882160f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:16.264381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ddf4e-573e-421c-a1e7-1245882160f2 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.264662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ddf4e-573e-421c-a1e7-1245882160f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.264937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ddf4e-573e-421c-a1e7-1245882160f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.265697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ddf4e-573e-421c-a1e7-1245882160f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:16.266005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ddf4e-573e-421c-a1e7-1245882160f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:16.267448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ddf4e-573e-421c-a1e7-1245882160f2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:16.280620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 238/489] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:16.281621 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ddf4e-573e-421c-a1e7-1245882160f2 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:16.337410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 252/490] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:16.339033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76274222-69dd-4b3b-8c82-b6097563d21f None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:16.379009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:16.385377 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ddf4e-573e-421c-a1e7-1245882160f2 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:16.400326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:16.430406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada3f90-a22b-44c9-a79b-aca2e79a29ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:16.431186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada3f90-a22b-44c9-a79b-aca2e79a29ef None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.431470 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada3f90-a22b-44c9-a79b-aca2e79a29ef None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.431744 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada3f90-a22b-44c9-a79b-aca2e79a29ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.443376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada3f90-a22b-44c9-a79b-aca2e79a29ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-3ada3f90-a22b-44c9-a79b-aca2e79a29ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:16.451536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:16.452409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:16.453188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 239/491] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:16.454484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada3f90-a22b-44c9-a79b-aca2e79a29ef None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:16.484238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76274222-69dd-4b3b-8c82-b6097563d21f None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:16.528089 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d49d2a-1266-4144-88fa-7dc31e7b784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:16.528888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d49d2a-1266-4144-88fa-7dc31e7b784b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.529169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d49d2a-1266-4144-88fa-7dc31e7b784b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.529469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d49d2a-1266-4144-88fa-7dc31e7b784b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.537411 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d49d2a-1266-4144-88fa-7dc31e7b784b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:16.538901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d49d2a-1266-4144-88fa-7dc31e7b784b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-b7d49d2a-1266-4144-88fa-7dc31e7b784b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:16.555882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:16.556832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:16.557741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:16.557741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:16.557741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:16.557741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:16.557741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:16.557741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:16.557741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:16.557741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:16.557741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:07:16.557741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:16.557741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 253/492] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Jul 7 07:07:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:16.558291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d49d2a-1266-4144-88fa-7dc31e7b784b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:16.571624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada3f90-a22b-44c9-a79b-aca2e79a29ef None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:16.614519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585fd49-6bec-4f86-b6a2-242f151fa172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:16.615330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585fd49-6bec-4f86-b6a2-242f151fa172 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.615809 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585fd49-6bec-4f86-b6a2-242f151fa172 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.615912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585fd49-6bec-4f86-b6a2-242f151fa172 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.627187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585fd49-6bec-4f86-b6a2-242f151fa172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-0585fd49-6bec-4f86-b6a2-242f151fa172 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:16.635035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:16.636015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:16.636794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 240/493] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:16.637473 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585fd49-6bec-4f86-b6a2-242f151fa172 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:16.663275 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:16.670880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:16.675877 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d49d2a-1266-4144-88fa-7dc31e7b784b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:16.713510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbe62c-ecae-4551-88ba-5146a710c6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:16.714153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbe62c-ecae-4551-88ba-5146a710c6fe None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.714430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbe62c-ecae-4551-88ba-5146a710c6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.714705 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbe62c-ecae-4551-88ba-5146a710c6fe None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.715493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbe62c-ecae-4551-88ba-5146a710c6fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:16.715800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbe62c-ecae-4551-88ba-5146a710c6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:16.717328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbe62c-ecae-4551-88ba-5146a710c6fe None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:16.729125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 254/494] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:16.731271 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb4cfe-05a4-40b0-8bb5-a11d59ffeadd None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.731856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb4cfe-05a4-40b0-8bb5-a11d59ffeadd None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.732308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb4cfe-05a4-40b0-8bb5-a11d59ffeadd None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.734131 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 255/495] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:16.735008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb4cfe-05a4-40b0-8bb5-a11d59ffeadd None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:16.744107 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585fd49-6bec-4f86-b6a2-242f151fa172 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:16.779310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbde59-6e62-4961-a29d-d4c26579b440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:16.779975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbde59-6e62-4961-a29d-d4c26579b440 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.780258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbde59-6e62-4961-a29d-d4c26579b440 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.780601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbde59-6e62-4961-a29d-d4c26579b440 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.781402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbde59-6e62-4961-a29d-d4c26579b440 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:16.781716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbde59-6e62-4961-a29d-d4c26579b440 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:16.783155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbde59-6e62-4961-a29d-d4c26579b440 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:16.822294 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 241/496] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Jul 7 07:07:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:16.823436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbde59-6e62-4961-a29d-d4c26579b440 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:16.846849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb4cfe-05a4-40b0-8bb5-a11d59ffeadd None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:16.883920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523e870-b5d3-4f02-a511-bc045362f5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:16.884584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523e870-b5d3-4f02-a511-bc045362f5ef None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.884866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523e870-b5d3-4f02-a511-bc045362f5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.885138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523e870-b5d3-4f02-a511-bc045362f5ef None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.885916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523e870-b5d3-4f02-a511-bc045362f5ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:16.886224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523e870-b5d3-4f02-a511-bc045362f5ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:16.887605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523e870-b5d3-4f02-a511-bc045362f5ef None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:16.895916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 256/497] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:16.897125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571543c-7efc-4a59-ba37-17dee1e9d0aa None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.897449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571543c-7efc-4a59-ba37-17dee1e9d0aa None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.897730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571543c-7efc-4a59-ba37-17dee1e9d0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.915543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c571543c-7efc-4a59-ba37-17dee1e9d0aa None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:16.916940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c571543c-7efc-4a59-ba37-17dee1e9d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:16.918073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:16.928331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbde59-6e62-4961-a29d-d4c26579b440 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:16.929387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:16.964300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162cfec-d176-4c3b-b4fa-86716251c457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:16.965024 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162cfec-d176-4c3b-b4fa-86716251c457 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:16.965335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162cfec-d176-4c3b-b4fa-86716251c457 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:16.965859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162cfec-d176-4c3b-b4fa-86716251c457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:16.975948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162cfec-d176-4c3b-b4fa-86716251c457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:16.977477 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162cfec-d176-4c3b-b4fa-86716251c457 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:16.988063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 257/498] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:16.988910 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571543c-7efc-4a59-ba37-17dee1e9d0aa None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-8162cfec-d176-4c3b-b4fa-86716251c457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:16.995352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:16.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:16.996982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:16.996982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:16.996982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:16.996982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:16.996982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 242/499] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:16.997689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162cfec-d176-4c3b-b4fa-86716251c457 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:17.091931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571543c-7efc-4a59-ba37-17dee1e9d0aa None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:17.100393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162cfec-d176-4c3b-b4fa-86716251c457 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:17.127276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042a94f-e96e-4926-8809-b51f0d8d4ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:17.127923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042a94f-e96e-4926-8809-b51f0d8d4ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:17.128210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042a94f-e96e-4926-8809-b51f0d8d4ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:17.128500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042a94f-e96e-4926-8809-b51f0d8d4ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:17.133791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74938c6-4a40-41c1-b55d-7ba01dd870c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:17.135748 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74938c6-4a40-41c1-b55d-7ba01dd870c7 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:17.136034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74938c6-4a40-41c1-b55d-7ba01dd870c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:17.136291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74938c6-4a40-41c1-b55d-7ba01dd870c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:17.143938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:17.147337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74938c6-4a40-41c1-b55d-7ba01dd870c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:17.148974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74938c6-4a40-41c1-b55d-7ba01dd870c7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:17.150907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-e74938c6-4a40-41c1-b55d-7ba01dd870c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:17.167410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:17.168266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:17.169080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:17.169080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:17.169080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:17.169080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:17.169080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 243/500] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:17.170100 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bb7d9-62b8-4464-be5c-cb789d6de2e1 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:17.170200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bb7d9-62b8-4464-be5c-cb789d6de2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:17.170437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bb7d9-62b8-4464-be5c-cb789d6de2e1 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:17.172035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 244/501] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:17.172751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bb7d9-62b8-4464-be5c-cb789d6de2e1 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:17.203174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042a94f-e96e-4926-8809-b51f0d8d4ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:17.204646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042a94f-e96e-4926-8809-b51f0d8d4ca6 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:17.275537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bb7d9-62b8-4464-be5c-cb789d6de2e1 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:17.300823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 258/502] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:17.301712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042a94f-e96e-4926-8809-b51f0d8d4ca6 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:17.310520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1758be-2391-4855-8fc6-802a2ef8cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:17.311191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1758be-2391-4855-8fc6-802a2ef8cb4f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:17.311478 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1758be-2391-4855-8fc6-802a2ef8cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:17.311756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1758be-2391-4855-8fc6-802a2ef8cb4f None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:17.312487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1758be-2391-4855-8fc6-802a2ef8cb4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:17.312803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1758be-2391-4855-8fc6-802a2ef8cb4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:17.314245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1758be-2391-4855-8fc6-802a2ef8cb4f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:17.326411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 245/503] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:17.327272 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1758be-2391-4855-8fc6-802a2ef8cb4f None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:17.356699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:17.383502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:17.417428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042a94f-e96e-4926-8809-b51f0d8d4ca6 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:17.430652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1758be-2391-4855-8fc6-802a2ef8cb4f None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:17.451880 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dad41-fc30-46df-856c-2e2649926147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:17.452607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dad41-fc30-46df-856c-2e2649926147 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:17.452880 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dad41-fc30-46df-856c-2e2649926147 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:17.453150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dad41-fc30-46df-856c-2e2649926147 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:17.463168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dad41-fc30-46df-856c-2e2649926147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:17.467966 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a2936-ae2b-4480-8d7a-1236b4afa532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:17.468638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a2936-ae2b-4480-8d7a-1236b4afa532 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:17.468924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a2936-ae2b-4480-8d7a-1236b4afa532 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:17.469195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a2936-ae2b-4480-8d7a-1236b4afa532 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:17.469947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a2936-ae2b-4480-8d7a-1236b4afa532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:17.470315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a2936-ae2b-4480-8d7a-1236b4afa532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-eb2dad41-fc30-46df-856c-2e2649926147 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:17.470832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:17.471905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:17.472694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:17.472694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:17.472694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:17.472694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:17.472694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:17.472694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:17.472694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:17.472694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:17.472694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:17.472694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:17.472694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:17.472694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:17.474039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a2936-ae2b-4480-8d7a-1236b4afa532 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:17.474179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 259/504] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:17.474179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e54fcb-4ebb-4434-915c-deab2bc98d71 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:17.474179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e54fcb-4ebb-4434-915c-deab2bc98d71 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:17.474179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e54fcb-4ebb-4434-915c-deab2bc98d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:17.488120 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 246/505] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:17.488964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a2936-ae2b-4480-8d7a-1236b4afa532 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:17.490916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-09e54fcb-4ebb-4434-915c-deab2bc98d71 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:17.492092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-09e54fcb-4ebb-4434-915c-deab2bc98d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:17.560365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 260/506] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:17.561210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e54fcb-4ebb-4434-915c-deab2bc98d71 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:17.595356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:17.600217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a2936-ae2b-4480-8d7a-1236b4afa532 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:17.614261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:17.634909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d5e59-0100-40bd-b167-be5fea5415f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:17.635709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d5e59-0100-40bd-b167-be5fea5415f1 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:17.635989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d5e59-0100-40bd-b167-be5fea5415f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:17.636261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d5e59-0100-40bd-b167-be5fea5415f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:17.647711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d5e59-0100-40bd-b167-be5fea5415f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:17.649171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d5e59-0100-40bd-b167-be5fea5415f1 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:17.666503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e54fcb-4ebb-4434-915c-deab2bc98d71 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-546d5e59-0100-40bd-b167-be5fea5415f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:17.667274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:17.668138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:17.668957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:17.668957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:17.668957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:17.668957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:17.669318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 247/507] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:17.670608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d5e59-0100-40bd-b167-be5fea5415f1 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:17.707660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f66c8-208a-4c53-9c8b-60b053263970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:17.708479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f66c8-208a-4c53-9c8b-60b053263970 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:17.708768 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f66c8-208a-4c53-9c8b-60b053263970 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:17.709037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f66c8-208a-4c53-9c8b-60b053263970 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:17.716370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f66c8-208a-4c53-9c8b-60b053263970 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:17.717905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f66c8-208a-4c53-9c8b-60b053263970 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-ef3f66c8-208a-4c53-9c8b-60b053263970 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:17.732344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:17.733431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:17.734397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:17.734397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:17.734397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:17.734397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:17.734397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:17.734397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:17.734397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:17.734397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:17.734397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 07 07:07:17.734397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:17.734397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 261/508] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:17.734942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f66c8-208a-4c53-9c8b-60b053263970 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:17.779042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d5e59-0100-40bd-b167-be5fea5415f1 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:17.811944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbada0a-ceac-4064-8918-6f67c55b629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:17.812553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbada0a-ceac-4064-8918-6f67c55b629b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:17.812833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbada0a-ceac-4064-8918-6f67c55b629b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:17.813109 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbada0a-ceac-4064-8918-6f67c55b629b None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:17.813891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbada0a-ceac-4064-8918-6f67c55b629b None admin] RBAC: Adding query filter params (name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:17.814196 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbada0a-ceac-4064-8918-6f67c55b629b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:17.815594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbada0a-ceac-4064-8918-6f67c55b629b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:17.823926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 248/509] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:17.824720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbada0a-ceac-4064-8918-6f67c55b629b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:17.828561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:17.836216 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f66c8-208a-4c53-9c8b-60b053263970 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:17.855490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:17.877353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9177b-2374-45f9-ad37-4f8f284ebc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:17.878172 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9177b-2374-45f9-ad37-4f8f284ebc83 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:17.878432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9177b-2374-45f9-ad37-4f8f284ebc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:17.878712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9177b-2374-45f9-ad37-4f8f284ebc83 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:17.886638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9177b-2374-45f9-ad37-4f8f284ebc83 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:17.888087 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9177b-2374-45f9-ad37-4f8f284ebc83 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-bcf9177b-2374-45f9-ad37-4f8f284ebc83 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:17.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:17.904210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:17.905062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:17.905062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:17.905062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:17.905062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:17.905062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:17.905062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:17.905062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:17.905062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:17.905062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 07:07:17.905062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:17.905062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 262/510] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:17.905649 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9177b-2374-45f9-ad37-4f8f284ebc83 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:17.932105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbada0a-ceac-4064-8918-6f67c55b629b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:17.967687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc46dad-736b-4f40-b503-e9d2b5c6f267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:17.968486 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc46dad-736b-4f40-b503-e9d2b5c6f267 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:17.968762 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc46dad-736b-4f40-b503-e9d2b5c6f267 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:17.969030 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc46dad-736b-4f40-b503-e9d2b5c6f267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:17.980927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc46dad-736b-4f40-b503-e9d2b5c6f267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:17.982612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc46dad-736b-4f40-b503-e9d2b5c6f267 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-acc46dad-736b-4f40-b503-e9d2b5c6f267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:18.003015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:18.004071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:18.005098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:18.005098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:18.005098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:18.005098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:18.005098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 249/511] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:18.005530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc46dad-736b-4f40-b503-e9d2b5c6f267 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:18.023749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9177b-2374-45f9-ad37-4f8f284ebc83 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:18.062572 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77cc03-c8b0-4dc3-a536-ae333978fe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:18.063179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77cc03-c8b0-4dc3-a536-ae333978fe07 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:18.063466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77cc03-c8b0-4dc3-a536-ae333978fe07 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:18.063747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77cc03-c8b0-4dc3-a536-ae333978fe07 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:18.064491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77cc03-c8b0-4dc3-a536-ae333978fe07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:18.064796 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77cc03-c8b0-4dc3-a536-ae333978fe07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:18.066228 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77cc03-c8b0-4dc3-a536-ae333978fe07 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:18.078162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 263/512] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:18.079002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77cc03-c8b0-4dc3-a536-ae333978fe07 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:18.095838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:18.096574 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:18.116795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc46dad-736b-4f40-b503-e9d2b5c6f267 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:18.152102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382415b-5ab9-4655-a8d8-704f82dfd4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:18.152782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382415b-5ab9-4655-a8d8-704f82dfd4ad None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:18.153067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382415b-5ab9-4655-a8d8-704f82dfd4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:18.153376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382415b-5ab9-4655-a8d8-704f82dfd4ad None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:18.154228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382415b-5ab9-4655-a8d8-704f82dfd4ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:18.154524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382415b-5ab9-4655-a8d8-704f82dfd4ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:18.155977 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382415b-5ab9-4655-a8d8-704f82dfd4ad None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:18.173925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 250/513] 10.222.0.62 () {56 vars in 1137 bytes} [Thu Jul 7 07:07:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:18.174750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382415b-5ab9-4655-a8d8-704f82dfd4ad None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:18.188659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77cc03-c8b0-4dc3-a536-ae333978fe07 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:18.223129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8358cd-a2a1-4e41-975f-052832c3c687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:18.223935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8358cd-a2a1-4e41-975f-052832c3c687 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:18.224217 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8358cd-a2a1-4e41-975f-052832c3c687 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:18.224490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8358cd-a2a1-4e41-975f-052832c3c687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:18.235017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8358cd-a2a1-4e41-975f-052832c3c687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:18.236493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8358cd-a2a1-4e41-975f-052832c3c687 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-7d8358cd-a2a1-4e41-975f-052832c3c687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:18.253195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:18.254055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:18.255121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:18.255121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:18.255121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:18.255121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:18.255121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 264/514] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:18.255381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8358cd-a2a1-4e41-975f-052832c3c687 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:18.282650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382415b-5ab9-4655-a8d8-704f82dfd4ad None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:18.316794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179eb30-5682-403d-81b5-9952aca7ede5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:18.317432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179eb30-5682-403d-81b5-9952aca7ede5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:18.318079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179eb30-5682-403d-81b5-9952aca7ede5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:18.318357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179eb30-5682-403d-81b5-9952aca7ede5 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:18.319205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179eb30-5682-403d-81b5-9952aca7ede5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:18.319511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179eb30-5682-403d-81b5-9952aca7ede5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:18.320971 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179eb30-5682-403d-81b5-9952aca7ede5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:18.323275 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:18.331072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:18.342810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 251/515] 10.222.0.62 () {56 vars in 1137 bytes} [Thu Jul 7 07:07:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:18.343820 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179eb30-5682-403d-81b5-9952aca7ede5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:18.365795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8358cd-a2a1-4e41-975f-052832c3c687 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:18.403234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e29f4-86b4-4a47-bf93-5f3ae21b5cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:18.403916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e29f4-86b4-4a47-bf93-5f3ae21b5cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:18.404191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e29f4-86b4-4a47-bf93-5f3ae21b5cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:18.404458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e29f4-86b4-4a47-bf93-5f3ae21b5cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:18.405181 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e29f4-86b4-4a47-bf93-5f3ae21b5cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:18.405526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e29f4-86b4-4a47-bf93-5f3ae21b5cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:18.407033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e29f4-86b4-4a47-bf93-5f3ae21b5cb0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:18.419450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 265/516] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:18.420085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e29f4-86b4-4a47-bf93-5f3ae21b5cb0 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:18.450446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179eb30-5682-403d-81b5-9952aca7ede5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:18.483565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5062cc-e660-4eee-a1a0-5cd444d280a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:18.484368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5062cc-e660-4eee-a1a0-5cd444d280a7 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:18.484655 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5062cc-e660-4eee-a1a0-5cd444d280a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:18.484939 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5062cc-e660-4eee-a1a0-5cd444d280a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:18.491580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5062cc-e660-4eee-a1a0-5cd444d280a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:18.493032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5062cc-e660-4eee-a1a0-5cd444d280a7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-bf5062cc-e660-4eee-a1a0-5cd444d280a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:18.507619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:18.508448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:18.509290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:18.509290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:18.509290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:18.509290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:18.509290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:18.509290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:18.509290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:18.509290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:18.509290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 252/517] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:18.514068 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5062cc-e660-4eee-a1a0-5cd444d280a7 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:18.518540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e29f4-86b4-4a47-bf93-5f3ae21b5cb0 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:18.544619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:18.554171 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ea66f-0bd8-404e-83c7-8217ce2e5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:18.554825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ea66f-0bd8-404e-83c7-8217ce2e5f75 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:18.555106 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ea66f-0bd8-404e-83c7-8217ce2e5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:18.555377 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ea66f-0bd8-404e-83c7-8217ce2e5f75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:18.571375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:18.616296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5062cc-e660-4eee-a1a0-5cd444d280a7 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:18.623601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ea66f-0bd8-404e-83c7-8217ce2e5f75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:18.625133 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ea66f-0bd8-404e-83c7-8217ce2e5f75 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:18.654264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763192c2-67ea-4259-a97f-cbed5fad0851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:18.654952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763192c2-67ea-4259-a97f-cbed5fad0851 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:18.655245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763192c2-67ea-4259-a97f-cbed5fad0851 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:18.655513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763192c2-67ea-4259-a97f-cbed5fad0851 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:18.656234 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763192c2-67ea-4259-a97f-cbed5fad0851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:18.656539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763192c2-67ea-4259-a97f-cbed5fad0851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:18.657944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763192c2-67ea-4259-a97f-cbed5fad0851 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:18.670631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 253/518] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:18.671713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763192c2-67ea-4259-a97f-cbed5fad0851 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:18.733067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 266/519] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:18.733960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ea66f-0bd8-404e-83c7-8217ce2e5f75 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:18.759972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:18.778026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763192c2-67ea-4259-a97f-cbed5fad0851 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:18.794999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:18.813408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ea556-28fd-48e9-a1ad-b147578a0870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:18.814067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ea556-28fd-48e9-a1ad-b147578a0870 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:18.814351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ea556-28fd-48e9-a1ad-b147578a0870 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:18.814618 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ea556-28fd-48e9-a1ad-b147578a0870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:18.835075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ea66f-0bd8-404e-83c7-8217ce2e5f75 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:18.868259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df646-7498-4c58-a7f7-0ba31a8941fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:18.868960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df646-7498-4c58-a7f7-0ba31a8941fa None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:18.869274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df646-7498-4c58-a7f7-0ba31a8941fa None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:18.869563 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df646-7498-4c58-a7f7-0ba31a8941fa None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:18.870273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7df646-7498-4c58-a7f7-0ba31a8941fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:18.871728 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7df646-7498-4c58-a7f7-0ba31a8941fa None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:18.880422 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ea556-28fd-48e9-a1ad-b147578a0870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:18.881927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ea556-28fd-48e9-a1ad-b147578a0870 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:18.891223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 267/520] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:07:18 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:07:18.892034 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df646-7498-4c58-a7f7-0ba31a8941fa None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:18.987563 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:19.006336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 254/521] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:19.007466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ea556-28fd-48e9-a1ad-b147578a0870 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:19.013056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df646-7498-4c58-a7f7-0ba31a8941fa None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:19.027508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:19.054198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8938545-dce1-4572-8295-9f2e2939c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:19.054893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8938545-dce1-4572-8295-9f2e2939c436 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:19.055183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8938545-dce1-4572-8295-9f2e2939c436 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:19.055463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8938545-dce1-4572-8295-9f2e2939c436 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:19.056387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8938545-dce1-4572-8295-9f2e2939c436 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:19.056696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8938545-dce1-4572-8295-9f2e2939c436 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:19.058244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8938545-dce1-4572-8295-9f2e2939c436 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:19.082075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 268/522] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:19.082075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8938545-dce1-4572-8295-9f2e2939c436 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:19.130129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ea556-28fd-48e9-a1ad-b147578a0870 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:19.164378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fa8ec-2ae8-475f-9e98-584e30ef8d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:19.165231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fa8ec-2ae8-475f-9e98-584e30ef8d0b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:19.165539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fa8ec-2ae8-475f-9e98-584e30ef8d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:19.165798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fa8ec-2ae8-475f-9e98-584e30ef8d0b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:19.173050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fa8ec-2ae8-475f-9e98-584e30ef8d0b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:19.174537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fa8ec-2ae8-475f-9e98-584e30ef8d0b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-1a6fa8ec-2ae8-475f-9e98-584e30ef8d0b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:19.190430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:19.191507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:19.192403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:19.192403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:19.192403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:19.192403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:19.192403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:19.192403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:19.192403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:19.192403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:19.192403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 07 07:07:19.192403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:19.192403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 255/523] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:19.193442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fa8ec-2ae8-475f-9e98-584e30ef8d0b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:19.196791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8938545-dce1-4572-8295-9f2e2939c436 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:19.234029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04b111-889f-46d7-9d99-0683ced9ae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:19.234826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04b111-889f-46d7-9d99-0683ced9ae3e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:19.235108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04b111-889f-46d7-9d99-0683ced9ae3e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:19.235385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04b111-889f-46d7-9d99-0683ced9ae3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:19.246228 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04b111-889f-46d7-9d99-0683ced9ae3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:19.247795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04b111-889f-46d7-9d99-0683ced9ae3e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:19.249669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-5c04b111-889f-46d7-9d99-0683ced9ae3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:19.266333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:19.267542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:19.273041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:19.273041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:19.273041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:19.273041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:19.273041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 269/524] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:19.273041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04b111-889f-46d7-9d99-0683ced9ae3e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:19.287018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:19.312804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fa8ec-2ae8-475f-9e98-584e30ef8d0b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:19.355550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15845c-9e34-4586-89eb-eba5fc61adbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:19.356485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15845c-9e34-4586-89eb-eba5fc61adbd None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:19.356765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15845c-9e34-4586-89eb-eba5fc61adbd None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:19.357037 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15845c-9e34-4586-89eb-eba5fc61adbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:19.367750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15845c-9e34-4586-89eb-eba5fc61adbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:19.369450 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15845c-9e34-4586-89eb-eba5fc61adbd None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:19.380454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04b111-889f-46d7-9d99-0683ced9ae3e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-dd15845c-9e34-4586-89eb-eba5fc61adbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:19.387221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:19.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:19.388990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:19.388990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:19.388990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:19.388990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:19.388990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 256/525] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:19.394873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15845c-9e34-4586-89eb-eba5fc61adbd None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:19.425344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa0c8c-a34f-4e56-9ddd-d3a205a64061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:19.426262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa0c8c-a34f-4e56-9ddd-d3a205a64061 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:19.426368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa0c8c-a34f-4e56-9ddd-d3a205a64061 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:19.426588 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa0c8c-a34f-4e56-9ddd-d3a205a64061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:19.427424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa0c8c-a34f-4e56-9ddd-d3a205a64061 None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=42acdb53c342401da6b32be6b9f3d030) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:19.427736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa0c8c-a34f-4e56-9ddd-d3a205a64061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:19.429192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa0c8c-a34f-4e56-9ddd-d3a205a64061 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:19.445256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 270/526] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:19 2022] GET /identity/v3/role_assignments?user.id=42acdb53c342401da6b32be6b9f3d030&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:19.445256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa0c8c-a34f-4e56-9ddd-d3a205a64061 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:19.514530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:19.531044 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15845c-9e34-4586-89eb-eba5fc61adbd None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:19.565484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa0c8c-a34f-4e56-9ddd-d3a205a64061 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:19.570526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:19.581871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbce69f-f80d-4e20-8f6a-6c00dbeefef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:19.582911 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbce69f-f80d-4e20-8f6a-6c00dbeefef4 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:19.583220 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbce69f-f80d-4e20-8f6a-6c00dbeefef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:19.584050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbce69f-f80d-4e20-8f6a-6c00dbeefef4 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:19.585292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbce69f-f80d-4e20-8f6a-6c00dbeefef4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:19.585612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbce69f-f80d-4e20-8f6a-6c00dbeefef4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:19.588216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbce69f-f80d-4e20-8f6a-6c00dbeefef4 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:19.606240 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984b151-0a6f-4095-969e-0b69c565f37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:19.607031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984b151-0a6f-4095-969e-0b69c565f37c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:19.607382 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984b151-0a6f-4095-969e-0b69c565f37c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:19.607811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984b151-0a6f-4095-969e-0b69c565f37c None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:19.608623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984b151-0a6f-4095-969e-0b69c565f37c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:19.608992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984b151-0a6f-4095-969e-0b69c565f37c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:19.610579 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984b151-0a6f-4095-969e-0b69c565f37c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:19.613438 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 257/527] 10.222.0.62 () {56 vars in 1139 bytes} [Thu Jul 7 07:07:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:19.614524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbce69f-f80d-4e20-8f6a-6c00dbeefef4 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:19.633491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 271/528] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:19.634483 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984b151-0a6f-4095-969e-0b69c565f37c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:19.740179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbce69f-f80d-4e20-8f6a-6c00dbeefef4 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:19.762116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984b151-0a6f-4095-969e-0b69c565f37c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:19.784334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:19.794613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a067ea-53f9-4263-80d8-d3e982419c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:19.795359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a067ea-53f9-4263-80d8-d3e982419c67 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:19.795646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a067ea-53f9-4263-80d8-d3e982419c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:19.795956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a067ea-53f9-4263-80d8-d3e982419c67 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:19.796753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a067ea-53f9-4263-80d8-d3e982419c67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:19.797090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a067ea-53f9-4263-80d8-d3e982419c67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:19.798577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a067ea-53f9-4263-80d8-d3e982419c67 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:19.813529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a598b4-53f3-4d71-b50a-8bfc244c339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:19.814554 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a598b4-53f3-4d71-b50a-8bfc244c339a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:19.815032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a598b4-53f3-4d71-b50a-8bfc244c339a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:19.815505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a598b4-53f3-4d71-b50a-8bfc244c339a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:19.816136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 258/529] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:19.817066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a067ea-53f9-4263-80d8-d3e982419c67 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:19.869907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:19.899788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a598b4-53f3-4d71-b50a-8bfc244c339a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:19.901705 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a598b4-53f3-4d71-b50a-8bfc244c339a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:19.925513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a067ea-53f9-4263-80d8-d3e982419c67 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:19.962867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808157b-b3d4-436d-b7df-6aa9403072e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:19.963862 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808157b-b3d4-436d-b7df-6aa9403072e0 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:19.963971 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808157b-b3d4-436d-b7df-6aa9403072e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:19.964239 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808157b-b3d4-436d-b7df-6aa9403072e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:19.971336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808157b-b3d4-436d-b7df-6aa9403072e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:19.972860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808157b-b3d4-436d-b7df-6aa9403072e0 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-8808157b-b3d4-436d-b7df-6aa9403072e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:19.987908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:19.988805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:19.989662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:19.989662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:19.989662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:19.989662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:19.989662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:19.989662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:19.989662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:19.989662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:19.989662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 259/530] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:19.990126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808157b-b3d4-436d-b7df-6aa9403072e0 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:20.021290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 272/531] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:20.022717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a598b4-53f3-4d71-b50a-8bfc244c339a None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:20.049642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:20.097653 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808157b-b3d4-436d-b7df-6aa9403072e0 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:20.105544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:20.134278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564761d-7902-45c3-9e78-64597ec297b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:20.134948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564761d-7902-45c3-9e78-64597ec297b5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:20.135230 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564761d-7902-45c3-9e78-64597ec297b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:20.135508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564761d-7902-45c3-9e78-64597ec297b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:20.141149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a598b4-53f3-4d71-b50a-8bfc244c339a None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:20.142773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564761d-7902-45c3-9e78-64597ec297b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:20.144242 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564761d-7902-45c3-9e78-64597ec297b5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-8564761d-7902-45c3-9e78-64597ec297b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:20.158588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:20.159448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:20.160278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:20.160278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:20.160278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:20.160278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:20.160278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:20.160278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:20.160278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:20.160278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:20.164460 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 260/532] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:20.165436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564761d-7902-45c3-9e78-64597ec297b5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:20.183174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc638029-e547-4773-994a-cfffdb4d9bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:20.184375 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc638029-e547-4773-994a-cfffdb4d9bdf None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:20.184906 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc638029-e547-4773-994a-cfffdb4d9bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:20.185551 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc638029-e547-4773-994a-cfffdb4d9bdf None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:20.186580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc638029-e547-4773-994a-cfffdb4d9bdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:20.187083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc638029-e547-4773-994a-cfffdb4d9bdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:20.188982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc638029-e547-4773-994a-cfffdb4d9bdf None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:20.203381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 273/533] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:20.204921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc638029-e547-4773-994a-cfffdb4d9bdf None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:20.325474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc638029-e547-4773-994a-cfffdb4d9bdf None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:20.329585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:20.339084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564761d-7902-45c3-9e78-64597ec297b5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:20.370044 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965e800-c990-4c0d-a2e9-619126925ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:20.371288 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965e800-c990-4c0d-a2e9-619126925ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:20.371772 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965e800-c990-4c0d-a2e9-619126925ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:20.372258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965e800-c990-4c0d-a2e9-619126925ef0 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:20.373304 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965e800-c990-4c0d-a2e9-619126925ef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:20.373815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965e800-c990-4c0d-a2e9-619126925ef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:20.375596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965e800-c990-4c0d-a2e9-619126925ef0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:20.396895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 274/534] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:20.398799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965e800-c990-4c0d-a2e9-619126925ef0 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:20.463508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bc6f1-59c6-4804-a47c-908bf60cd5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:20.464298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bc6f1-59c6-4804-a47c-908bf60cd5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:20.464587 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bc6f1-59c6-4804-a47c-908bf60cd5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:20.464865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bc6f1-59c6-4804-a47c-908bf60cd5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:20.493655 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bc6f1-59c6-4804-a47c-908bf60cd5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:20.498049 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bc6f1-59c6-4804-a47c-908bf60cd5e5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:20.512422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965e800-c990-4c0d-a2e9-619126925ef0 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-1c5bc6f1-59c6-4804-a47c-908bf60cd5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:20.544015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:20.545249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:20.546084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:20.546084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:20.546084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:20.546084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:20.551056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 261/535] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:20.551056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bc6f1-59c6-4804-a47c-908bf60cd5e5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:20.560305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658403c-c65d-4080-b26e-7484e142fa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:20.561300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658403c-c65d-4080-b26e-7484e142fa2b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:20.561784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658403c-c65d-4080-b26e-7484e142fa2b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:20.562281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658403c-c65d-4080-b26e-7484e142fa2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:20.563328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658403c-c65d-4080-b26e-7484e142fa2b None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=3a6af41d833941debd6afcecd952af0f) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:20.563838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658403c-c65d-4080-b26e-7484e142fa2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:20.565539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658403c-c65d-4080-b26e-7484e142fa2b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:20.574393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 275/536] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:20 2022] GET /identity/v3/role_assignments?user.id=3a6af41d833941debd6afcecd952af0f&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:20.575665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658403c-c65d-4080-b26e-7484e142fa2b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:20.579479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:20.596110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:20.744504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658403c-c65d-4080-b26e-7484e142fa2b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:20.823072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bc6f1-59c6-4804-a47c-908bf60cd5e5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:20.854021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec6eb-ef54-43bf-a8f6-ea01ceaf4bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:20.854754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec6eb-ef54-43bf-a8f6-ea01ceaf4bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:20.855047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec6eb-ef54-43bf-a8f6-ea01ceaf4bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:20.855322 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec6eb-ef54-43bf-a8f6-ea01ceaf4bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:20.856710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec6eb-ef54-43bf-a8f6-ea01ceaf4bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:20.856710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec6eb-ef54-43bf-a8f6-ea01ceaf4bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:20.857839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec6eb-ef54-43bf-a8f6-ea01ceaf4bb2 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:20.880896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 276/537] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:20.886278 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec6eb-ef54-43bf-a8f6-ea01ceaf4bb2 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:20.904441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc70c78-8fbe-4283-a79a-fc3bfe55be32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:20.905502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc70c78-8fbe-4283-a79a-fc3bfe55be32 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:20.906009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc70c78-8fbe-4283-a79a-fc3bfe55be32 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:20.906480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc70c78-8fbe-4283-a79a-fc3bfe55be32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:20.907702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc70c78-8fbe-4283-a79a-fc3bfe55be32 None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=af7af6f0c53d4c599f5dd80150b4a22e) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:20.908212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc70c78-8fbe-4283-a79a-fc3bfe55be32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:20.909924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc70c78-8fbe-4283-a79a-fc3bfe55be32 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:20.917195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 262/538] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:20 2022] GET /identity/v3/role_assignments?user.id=af7af6f0c53d4c599f5dd80150b4a22e&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 259 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:20.955905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:21.013564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec6eb-ef54-43bf-a8f6-ea01ceaf4bb2 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:21.032066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ea227-4363-4ab3-ba75-16a4327b8cfe None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:21.032402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ea227-4363-4ab3-ba75-16a4327b8cfe None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:21.032631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ea227-4363-4ab3-ba75-16a4327b8cfe None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:21.035619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 263/539] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:21.040341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf31c1-d0fb-4a54-a947-da0813cf2ccd None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:21.040989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf31c1-d0fb-4a54-a947-da0813cf2ccd None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:21.041560 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf31c1-d0fb-4a54-a947-da0813cf2ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:21.066079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95f6c7-6564-46fe-8064-dc971e59686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:21.066941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95f6c7-6564-46fe-8064-dc971e59686f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:21.067226 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95f6c7-6564-46fe-8064-dc971e59686f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:21.067501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95f6c7-6564-46fe-8064-dc971e59686f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:21.068167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-15cf31c1-d0fb-4a54-a947-da0813cf2ccd None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:21.069911 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-15cf31c1-d0fb-4a54-a947-da0813cf2ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:21.075747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95f6c7-6564-46fe-8064-dc971e59686f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:21.077235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95f6c7-6564-46fe-8064-dc971e59686f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-6f95f6c7-6564-46fe-8064-dc971e59686f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:21.104941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:21.105882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:21.106684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:21.106684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:21.106684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:21.106684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:21.106684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:21.106684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:21.106684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:21.106684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:21.106684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 277/540] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:21.112121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95f6c7-6564-46fe-8064-dc971e59686f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:21.153746 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 264/541] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:21.184112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf31c1-d0fb-4a54-a947-da0813cf2ccd None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:21.200968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:21.243689 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95f6c7-6564-46fe-8064-dc971e59686f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:21.280842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee3b06-9b8d-4f1f-9286-a567774851b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:21.281427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee3b06-9b8d-4f1f-9286-a567774851b9 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:21.281712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee3b06-9b8d-4f1f-9286-a567774851b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:21.281992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee3b06-9b8d-4f1f-9286-a567774851b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:21.282789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee3b06-9b8d-4f1f-9286-a567774851b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:21.283144 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee3b06-9b8d-4f1f-9286-a567774851b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:21.284635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee3b06-9b8d-4f1f-9286-a567774851b9 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:21.301271 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 278/542] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:21.301696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:21.303609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee3b06-9b8d-4f1f-9286-a567774851b9 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:21.331306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf31c1-d0fb-4a54-a947-da0813cf2ccd None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:21.412699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee3b06-9b8d-4f1f-9286-a567774851b9 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:21.450368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933cbfe-c286-49c6-8f1b-e853ed9da2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:21.451048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933cbfe-c286-49c6-8f1b-e853ed9da2bb None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:21.451329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933cbfe-c286-49c6-8f1b-e853ed9da2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:21.451604 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933cbfe-c286-49c6-8f1b-e853ed9da2bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:21.452448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933cbfe-c286-49c6-8f1b-e853ed9da2bb None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=4d0c6b46b5d248e5bed2b1bbdfa74f59) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:21.452755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933cbfe-c286-49c6-8f1b-e853ed9da2bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:21.454387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933cbfe-c286-49c6-8f1b-e853ed9da2bb None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:21.460981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 279/543] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:21 2022] GET /identity/v3/role_assignments?user.id=4d0c6b46b5d248e5bed2b1bbdfa74f59&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:21.490110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee76dc-4be4-4de3-bb78-99c677264455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:21.490966 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee76dc-4be4-4de3-bb78-99c677264455 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:21.491257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee76dc-4be4-4de3-bb78-99c677264455 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:21.491540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee76dc-4be4-4de3-bb78-99c677264455 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:21.522508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee76dc-4be4-4de3-bb78-99c677264455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-5bee76dc-4be4-4de3-bb78-99c677264455 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:21.530732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:21.531728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:21.532524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:21.532524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:21.532524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:21.532524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:21.532524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:21.532524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:21.532524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:21.532524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:21.532524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:21.532524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:21.532524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:21.532524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:21.537276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 265/544] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:21.538621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933cbfe-c286-49c6-8f1b-e853ed9da2bb None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:21.633636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:21.715152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933cbfe-c286-49c6-8f1b-e853ed9da2bb None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:21.756866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467d5bd-3949-4f1c-9f48-c3eb61013217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:21.757596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d5bd-3949-4f1c-9f48-c3eb61013217 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:21.757878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d5bd-3949-4f1c-9f48-c3eb61013217 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:21.758151 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d5bd-3949-4f1c-9f48-c3eb61013217 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:21.758978 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467d5bd-3949-4f1c-9f48-c3eb61013217 None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:21.759291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467d5bd-3949-4f1c-9f48-c3eb61013217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:21.760686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467d5bd-3949-4f1c-9f48-c3eb61013217 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:21.774121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 280/545] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:21.782448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee76dc-4be4-4de3-bb78-99c677264455 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:21.821872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823be25-61a2-4080-8354-e40c594a51cf None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:21.822224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823be25-61a2-4080-8354-e40c594a51cf None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:21.822606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823be25-61a2-4080-8354-e40c594a51cf None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:21.824959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 281/546] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:21.832047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7a847-f381-4f27-ae5f-5ac00b214db5 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:21.832334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7a847-f381-4f27-ae5f-5ac00b214db5 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:21.832612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7a847-f381-4f27-ae5f-5ac00b214db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:21.852337 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ecf7a847-f381-4f27-ae5f-5ac00b214db5 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:21.853845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ecf7a847-f381-4f27-ae5f-5ac00b214db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:21.927077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:21.955770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee76dc-4be4-4de3-bb78-99c677264455 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:21.980000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 282/547] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:07:22.001649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459830b2-5d23-41a2-ba15-78e1074e9de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:22.003090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7a847-f381-4f27-ae5f-5ac00b214db5 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:22.006589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459830b2-5d23-41a2-ba15-78e1074e9de1 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:22.011374 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459830b2-5d23-41a2-ba15-78e1074e9de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:22.011709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459830b2-5d23-41a2-ba15-78e1074e9de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:22.032807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459830b2-5d23-41a2-ba15-78e1074e9de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:22.034236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459830b2-5d23-41a2-ba15-78e1074e9de1 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-459830b2-5d23-41a2-ba15-78e1074e9de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:22.062619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:22.063524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:22.064332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:22.064332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:22.064332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:22.064332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:22.066615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 266/548] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:22.071565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:22.072684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459830b2-5d23-41a2-ba15-78e1074e9de1 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:22.137402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7a847-f381-4f27-ae5f-5ac00b214db5 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:22.203600 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb01b2-02de-4cb0-b3ee-e7570898ed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:22.204574 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb01b2-02de-4cb0-b3ee-e7570898ed22 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:22.204956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb01b2-02de-4cb0-b3ee-e7570898ed22 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:22.205369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb01b2-02de-4cb0-b3ee-e7570898ed22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:22.219054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb01b2-02de-4cb0-b3ee-e7570898ed22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-99cb01b2-02de-4cb0-b3ee-e7570898ed22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:22.227699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:22.228898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:22.230462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:22.230462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:22.230462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:22.230462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:22.230462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:22.230462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:22.230462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:22.230462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:22.230462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:22.230462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:22.230462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:22.230462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:22.232031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 283/549] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:22.242263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb01b2-02de-4cb0-b3ee-e7570898ed22 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:22.245007 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459830b2-5d23-41a2-ba15-78e1074e9de1 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:22.270673 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:22.282794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab691a9d-e8eb-41d4-bae2-8236c75c990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:22.283819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab691a9d-e8eb-41d4-bae2-8236c75c990c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:22.284292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab691a9d-e8eb-41d4-bae2-8236c75c990c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:22.284721 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab691a9d-e8eb-41d4-bae2-8236c75c990c None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:22.285626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab691a9d-e8eb-41d4-bae2-8236c75c990c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:22.286123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab691a9d-e8eb-41d4-bae2-8236c75c990c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:22.287776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab691a9d-e8eb-41d4-bae2-8236c75c990c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:22.301058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 267/550] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:22.314514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab691a9d-e8eb-41d4-bae2-8236c75c990c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:22.431928 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab691a9d-e8eb-41d4-bae2-8236c75c990c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:22.471069 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60536f58-f331-493b-a3f0-987a936f62ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:22.472333 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60536f58-f331-493b-a3f0-987a936f62ea None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:22.472826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60536f58-f331-493b-a3f0-987a936f62ea None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:22.473389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60536f58-f331-493b-a3f0-987a936f62ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:22.476265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:22.485171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60536f58-f331-493b-a3f0-987a936f62ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:22.487040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60536f58-f331-493b-a3f0-987a936f62ea None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:22.487597 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb01b2-02de-4cb0-b3ee-e7570898ed22 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-60536f58-f331-493b-a3f0-987a936f62ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:22.504300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:22.505656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:22.506727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:22.506727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:22.506727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:22.506727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:22.506727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:22.506727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:22.506727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:22.506727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:22.506727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 07 07:07:22.506727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:22.509429 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 268/551] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:22.518308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60536f58-f331-493b-a3f0-987a936f62ea None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:22.559064 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4314c-2020-407c-ab10-035cb831f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:22.559752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4314c-2020-407c-ab10-035cb831f70f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:22.561161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4314c-2020-407c-ab10-035cb831f70f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:22.561479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4314c-2020-407c-ab10-035cb831f70f None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:22.562249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4314c-2020-407c-ab10-035cb831f70f None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:22.562566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4314c-2020-407c-ab10-035cb831f70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:22.564408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4314c-2020-407c-ab10-035cb831f70f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:22.584730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 284/552] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:22.587204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4314c-2020-407c-ab10-035cb831f70f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:22.609620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:22.702367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60536f58-f331-493b-a3f0-987a936f62ea None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:22.761064 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4314c-2020-407c-ab10-035cb831f70f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:22.766054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3548af-b618-474f-bbd6-6eba57690fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:22.766762 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3548af-b618-474f-bbd6-6eba57690fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:22.767040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3548af-b618-474f-bbd6-6eba57690fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:22.767310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3548af-b618-474f-bbd6-6eba57690fc6 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:22.768159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3548af-b618-474f-bbd6-6eba57690fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:22.768470 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3548af-b618-474f-bbd6-6eba57690fc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:22.770291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3548af-b618-474f-bbd6-6eba57690fc6 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:22.808882 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 269/553] 10.222.0.62 () {56 vars in 1135 bytes} [Thu Jul 7 07:07:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:22.812975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3548af-b618-474f-bbd6-6eba57690fc6 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:22.832551 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c19470-a90d-4a9a-9825-6be6ddec78e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:22.833408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c19470-a90d-4a9a-9825-6be6ddec78e1 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:22.833742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c19470-a90d-4a9a-9825-6be6ddec78e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:22.834017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c19470-a90d-4a9a-9825-6be6ddec78e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:22.850526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c19470-a90d-4a9a-9825-6be6ddec78e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:22.852710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c19470-a90d-4a9a-9825-6be6ddec78e1 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-b9c19470-a90d-4a9a-9825-6be6ddec78e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:22.875394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:22.876393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:22.877261 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:22.877261 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:22.877261 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:22.877261 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:22.877974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 285/554] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:22.882365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70296b4d-c547-4373-9891-5583a357173d None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:22.882653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70296b4d-c547-4373-9891-5583a357173d None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:22.882933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70296b4d-c547-4373-9891-5583a357173d None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:22.884505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 286/555] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:22.885882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70296b4d-c547-4373-9891-5583a357173d None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:22.907969 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:22.947029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3548af-b618-474f-bbd6-6eba57690fc6 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:22.949187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:23.002716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c583a0e-a79e-479c-a974-379c31c9fec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:23.003782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c583a0e-a79e-479c-a974-379c31c9fec8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:23.004320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c583a0e-a79e-479c-a974-379c31c9fec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:23.004608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c583a0e-a79e-479c-a974-379c31c9fec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:23.007370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70296b4d-c547-4373-9891-5583a357173d None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:23.043433 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f15b9f-196f-44c2-a3ea-44c5954602fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:23.044116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f15b9f-196f-44c2-a3ea-44c5954602fb None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:23.044400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f15b9f-196f-44c2-a3ea-44c5954602fb None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:23.044680 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f15b9f-196f-44c2-a3ea-44c5954602fb None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:23.045436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f15b9f-196f-44c2-a3ea-44c5954602fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:23.045744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f15b9f-196f-44c2-a3ea-44c5954602fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:23.047190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f15b9f-196f-44c2-a3ea-44c5954602fb None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:23.065328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 287/556] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:23.066648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd41a13-c258-49c5-844c-d8ea92c6fb17 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:23.066934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd41a13-c258-49c5-844c-d8ea92c6fb17 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:23.067216 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd41a13-c258-49c5-844c-d8ea92c6fb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:23.085036 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-6bd41a13-c258-49c5-844c-d8ea92c6fb17 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:23.086334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6bd41a13-c258-49c5-844c-d8ea92c6fb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:23.090305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c583a0e-a79e-479c-a974-379c31c9fec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:23.092397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c583a0e-a79e-479c-a974-379c31c9fec8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:23.161597 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 288/557] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:23.162562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd41a13-c258-49c5-844c-d8ea92c6fb17 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:23.165020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:23.204203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 270/558] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:23.209891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c583a0e-a79e-479c-a974-379c31c9fec8 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:23.213044 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:23.282396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd41a13-c258-49c5-844c-d8ea92c6fb17 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:23.321607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b55576-4058-4f84-aca1-e94a1da5a7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:23.322336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b55576-4058-4f84-aca1-e94a1da5a7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:23.322615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b55576-4058-4f84-aca1-e94a1da5a7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:23.322889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b55576-4058-4f84-aca1-e94a1da5a7d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:23.324412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c583a0e-a79e-479c-a974-379c31c9fec8 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:23.333237 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b55576-4058-4f84-aca1-e94a1da5a7d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:23.334758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b55576-4058-4f84-aca1-e94a1da5a7d7 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-91b55576-4058-4f84-aca1-e94a1da5a7d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:23.351886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:23.353042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:23.354008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:23.354008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:23.354008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:23.354008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:23.354008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:23.354008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:23.354008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:23.354008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:23.354008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:07:23.354008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:23.354008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 289/559] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Jul 7 07:07:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:23.354605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b55576-4058-4f84-aca1-e94a1da5a7d7 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:23.368701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1f6f6-ff7b-4b4d-b382-77e7e6d05a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:23.370067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1f6f6-ff7b-4b4d-b382-77e7e6d05a3b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:23.370604 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1f6f6-ff7b-4b4d-b382-77e7e6d05a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:23.371081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1f6f6-ff7b-4b4d-b382-77e7e6d05a3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:23.383777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1f6f6-ff7b-4b4d-b382-77e7e6d05a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-41a1f6f6-ff7b-4b4d-b382-77e7e6d05a3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:23.392908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:23.393877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:23.394796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:23.394796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:23.394796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:23.394796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:23.394796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:23.394796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:23.394796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:23.394796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:23.394796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:23.394796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:23.394796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:23.394796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:23.397332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 271/560] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:23.398300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1f6f6-ff7b-4b4d-b382-77e7e6d05a3b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:23.429480 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:23.471358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b55576-4058-4f84-aca1-e94a1da5a7d7 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:23.472256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:23.509462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5f852-df3d-4413-9a0b-800e9519057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:23.511315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5f852-df3d-4413-9a0b-800e9519057b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:23.511533 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5f852-df3d-4413-9a0b-800e9519057b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:23.511903 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5f852-df3d-4413-9a0b-800e9519057b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:23.521678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1f6f6-ff7b-4b4d-b382-77e7e6d05a3b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:23.523524 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5f852-df3d-4413-9a0b-800e9519057b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:23.525328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5f852-df3d-4413-9a0b-800e9519057b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-31f5f852-df3d-4413-9a0b-800e9519057b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:23.544040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:23.545030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:23.546026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:23.546026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:23.546026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:23.546026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:23.546026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 290/561] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:23.546296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5f852-df3d-4413-9a0b-800e9519057b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:23.566876 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62345c94-58d7-41dc-bc03-2656f6caeb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:23.568216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62345c94-58d7-41dc-bc03-2656f6caeb30 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:23.568495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62345c94-58d7-41dc-bc03-2656f6caeb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:23.568765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62345c94-58d7-41dc-bc03-2656f6caeb30 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:23.569654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62345c94-58d7-41dc-bc03-2656f6caeb30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:23.569958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62345c94-58d7-41dc-bc03-2656f6caeb30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:23.572058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62345c94-58d7-41dc-bc03-2656f6caeb30 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:23.594647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 272/562] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Jul 7 07:07:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:23.596126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd6cf2-6d37-44a8-ad1e-084cf6addaac None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:23.596425 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd6cf2-6d37-44a8-ad1e-084cf6addaac None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:23.596707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd6cf2-6d37-44a8-ad1e-084cf6addaac None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:23.598219 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 273/563] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:23.601391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd6cf2-6d37-44a8-ad1e-084cf6addaac None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:23.671105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5f852-df3d-4413-9a0b-800e9519057b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:23.687495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:23.715690 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829e549-0858-4ba6-a423-7ade36779016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:23.716647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829e549-0858-4ba6-a423-7ade36779016 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:23.716931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829e549-0858-4ba6-a423-7ade36779016 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:23.717208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829e549-0858-4ba6-a423-7ade36779016 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:23.718011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829e549-0858-4ba6-a423-7ade36779016 None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:23.718323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829e549-0858-4ba6-a423-7ade36779016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:23.719758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829e549-0858-4ba6-a423-7ade36779016 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:23.728375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd6cf2-6d37-44a8-ad1e-084cf6addaac None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:23.729016 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 291/564] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:23.729924 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829e549-0858-4ba6-a423-7ade36779016 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:23.761182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:23.778606 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acc7ce-9767-4eea-8ec2-0312843dcac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:23.779764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acc7ce-9767-4eea-8ec2-0312843dcac0 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:23.780062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acc7ce-9767-4eea-8ec2-0312843dcac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:23.780349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acc7ce-9767-4eea-8ec2-0312843dcac0 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:23.781075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acc7ce-9767-4eea-8ec2-0312843dcac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:23.781758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acc7ce-9767-4eea-8ec2-0312843dcac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:23.783536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acc7ce-9767-4eea-8ec2-0312843dcac0 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:23.800885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 274/565] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:23.800885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53a5c-533c-4810-9d0f-8cb1ebc71372 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:23.800885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53a5c-533c-4810-9d0f-8cb1ebc71372 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:23.800885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53a5c-533c-4810-9d0f-8cb1ebc71372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:23.818047 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-14c53a5c-533c-4810-9d0f-8cb1ebc71372 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:23.819423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-14c53a5c-533c-4810-9d0f-8cb1ebc71372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:23.860519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829e549-0858-4ba6-a423-7ade36779016 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:23.896240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 275/566] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:23.897344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c53a5c-533c-4810-9d0f-8cb1ebc71372 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:23.900304 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceed3ff-b11e-4f78-b053-da6af51564fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:23.901112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceed3ff-b11e-4f78-b053-da6af51564fb None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:23.901455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceed3ff-b11e-4f78-b053-da6af51564fb None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:23.901669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceed3ff-b11e-4f78-b053-da6af51564fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:23.914711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceed3ff-b11e-4f78-b053-da6af51564fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:23.916425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceed3ff-b11e-4f78-b053-da6af51564fb None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-4ceed3ff-b11e-4f78-b053-da6af51564fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:23.934609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:23.935708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:23.936843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:23.936843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:23.936843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:23.936843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:23.936843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 292/567] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:23.936843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceed3ff-b11e-4f78-b053-da6af51564fb None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:23.981986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:24.010475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c53a5c-533c-4810-9d0f-8cb1ebc71372 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:24.021598 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:24.047844 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac8813-be8c-417a-af20-3e8c3099a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:24.048811 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac8813-be8c-417a-af20-3e8c3099a706 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.049090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac8813-be8c-417a-af20-3e8c3099a706 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.049408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac8813-be8c-417a-af20-3e8c3099a706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.061093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac8813-be8c-417a-af20-3e8c3099a706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:24.061343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceed3ff-b11e-4f78-b053-da6af51564fb None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:24.062638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac8813-be8c-417a-af20-3e8c3099a706 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-86ac8813-be8c-417a-af20-3e8c3099a706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:24.081141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:24.082286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:24.083221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:24.083221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:24.083221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:24.083221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:24.083221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 276/568] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:24.084163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87ec2-9cba-4f25-befc-c72a76a0e03e None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.084278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87ec2-9cba-4f25-befc-c72a76a0e03e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.084532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87ec2-9cba-4f25-befc-c72a76a0e03e None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.086080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 277/569] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:24.091240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb87ec2-9cba-4f25-befc-c72a76a0e03e None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:24.098332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a220f-8512-45b0-aef2-0ba625eb6ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:24.099142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a220f-8512-45b0-aef2-0ba625eb6ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.099420 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a220f-8512-45b0-aef2-0ba625eb6ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.099691 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a220f-8512-45b0-aef2-0ba625eb6ea8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.107033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a220f-8512-45b0-aef2-0ba625eb6ea8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:24.108496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a220f-8512-45b0-aef2-0ba625eb6ea8 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-f23a220f-8512-45b0-aef2-0ba625eb6ea8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:24.122962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:24.124031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:24.125110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:24.125110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:24.125110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:24.125110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:24.125110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:24.125110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:24.125110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:24.125110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:24.125110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 293/570] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:24.125110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a220f-8512-45b0-aef2-0ba625eb6ea8 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:24.208741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb87ec2-9cba-4f25-befc-c72a76a0e03e None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:24.220245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:24.232217 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a220f-8512-45b0-aef2-0ba625eb6ea8 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:24.242898 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225518d-e7fd-4e33-af5a-fc22a5f6851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:24.243900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225518d-e7fd-4e33-af5a-fc22a5f6851e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.244182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225518d-e7fd-4e33-af5a-fc22a5f6851e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.244464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225518d-e7fd-4e33-af5a-fc22a5f6851e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.254513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225518d-e7fd-4e33-af5a-fc22a5f6851e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-3225518d-e7fd-4e33-af5a-fc22a5f6851e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:24.262246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:24.263297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:24.264141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 278/571] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:24.264915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225518d-e7fd-4e33-af5a-fc22a5f6851e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:24.272742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a5d64-cead-4a71-8612-0bb16cd1b458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:24.273456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a5d64-cead-4a71-8612-0bb16cd1b458 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.273741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a5d64-cead-4a71-8612-0bb16cd1b458 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.274017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a5d64-cead-4a71-8612-0bb16cd1b458 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.274807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a5d64-cead-4a71-8612-0bb16cd1b458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:24.275112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a5d64-cead-4a71-8612-0bb16cd1b458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:24.276500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a5d64-cead-4a71-8612-0bb16cd1b458 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:24.293784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 294/572] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:24.295096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775bc1f-23c9-49b2-985f-8de9c2c1fe88 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.295441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775bc1f-23c9-49b2-985f-8de9c2c1fe88 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.295777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775bc1f-23c9-49b2-985f-8de9c2c1fe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.299438 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:24.312606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-1775bc1f-23c9-49b2-985f-8de9c2c1fe88 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:24.313826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1775bc1f-23c9-49b2-985f-8de9c2c1fe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:24.378997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225518d-e7fd-4e33-af5a-fc22a5f6851e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:24.383644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 295/573] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:24.384315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775bc1f-23c9-49b2-985f-8de9c2c1fe88 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:24.416028 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708f60d-4684-4a51-8abe-12163134d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:24.416711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708f60d-4684-4a51-8abe-12163134d85f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.416993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708f60d-4684-4a51-8abe-12163134d85f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.417304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708f60d-4684-4a51-8abe-12163134d85f None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.418061 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708f60d-4684-4a51-8abe-12163134d85f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:24.418382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708f60d-4684-4a51-8abe-12163134d85f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:24.419743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708f60d-4684-4a51-8abe-12163134d85f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:24.431670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 279/574] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:24.432488 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708f60d-4684-4a51-8abe-12163134d85f None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:24.480814 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:24.503653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775bc1f-23c9-49b2-985f-8de9c2c1fe88 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:24.514256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:24.537589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708f60d-4684-4a51-8abe-12163134d85f None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:24.544300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cb54e-eec2-4003-be7f-598077fc7bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:24.544939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cb54e-eec2-4003-be7f-598077fc7bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.545183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cb54e-eec2-4003-be7f-598077fc7bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.545491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cb54e-eec2-4003-be7f-598077fc7bb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.546306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cb54e-eec2-4003-be7f-598077fc7bb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:24.546617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cb54e-eec2-4003-be7f-598077fc7bb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:24.548086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cb54e-eec2-4003-be7f-598077fc7bb5 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:24.560115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 296/575] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:24.560932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cb54e-eec2-4003-be7f-598077fc7bb5 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:24.577173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a22ae7-8374-4401-b949-fa624e308ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:24.577891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22ae7-8374-4401-b949-fa624e308ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.578173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22ae7-8374-4401-b949-fa624e308ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.578449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22ae7-8374-4401-b949-fa624e308ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.579207 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a22ae7-8374-4401-b949-fa624e308ae1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:24.579516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a22ae7-8374-4401-b949-fa624e308ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:24.580894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a22ae7-8374-4401-b949-fa624e308ae1 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:24.589285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 280/576] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:24.594033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a22ae7-8374-4401-b949-fa624e308ae1 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:24.659190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cb54e-eec2-4003-be7f-598077fc7bb5 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:24.690726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a22ae7-8374-4401-b949-fa624e308ae1 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:24.693126 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3051b-26a8-434a-a6a6-bbfce487e27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:24.693957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3051b-26a8-434a-a6a6-bbfce487e27c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.694235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3051b-26a8-434a-a6a6-bbfce487e27c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.694511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3051b-26a8-434a-a6a6-bbfce487e27c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.701393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3051b-26a8-434a-a6a6-bbfce487e27c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:24.702845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3051b-26a8-434a-a6a6-bbfce487e27c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:24.704797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-fce3051b-26a8-434a-a6a6-bbfce487e27c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:24.718504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:24.719477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:24.720335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:24.720335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:24.720335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:24.720335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:24.720335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:24.720335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:24.720335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:24.720335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:24.720335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 297/577] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:24.720913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3051b-26a8-434a-a6a6-bbfce487e27c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:24.727213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99205828-38d4-4eca-8cf1-8b76b0ac9823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:24.728123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99205828-38d4-4eca-8cf1-8b76b0ac9823 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.728399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99205828-38d4-4eca-8cf1-8b76b0ac9823 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.728669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99205828-38d4-4eca-8cf1-8b76b0ac9823 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.738856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99205828-38d4-4eca-8cf1-8b76b0ac9823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-99205828-38d4-4eca-8cf1-8b76b0ac9823 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:24.746515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:24.747629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:24.748635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:24.748635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:24.748635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:24.748635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:24.748635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:24.748635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:24.748635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:24.748635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:24.748635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:24.748635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:24.748635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:24.748635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:24.752656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 281/578] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:24.753423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99205828-38d4-4eca-8cf1-8b76b0ac9823 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:24.757625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:24.820838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3051b-26a8-434a-a6a6-bbfce487e27c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:24.856946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99205828-38d4-4eca-8cf1-8b76b0ac9823 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:24.857671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd484a-a5f2-4a6e-a82b-467890f94226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:24.858086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd484a-a5f2-4a6e-a82b-467890f94226 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.858394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd484a-a5f2-4a6e-a82b-467890f94226 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.858671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd484a-a5f2-4a6e-a82b-467890f94226 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.866410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd484a-a5f2-4a6e-a82b-467890f94226 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:24.867931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd484a-a5f2-4a6e-a82b-467890f94226 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-f4dd484a-a5f2-4a6e-a82b-467890f94226 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:24.887633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:24.888773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:24.889743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:24.889743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:24.889743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:24.889743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:24.889743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:24.889743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:24.889743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:24.889743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:24.889743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 07 07:07:24.889743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:24.889743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 298/579] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:24.889743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd484a-a5f2-4a6e-a82b-467890f94226 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:24.898258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815a559-0a79-472e-be19-d9e86fbe028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:24.898959 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815a559-0a79-472e-be19-d9e86fbe028f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:24.899242 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815a559-0a79-472e-be19-d9e86fbe028f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:24.899519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815a559-0a79-472e-be19-d9e86fbe028f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:24.900374 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815a559-0a79-472e-be19-d9e86fbe028f None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=16f8303298b04e009e22ea05ba24a3c5) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:24.900671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815a559-0a79-472e-be19-d9e86fbe028f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:24.902403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815a559-0a79-472e-be19-d9e86fbe028f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:24.907892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 282/580] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:24 2022] GET /identity/v3/role_assignments?user.id=16f8303298b04e009e22ea05ba24a3c5&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:24.908678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815a559-0a79-472e-be19-d9e86fbe028f None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:24.956489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:24.988492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:25.007856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd484a-a5f2-4a6e-a82b-467890f94226 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:25.025341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815a559-0a79-472e-be19-d9e86fbe028f None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:25.049555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e895d8-21e7-41ee-896e-131279cec4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:25.050492 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e895d8-21e7-41ee-896e-131279cec4ab None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:25.050792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e895d8-21e7-41ee-896e-131279cec4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:25.051067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e895d8-21e7-41ee-896e-131279cec4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:25.062705 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120571d-e746-4e54-b3c9-e432c7e7d141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:25.063334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e895d8-21e7-41ee-896e-131279cec4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:25.063443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120571d-e746-4e54-b3c9-e432c7e7d141 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:25.063657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120571d-e746-4e54-b3c9-e432c7e7d141 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:25.063932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120571d-e746-4e54-b3c9-e432c7e7d141 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:25.064755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120571d-e746-4e54-b3c9-e432c7e7d141 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:25.064852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e895d8-21e7-41ee-896e-131279cec4ab None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:25.065070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120571d-e746-4e54-b3c9-e432c7e7d141 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:25.066532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120571d-e746-4e54-b3c9-e432c7e7d141 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-b3e895d8-21e7-41ee-896e-131279cec4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:25.084664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:25.085942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:25.086904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:25.086904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:25.086904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:25.086904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:25.086904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 299/581] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:25.087213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e895d8-21e7-41ee-896e-131279cec4ab None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:25.092955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 283/582] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:25.094203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120571d-e746-4e54-b3c9-e432c7e7d141 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:25.193438 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e895d8-21e7-41ee-896e-131279cec4ab None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:25.205003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:25.210030 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120571d-e746-4e54-b3c9-e432c7e7d141 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:25.230258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5ba71-1a2e-40aa-96ea-2ddc31b74af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:25.230937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5ba71-1a2e-40aa-96ea-2ddc31b74af1 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:25.231217 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5ba71-1a2e-40aa-96ea-2ddc31b74af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:25.231488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5ba71-1a2e-40aa-96ea-2ddc31b74af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:25.232246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5ba71-1a2e-40aa-96ea-2ddc31b74af1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:25.232545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5ba71-1a2e-40aa-96ea-2ddc31b74af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:25.233983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5ba71-1a2e-40aa-96ea-2ddc31b74af1 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:25.239035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:25.243808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 300/583] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:25.244479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5ba71-1a2e-40aa-96ea-2ddc31b74af1 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:25.250710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380115b4-6591-4527-b099-ed46cfc175d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:25.251413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380115b4-6591-4527-b099-ed46cfc175d2 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:25.251704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380115b4-6591-4527-b099-ed46cfc175d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:25.251988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380115b4-6591-4527-b099-ed46cfc175d2 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:25.253405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380115b4-6591-4527-b099-ed46cfc175d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:25.253738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380115b4-6591-4527-b099-ed46cfc175d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:25.255216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380115b4-6591-4527-b099-ed46cfc175d2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:25.274471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 284/584] 10.222.0.62 () {56 vars in 1137 bytes} [Thu Jul 7 07:07:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:25.275420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380115b4-6591-4527-b099-ed46cfc175d2 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:25.353794 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5ba71-1a2e-40aa-96ea-2ddc31b74af1 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:25.386359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380115b4-6591-4527-b099-ed46cfc175d2 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:25.388688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4433b4-3010-4a74-adab-55ee24e60d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:25.389634 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4433b4-3010-4a74-adab-55ee24e60d70 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:25.390083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4433b4-3010-4a74-adab-55ee24e60d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:25.390526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4433b4-3010-4a74-adab-55ee24e60d70 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:25.391436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4433b4-3010-4a74-adab-55ee24e60d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:25.391984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4433b4-3010-4a74-adab-55ee24e60d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:25.393463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4433b4-3010-4a74-adab-55ee24e60d70 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:25.408658 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 301/585] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:25.409709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4433b4-3010-4a74-adab-55ee24e60d70 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:25.429872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c45a3-3d65-4f10-a76b-214dc4f6b87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:25.430808 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c45a3-3d65-4f10-a76b-214dc4f6b87d None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:25.431092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c45a3-3d65-4f10-a76b-214dc4f6b87d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:25.431367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c45a3-3d65-4f10-a76b-214dc4f6b87d None admin] PATH_INFO: `/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/42acdb53c342401da6b32be6b9f3d030/roles/bc1cedb3c00f446dbe9f7c756a01d28a` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:25.447251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c45a3-3d65-4f10-a76b-214dc4f6b87d None admin] RBAC: Authorizing `identity:create_grant(project_id=2d7163b6caf648d89fd2cd48f27b1a23, user_id=42acdb53c342401da6b32be6b9f3d030, role_id=bc1cedb3c00f446dbe9f7c756a01d28a)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:25.448815 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c45a3-3d65-4f10-a76b-214dc4f6b87d None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:25.449999 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:25.473357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 285/586] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:07:25 2022] PUT /identity/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/42acdb53c342401da6b32be6b9f3d030/roles/bc1cedb3c00f446dbe9f7c756a01d28a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:07:25.473357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c45a3-3d65-4f10-a76b-214dc4f6b87d None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:25.524858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:25.553851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4433b4-3010-4a74-adab-55ee24e60d70 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:25.594847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fe10-e56f-49ed-be2e-3410468bc5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:25.595819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fe10-e56f-49ed-be2e-3410468bc5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:25.596177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fe10-e56f-49ed-be2e-3410468bc5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:25.596525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fe10-e56f-49ed-be2e-3410468bc5b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:25.608923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10fe10-e56f-49ed-be2e-3410468bc5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:25.610571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10fe10-e56f-49ed-be2e-3410468bc5b0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:25.624468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c45a3-3d65-4f10-a76b-214dc4f6b87d None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-5b10fe10-e56f-49ed-be2e-3410468bc5b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:25.630297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:25.631267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:25.632105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:25.632105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:25.632105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:25.632105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:25.632328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 302/587] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:25.637248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fe10-e56f-49ed-be2e-3410468bc5b0 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:25.673486 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4d2ff-e3be-4130-850b-23db28d59457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:25.674302 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4d2ff-e3be-4130-850b-23db28d59457 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:25.674587 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4d2ff-e3be-4130-850b-23db28d59457 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:25.674861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4d2ff-e3be-4130-850b-23db28d59457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:25.688216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4d2ff-e3be-4130-850b-23db28d59457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:25.689895 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4d2ff-e3be-4130-850b-23db28d59457 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-f3a4d2ff-e3be-4130-850b-23db28d59457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:25.709514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:25.710534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:25.711396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:25.711396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:25.711396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:25.711396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:25.711396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 286/588] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:25.712040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4d2ff-e3be-4130-850b-23db28d59457 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:25.744643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:25.767787 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fe10-e56f-49ed-be2e-3410468bc5b0 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:25.812042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:25.816682 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32218cd-ca19-455f-b161-f35bee353064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:25.818367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32218cd-ca19-455f-b161-f35bee353064 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:25.818799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32218cd-ca19-455f-b161-f35bee353064 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:25.819350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32218cd-ca19-455f-b161-f35bee353064 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:25.825992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4d2ff-e3be-4130-850b-23db28d59457 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:25.829923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32218cd-ca19-455f-b161-f35bee353064 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:25.831583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32218cd-ca19-455f-b161-f35bee353064 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-b32218cd-ca19-455f-b161-f35bee353064 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:25.851178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:25.852373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:25.853571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:25.853571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:25.853571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:25.853571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:25.853571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:25.853571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:25.853571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:25.853571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:25.853571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 07:07:25.853571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:25.856280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 303/589] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:25.858022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32218cd-ca19-455f-b161-f35bee353064 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:25.865501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02fd5c-62d7-4a76-aa20-f75748f249d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:25.866325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02fd5c-62d7-4a76-aa20-f75748f249d2 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:25.866696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02fd5c-62d7-4a76-aa20-f75748f249d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:25.867062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02fd5c-62d7-4a76-aa20-f75748f249d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:25.867887 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02fd5c-62d7-4a76-aa20-f75748f249d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:25.868457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02fd5c-62d7-4a76-aa20-f75748f249d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:25.870173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02fd5c-62d7-4a76-aa20-f75748f249d2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:25.887871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 287/590] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:25.887871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02fd5c-62d7-4a76-aa20-f75748f249d2 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:25.986469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32218cd-ca19-455f-b161-f35bee353064 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:25.998224 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02fd5c-62d7-4a76-aa20-f75748f249d2 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:26.024550 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cbea2-c6a8-4b0a-9927-4002604cd89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:26.025555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cbea2-c6a8-4b0a-9927-4002604cd89e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:26.026110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cbea2-c6a8-4b0a-9927-4002604cd89e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:26.026573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cbea2-c6a8-4b0a-9927-4002604cd89e None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:26.027660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cbea2-c6a8-4b0a-9927-4002604cd89e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:26.028154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cbea2-c6a8-4b0a-9927-4002604cd89e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:26.029879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cbea2-c6a8-4b0a-9927-4002604cd89e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:26.035381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36180b-7777-4b25-8ce7-91aa2857507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:26.036160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36180b-7777-4b25-8ce7-91aa2857507a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:26.036507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36180b-7777-4b25-8ce7-91aa2857507a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:26.036846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36180b-7777-4b25-8ce7-91aa2857507a None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:26.037829 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36180b-7777-4b25-8ce7-91aa2857507a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:26.038201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36180b-7777-4b25-8ce7-91aa2857507a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:26.040114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36180b-7777-4b25-8ce7-91aa2857507a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:26.044696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 304/591] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:26.045819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cbea2-c6a8-4b0a-9927-4002604cd89e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:26.057580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:26.066415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 288/592] 10.222.0.62 () {56 vars in 1137 bytes} [Thu Jul 7 07:07:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:26.068164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36180b-7777-4b25-8ce7-91aa2857507a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:26.080735 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:26.178727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cbea2-c6a8-4b0a-9927-4002604cd89e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:26.202937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36180b-7777-4b25-8ce7-91aa2857507a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:26.219831 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae5079-8646-413d-b991-80763877bdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:26.221312 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae5079-8646-413d-b991-80763877bdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:26.221920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae5079-8646-413d-b991-80763877bdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:26.222354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae5079-8646-413d-b991-80763877bdd8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:26.232327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae5079-8646-413d-b991-80763877bdd8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:26.234627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae5079-8646-413d-b991-80763877bdd8 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:26.245690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3aca66-a569-460d-99cf-7738b486b0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:26.246535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3aca66-a569-460d-99cf-7738b486b0cf None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:26.246821 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3aca66-a569-460d-99cf-7738b486b0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:26.247101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3aca66-a569-460d-99cf-7738b486b0cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-a9ae5079-8646-413d-b991-80763877bdd8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:26.251981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:26.253073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:26.254219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:26.254219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:26.254219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:26.254219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:26.254219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:26.254219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:26.254219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:26.254219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:26.254219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 07 07:07:26.254219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:26.254728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3aca66-a569-460d-99cf-7738b486b0cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:26.255774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3aca66-a569-460d-99cf-7738b486b0cf None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:26.256677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 305/593] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:26.257732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae5079-8646-413d-b991-80763877bdd8 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-2e3aca66-a569-460d-99cf-7738b486b0cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:26.281626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:26.282585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:26.283483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:26.283483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:26.283483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:26.283483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:26.283483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:26.283483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:26.283483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:26.283483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:26.283483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 289/594] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:26.284427 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3aca66-a569-460d-99cf-7738b486b0cf None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:26.337546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:26.360569 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:26.385041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae5079-8646-413d-b991-80763877bdd8 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:26.405181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3aca66-a569-460d-99cf-7738b486b0cf None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:26.424761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6201e6-3b58-4cdc-be61-a2f8b38026cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:26.426128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6201e6-3b58-4cdc-be61-a2f8b38026cc None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:26.426605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6201e6-3b58-4cdc-be61-a2f8b38026cc None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:26.427087 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6201e6-3b58-4cdc-be61-a2f8b38026cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:26.439226 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6201e6-3b58-4cdc-be61-a2f8b38026cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:26.440493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd5065-7aa8-4a01-ace5-5c2d1c6d4773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:26.441153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd5065-7aa8-4a01-ace5-5c2d1c6d4773 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:26.441493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd5065-7aa8-4a01-ace5-5c2d1c6d4773 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:26.441596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6201e6-3b58-4cdc-be61-a2f8b38026cc None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:26.441770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd5065-7aa8-4a01-ace5-5c2d1c6d4773 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:26.443141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd5065-7aa8-4a01-ace5-5c2d1c6d4773 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:26.443458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd5065-7aa8-4a01-ace5-5c2d1c6d4773 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:26.444994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd5065-7aa8-4a01-ace5-5c2d1c6d4773 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-1c6201e6-3b58-4cdc-be61-a2f8b38026cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:26.461669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:26.462666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:26.463515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:26.463515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:26.463515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:26.463515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:26.469917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 290/596] 10.222.0.62 () {56 vars in 1139 bytes} [Thu Jul 7 07:07:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:26.469917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd5065-7aa8-4a01-ace5-5c2d1c6d4773 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:26.470257 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 306/596] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:26.471360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6201e6-3b58-4cdc-be61-a2f8b38026cc None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:26.570980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd5065-7aa8-4a01-ace5-5c2d1c6d4773 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:26.581987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6201e6-3b58-4cdc-be61-a2f8b38026cc None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:26.596012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:26.603601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:26.607173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6972c4-1c44-41e0-a932-5947fc1d0cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:26.607798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6972c4-1c44-41e0-a932-5947fc1d0cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:26.608091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6972c4-1c44-41e0-a932-5947fc1d0cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:26.608371 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6972c4-1c44-41e0-a932-5947fc1d0cb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:26.609196 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6972c4-1c44-41e0-a932-5947fc1d0cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:26.609549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6972c4-1c44-41e0-a932-5947fc1d0cb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:26.611349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6972c4-1c44-41e0-a932-5947fc1d0cb8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:26.623958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 291/597] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:26.624976 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6972c4-1c44-41e0-a932-5947fc1d0cb8 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:26.627115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbaca-e016-4254-97e0-f8c9547d4005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:26.628325 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbaca-e016-4254-97e0-f8c9547d4005 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:26.628929 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbaca-e016-4254-97e0-f8c9547d4005 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:26.629436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbaca-e016-4254-97e0-f8c9547d4005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:26.642038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cbaca-e016-4254-97e0-f8c9547d4005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:26.643961 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cbaca-e016-4254-97e0-f8c9547d4005 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-4e6cbaca-e016-4254-97e0-f8c9547d4005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:26.664840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:26.666121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:26.667093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:26.667093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:26.667093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:26.667093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:26.669507 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 307/598] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:26.670539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbaca-e016-4254-97e0-f8c9547d4005 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:26.737440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6972c4-1c44-41e0-a932-5947fc1d0cb8 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:26.771885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2052a-48be-4afa-bd76-7ce1eb113c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:26.772581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2052a-48be-4afa-bd76-7ce1eb113c02 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:26.772835 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2052a-48be-4afa-bd76-7ce1eb113c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:26.773117 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2052a-48be-4afa-bd76-7ce1eb113c02 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:26.773892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2052a-48be-4afa-bd76-7ce1eb113c02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:26.774218 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2052a-48be-4afa-bd76-7ce1eb113c02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:26.775672 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2052a-48be-4afa-bd76-7ce1eb113c02 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:26.782703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbaca-e016-4254-97e0-f8c9547d4005 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:26.792555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 292/599] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:26.792555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2052a-48be-4afa-bd76-7ce1eb113c02 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:26.825654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d727a2-1a28-427f-bc73-510bbcda8ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:26.826973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d727a2-1a28-427f-bc73-510bbcda8ebf None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:26.827449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d727a2-1a28-427f-bc73-510bbcda8ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:26.827975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d727a2-1a28-427f-bc73-510bbcda8ebf None admin] PATH_INFO: `/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/3a6af41d833941debd6afcecd952af0f/roles/bc1cedb3c00f446dbe9f7c756a01d28a` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:26.836623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:26.846986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d727a2-1a28-427f-bc73-510bbcda8ebf None admin] RBAC: Authorizing `identity:create_grant(project_id=2d7163b6caf648d89fd2cd48f27b1a23, user_id=3a6af41d833941debd6afcecd952af0f, role_id=bc1cedb3c00f446dbe9f7c756a01d28a)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:26.849010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d727a2-1a28-427f-bc73-510bbcda8ebf None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:26.866346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 308/600] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:07:26 2022] PUT /identity/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/3a6af41d833941debd6afcecd952af0f/roles/bc1cedb3c00f446dbe9f7c756a01d28a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:07:26.867580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d727a2-1a28-427f-bc73-510bbcda8ebf None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:26.892682 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:26.913750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2052a-48be-4afa-bd76-7ce1eb113c02 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:26.967192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d7ee8-d292-4c89-9e0a-d8dcb7623553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:26.968863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d7ee8-d292-4c89-9e0a-d8dcb7623553 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:26.969671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d7ee8-d292-4c89-9e0a-d8dcb7623553 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:26.970152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d7ee8-d292-4c89-9e0a-d8dcb7623553 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:26.971388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d7ee8-d292-4c89-9e0a-d8dcb7623553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:26.972304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d7ee8-d292-4c89-9e0a-d8dcb7623553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:26.973972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d7ee8-d292-4c89-9e0a-d8dcb7623553 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:26.988331 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d727a2-1a28-427f-bc73-510bbcda8ebf None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:26.992359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 293/601] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:26.994301 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fae8c-9949-405c-b55e-5bad00947ce8 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:26.994841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fae8c-9949-405c-b55e-5bad00947ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:26.995309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fae8c-9949-405c-b55e-5bad00947ce8 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:26.997194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 294/602] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:27.000223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fae8c-9949-405c-b55e-5bad00947ce8 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:27.031456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439331a6-23ed-4813-9677-6aecf5c915e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:27.032290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439331a6-23ed-4813-9677-6aecf5c915e5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:27.032571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439331a6-23ed-4813-9677-6aecf5c915e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:27.032851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439331a6-23ed-4813-9677-6aecf5c915e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:27.040766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439331a6-23ed-4813-9677-6aecf5c915e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:27.042316 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439331a6-23ed-4813-9677-6aecf5c915e5 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-439331a6-23ed-4813-9677-6aecf5c915e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:27.057594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:27.058557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:27.059453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:27.059453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:27.059453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:27.059453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:27.059453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:27.059453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:27.059453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:27.059453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:27.059453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 309/603] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:27.060444 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e3d87-8727-4e3a-83da-eca3e11531e1 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:27.060444 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e3d87-8727-4e3a-83da-eca3e11531e1 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:27.060726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e3d87-8727-4e3a-83da-eca3e11531e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:27.079410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-482e3d87-8727-4e3a-83da-eca3e11531e1 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:27.080551 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-482e3d87-8727-4e3a-83da-eca3e11531e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:27.137136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fae8c-9949-405c-b55e-5bad00947ce8 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:27.139799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:27.168105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 310/604] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:27.169447 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e3d87-8727-4e3a-83da-eca3e11531e1 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:27.177632 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c010557-9f94-4097-accd-acf5f1ab88a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:27.178577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010557-9f94-4097-accd-acf5f1ab88a5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:27.178954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010557-9f94-4097-accd-acf5f1ab88a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:27.179325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010557-9f94-4097-accd-acf5f1ab88a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:27.187138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c010557-9f94-4097-accd-acf5f1ab88a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:27.187643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:27.188891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c010557-9f94-4097-accd-acf5f1ab88a5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-8c010557-9f94-4097-accd-acf5f1ab88a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:27.204275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:27.205501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:27.206678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:27.206678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:27.206678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:27.206678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:27.206678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:27.206678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:27.206678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:27.206678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:27.208501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 295/605] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:27.210975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c010557-9f94-4097-accd-acf5f1ab88a5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:27.301098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e3d87-8727-4e3a-83da-eca3e11531e1 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:27.325535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c010557-9f94-4097-accd-acf5f1ab88a5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:27.347661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411ad95-b10e-4436-87d3-5d67aec4b358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:27.348260 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411ad95-b10e-4436-87d3-5d67aec4b358 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:27.348544 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411ad95-b10e-4436-87d3-5d67aec4b358 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:27.348823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411ad95-b10e-4436-87d3-5d67aec4b358 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:27.350219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411ad95-b10e-4436-87d3-5d67aec4b358 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:27.350535 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411ad95-b10e-4436-87d3-5d67aec4b358 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:27.352264 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411ad95-b10e-4436-87d3-5d67aec4b358 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:27.364671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc0cdd-d5f5-4ef1-a1eb-f343be1946e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:27.365656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc0cdd-d5f5-4ef1-a1eb-f343be1946e7 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:27.366025 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc0cdd-d5f5-4ef1-a1eb-f343be1946e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:27.366386 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc0cdd-d5f5-4ef1-a1eb-f343be1946e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:27.367880 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 311/606] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:27.369164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411ad95-b10e-4436-87d3-5d67aec4b358 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:27.379059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc0cdd-d5f5-4ef1-a1eb-f343be1946e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-4cdc0cdd-d5f5-4ef1-a1eb-f343be1946e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:27.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:27.389749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 296/607] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:27.391751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc0cdd-d5f5-4ef1-a1eb-f343be1946e7 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:27.426681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:27.457805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:27.503372 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411ad95-b10e-4436-87d3-5d67aec4b358 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:27.521268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc0cdd-d5f5-4ef1-a1eb-f343be1946e7 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:27.549898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675421b-4546-46f9-b498-c8514a0f8baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:27.550586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675421b-4546-46f9-b498-c8514a0f8baa None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:27.551117 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675421b-4546-46f9-b498-c8514a0f8baa None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:27.551409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675421b-4546-46f9-b498-c8514a0f8baa None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:27.552216 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675421b-4546-46f9-b498-c8514a0f8baa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:27.552530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675421b-4546-46f9-b498-c8514a0f8baa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:27.554900 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675421b-4546-46f9-b498-c8514a0f8baa None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:27.562379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c64790-b2d4-4152-a7ec-b3154a638bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:27.563836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c64790-b2d4-4152-a7ec-b3154a638bd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:27.564315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c64790-b2d4-4152-a7ec-b3154a638bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:27.564797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c64790-b2d4-4152-a7ec-b3154a638bd2 None admin] PATH_INFO: `/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/af7af6f0c53d4c599f5dd80150b4a22e/roles/bc1cedb3c00f446dbe9f7c756a01d28a` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:27.572870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 312/608] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:27.574455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675421b-4546-46f9-b498-c8514a0f8baa None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:27.586853 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c64790-b2d4-4152-a7ec-b3154a638bd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d7163b6caf648d89fd2cd48f27b1a23, user_id=af7af6f0c53d4c599f5dd80150b4a22e, role_id=bc1cedb3c00f446dbe9f7c756a01d28a)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:27.588739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c64790-b2d4-4152-a7ec-b3154a638bd2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:27.607448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 297/609] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:07:27 2022] PUT /identity/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/af7af6f0c53d4c599f5dd80150b4a22e/roles/bc1cedb3c00f446dbe9f7c756a01d28a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:07:27.608752 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c64790-b2d4-4152-a7ec-b3154a638bd2 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:27.696316 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675421b-4546-46f9-b498-c8514a0f8baa None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:27.699258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:27.731876 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:27.733026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c64790-b2d4-4152-a7ec-b3154a638bd2 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:27.741166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f93513-ca26-4d52-9f3b-43b634606406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:27.742151 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f93513-ca26-4d52-9f3b-43b634606406 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:27.742618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f93513-ca26-4d52-9f3b-43b634606406 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:27.743098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f93513-ca26-4d52-9f3b-43b634606406 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:27.744175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f93513-ca26-4d52-9f3b-43b634606406 None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:27.744638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f93513-ca26-4d52-9f3b-43b634606406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:27.746296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f93513-ca26-4d52-9f3b-43b634606406 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:27.756829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 313/610] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:27.758564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde00cbb-b05e-4ded-a467-ee85d2db4193 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:27.759076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde00cbb-b05e-4ded-a467-ee85d2db4193 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:27.759498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde00cbb-b05e-4ded-a467-ee85d2db4193 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:27.761496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 314/611] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:27.762455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde00cbb-b05e-4ded-a467-ee85d2db4193 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:27.776777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611fc4e-ab4f-4e5b-b862-68c620540971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:27.778051 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611fc4e-ab4f-4e5b-b862-68c620540971 None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:27.778437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611fc4e-ab4f-4e5b-b862-68c620540971 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:27.778799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611fc4e-ab4f-4e5b-b862-68c620540971 None admin] PATH_INFO: `/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/4d0c6b46b5d248e5bed2b1bbdfa74f59/roles/bc1cedb3c00f446dbe9f7c756a01d28a` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:27.798434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611fc4e-ab4f-4e5b-b862-68c620540971 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d7163b6caf648d89fd2cd48f27b1a23, user_id=4d0c6b46b5d248e5bed2b1bbdfa74f59, role_id=bc1cedb3c00f446dbe9f7c756a01d28a)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:27.800478 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611fc4e-ab4f-4e5b-b862-68c620540971 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:27.817160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 298/612] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:07:27 2022] PUT /identity/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/4d0c6b46b5d248e5bed2b1bbdfa74f59/roles/bc1cedb3c00f446dbe9f7c756a01d28a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:07:27.825254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570439af-f9ff-4e8b-b134-4a5ceb69b3aa None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:27.825254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570439af-f9ff-4e8b-b134-4a5ceb69b3aa None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:27.825254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570439af-f9ff-4e8b-b134-4a5ceb69b3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:27.840936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-570439af-f9ff-4e8b-b134-4a5ceb69b3aa None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:27.842331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-570439af-f9ff-4e8b-b134-4a5ceb69b3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:27.909712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde00cbb-b05e-4ded-a467-ee85d2db4193 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:27.940611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 299/613] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:27.964557 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570439af-f9ff-4e8b-b134-4a5ceb69b3aa None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:27.969798 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288e0d9-1d6b-4b88-90f8-0c7409b1c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:27.970743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288e0d9-1d6b-4b88-90f8-0c7409b1c487 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:27.971021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288e0d9-1d6b-4b88-90f8-0c7409b1c487 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:27.971293 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288e0d9-1d6b-4b88-90f8-0c7409b1c487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:27.992759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288e0d9-1d6b-4b88-90f8-0c7409b1c487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:27.994428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288e0d9-1d6b-4b88-90f8-0c7409b1c487 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-0288e0d9-1d6b-4b88-90f8-0c7409b1c487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:28.024735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:28.025827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:28.026777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:28.026777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:28.026777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:28.026777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:28.029606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 315/614] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:28.031976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288e0d9-1d6b-4b88-90f8-0c7409b1c487 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:28.054826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:28.092283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:28.122213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570439af-f9ff-4e8b-b134-4a5ceb69b3aa None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:28.161560 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb2d8e-4f8c-4018-9c5a-f3fd4dda5637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:28.162884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb2d8e-4f8c-4018-9c5a-f3fd4dda5637 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:28.163391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb2d8e-4f8c-4018-9c5a-f3fd4dda5637 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:28.163950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb2d8e-4f8c-4018-9c5a-f3fd4dda5637 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:28.164636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288e0d9-1d6b-4b88-90f8-0c7409b1c487 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:28.176806 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb2d8e-4f8c-4018-9c5a-f3fd4dda5637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-a8eb2d8e-4f8c-4018-9c5a-f3fd4dda5637 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:28.185993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:28.187072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:28.187927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:28.187927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:28.187927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:28.187927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:28.187927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:28.187927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:28.187927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:28.187927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:28.187927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:28.187927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:28.187927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:28.187927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:28.192310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 300/615] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:28.198626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb2d8e-4f8c-4018-9c5a-f3fd4dda5637 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:28.203075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06c400-2e4a-458f-8383-b327fcfec682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:28.203769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06c400-2e4a-458f-8383-b327fcfec682 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:28.204054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06c400-2e4a-458f-8383-b327fcfec682 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:28.204329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06c400-2e4a-458f-8383-b327fcfec682 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:28.205062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06c400-2e4a-458f-8383-b327fcfec682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:28.205395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06c400-2e4a-458f-8383-b327fcfec682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:28.206832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06c400-2e4a-458f-8383-b327fcfec682 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:28.222505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 316/616] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:28.234389 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06c400-2e4a-458f-8383-b327fcfec682 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:28.321462 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb2d8e-4f8c-4018-9c5a-f3fd4dda5637 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:28.348885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:28.380230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06c400-2e4a-458f-8383-b327fcfec682 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:28.383890 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:28.406366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f2414-cdf0-4bb8-99e5-0b4c17b70aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:28.407492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f2414-cdf0-4bb8-99e5-0b4c17b70aec None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:28.407987 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f2414-cdf0-4bb8-99e5-0b4c17b70aec None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:28.408481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f2414-cdf0-4bb8-99e5-0b4c17b70aec None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:28.410216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f2414-cdf0-4bb8-99e5-0b4c17b70aec None admin] RBAC: Adding query filter params (name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:28.410547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f2414-cdf0-4bb8-99e5-0b4c17b70aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:28.412878 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f2414-cdf0-4bb8-99e5-0b4c17b70aec None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:28.450034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 301/617] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:28.456018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f2414-cdf0-4bb8-99e5-0b4c17b70aec None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:28.473574 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc8cdb-ff02-4871-88e8-2381e2785ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:28.475515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8cdb-ff02-4871-88e8-2381e2785ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:28.476401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8cdb-ff02-4871-88e8-2381e2785ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:28.477463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8cdb-ff02-4871-88e8-2381e2785ce9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:28.492637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc8cdb-ff02-4871-88e8-2381e2785ce9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:28.496161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc8cdb-ff02-4871-88e8-2381e2785ce9 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-c5fc8cdb-ff02-4871-88e8-2381e2785ce9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:28.527496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:28.529272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:28.533484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:28.533484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:28.533484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:28.533484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:28.533484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:28.533484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:28.533484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:28.533484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:28.533484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 07 07:07:28.533484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:28.539594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 317/618] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:28.549147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc8cdb-ff02-4871-88e8-2381e2785ce9 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:28.582069 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f2414-cdf0-4bb8-99e5-0b4c17b70aec None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:28.619839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cc9a7-69c3-490b-882d-56e93de66ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:28.619839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc9a7-69c3-490b-882d-56e93de66ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:28.619839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc9a7-69c3-490b-882d-56e93de66ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:28.619839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc9a7-69c3-490b-882d-56e93de66ec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:28.630636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cc9a7-69c3-490b-882d-56e93de66ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:28.632250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cc9a7-69c3-490b-882d-56e93de66ec1 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-9f3cc9a7-69c3-490b-882d-56e93de66ec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:28.650213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:28.651816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:28.653615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:28.653615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:28.653615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:28.653615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:28.653615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 302/619] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:28.660693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cc9a7-69c3-490b-882d-56e93de66ec1 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:28.715173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:28.801826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc8cdb-ff02-4871-88e8-2381e2785ce9 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:28.870278 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0e6a7-ef6e-4838-a6ee-6604ffcf92a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:28.872282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e6a7-ef6e-4838-a6ee-6604ffcf92a4 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:28.873066 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e6a7-ef6e-4838-a6ee-6604ffcf92a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:28.873891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e6a7-ef6e-4838-a6ee-6604ffcf92a4 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:28.876558 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0e6a7-ef6e-4838-a6ee-6604ffcf92a4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:28.878250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0e6a7-ef6e-4838-a6ee-6604ffcf92a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:28.881389 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0e6a7-ef6e-4838-a6ee-6604ffcf92a4 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:28.923207 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cc9a7-69c3-490b-882d-56e93de66ec1 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:28.956154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 318/620] 10.222.0.62 () {56 vars in 1135 bytes} [Thu Jul 7 07:07:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:28.962728 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0e6a7-ef6e-4838-a6ee-6604ffcf92a4 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:28.997133 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:29.003257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60ea8e-7e63-4716-a1ef-ec577b1d69e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:29.005733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60ea8e-7e63-4716-a1ef-ec577b1d69e6 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:29.006245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60ea8e-7e63-4716-a1ef-ec577b1d69e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:29.006929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60ea8e-7e63-4716-a1ef-ec577b1d69e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:29.008560 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60ea8e-7e63-4716-a1ef-ec577b1d69e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:29.009343 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60ea8e-7e63-4716-a1ef-ec577b1d69e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:29.011904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60ea8e-7e63-4716-a1ef-ec577b1d69e6 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:29.033806 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 303/621] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:29.042760 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60ea8e-7e63-4716-a1ef-ec577b1d69e6 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:29.161653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0e6a7-ef6e-4838-a6ee-6604ffcf92a4 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:29.173081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:29.182283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60ea8e-7e63-4716-a1ef-ec577b1d69e6 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:29.228796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e3a19-be75-438c-9943-1eb893df9a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:29.229732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e3a19-be75-438c-9943-1eb893df9a76 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:29.230010 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e3a19-be75-438c-9943-1eb893df9a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:29.230289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e3a19-be75-438c-9943-1eb893df9a76 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:29.230592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244dd04-5bba-4ab4-9293-5b0807dea223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:29.231630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244dd04-5bba-4ab4-9293-5b0807dea223 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:29.232115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244dd04-5bba-4ab4-9293-5b0807dea223 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:29.232659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244dd04-5bba-4ab4-9293-5b0807dea223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:29.238086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e3a19-be75-438c-9943-1eb893df9a76 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:29.239846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e3a19-be75-438c-9943-1eb893df9a76 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-5a8e3a19-be75-438c-9943-1eb893df9a76 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:29.257933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:29.259001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:29.261032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:29.261032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:29.261032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:29.261032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:29.261032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:29.261032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:29.261032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:29.261032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:29.261032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:07:29.261032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:29.261626 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244dd04-5bba-4ab4-9293-5b0807dea223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:29.261710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 304/622] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Jul 7 07:07:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:29.261787 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244dd04-5bba-4ab4-9293-5b0807dea223 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:29.266184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e3a19-be75-438c-9943-1eb893df9a76 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-0244dd04-5bba-4ab4-9293-5b0807dea223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:29.297305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:29.299810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:29.300735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:29.300735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:29.300735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:29.300735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:29.300735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 319/623] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:29.304828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244dd04-5bba-4ab4-9293-5b0807dea223 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:29.424144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e3a19-be75-438c-9943-1eb893df9a76 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:29.439879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:29.475282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244dd04-5bba-4ab4-9293-5b0807dea223 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:29.512119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285e8c0-7a15-4838-bcf4-20cfe3e4f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:29.512705 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285e8c0-7a15-4838-bcf4-20cfe3e4f9ad None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:29.512984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285e8c0-7a15-4838-bcf4-20cfe3e4f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:29.513363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285e8c0-7a15-4838-bcf4-20cfe3e4f9ad None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:29.514200 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285e8c0-7a15-4838-bcf4-20cfe3e4f9ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:29.514509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285e8c0-7a15-4838-bcf4-20cfe3e4f9ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:29.515170 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced4088-b233-4262-9786-7aadef488e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:29.515903 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285e8c0-7a15-4838-bcf4-20cfe3e4f9ad None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:29.516329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4088-b233-4262-9786-7aadef488e12 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:29.516821 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4088-b233-4262-9786-7aadef488e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:29.517345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4088-b233-4262-9786-7aadef488e12 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:29.518414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced4088-b233-4262-9786-7aadef488e12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:29.518948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced4088-b233-4262-9786-7aadef488e12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:29.523681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced4088-b233-4262-9786-7aadef488e12 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:29.528987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 320/624] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:29.530399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c438dbb-307f-47ee-a219-d310056ec38b None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:29.530687 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c438dbb-307f-47ee-a219-d310056ec38b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:29.530965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c438dbb-307f-47ee-a219-d310056ec38b None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:29.532742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 321/625] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:29.535967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c438dbb-307f-47ee-a219-d310056ec38b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:29.550134 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 305/626] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Jul 7 07:07:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:29.552373 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de007760-126d-443b-85f2-6cb307a7fee2 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:29.552660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de007760-126d-443b-85f2-6cb307a7fee2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:29.552939 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de007760-126d-443b-85f2-6cb307a7fee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:29.573583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:29.576861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-de007760-126d-443b-85f2-6cb307a7fee2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:29.578437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-de007760-126d-443b-85f2-6cb307a7fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:29.659876 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 306/627] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:29.660810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de007760-126d-443b-85f2-6cb307a7fee2 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:29.680016 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c438dbb-307f-47ee-a219-d310056ec38b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:29.723041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:29.730861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1fb3e-da92-447b-beaa-6a9d660574ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:29.731957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1fb3e-da92-447b-beaa-6a9d660574ea None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:29.732235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1fb3e-da92-447b-beaa-6a9d660574ea None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:29.732512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1fb3e-da92-447b-beaa-6a9d660574ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:29.742957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1fb3e-da92-447b-beaa-6a9d660574ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:29.745393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1fb3e-da92-447b-beaa-6a9d660574ea None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-eef1fb3e-da92-447b-beaa-6a9d660574ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:29.766736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:29.767654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:29.768505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:29.768505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:29.768505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:29.768505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:29.768505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:29.768505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:29.768505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:29.768505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:29.774057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 322/628] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:29.775364 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1fb3e-da92-447b-beaa-6a9d660574ea None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:29.789922 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de007760-126d-443b-85f2-6cb307a7fee2 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:29.827253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0034f9-5bbd-4e21-8e42-b83294ecd67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:29.827959 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0034f9-5bbd-4e21-8e42-b83294ecd67c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:29.828240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0034f9-5bbd-4e21-8e42-b83294ecd67c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:29.828513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0034f9-5bbd-4e21-8e42-b83294ecd67c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:29.833179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:29.904384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0034f9-5bbd-4e21-8e42-b83294ecd67c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:29.905973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0034f9-5bbd-4e21-8e42-b83294ecd67c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:29.912889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1fb3e-da92-447b-beaa-6a9d660574ea None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:29.949595 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cc870-a1b2-4b6a-9c9d-70a04e88bbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:29.950719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cc870-a1b2-4b6a-9c9d-70a04e88bbda None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:29.951120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cc870-a1b2-4b6a-9c9d-70a04e88bbda None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:29.951299 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cc870-a1b2-4b6a-9c9d-70a04e88bbda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:29.964549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cc870-a1b2-4b6a-9c9d-70a04e88bbda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-a01cc870-a1b2-4b6a-9c9d-70a04e88bbda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:29.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:29.973452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:29.974341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:29.974341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:29.974341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:29.974341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:29.974341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:29.974341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:29.974341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:29.974341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:29.974341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:29.974341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:29.974341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:29.974341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:29.978875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 323/629] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:29.979775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cc870-a1b2-4b6a-9c9d-70a04e88bbda None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:30.041042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:30.042818 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 307/630] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:30.044015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0034f9-5bbd-4e21-8e42-b83294ecd67c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:30.082835 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:30.111661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cc870-a1b2-4b6a-9c9d-70a04e88bbda None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:30.149938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17710b1-516b-466f-a567-ca5d972e9a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:30.150755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17710b1-516b-466f-a567-ca5d972e9a4a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:30.151140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17710b1-516b-466f-a567-ca5d972e9a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:30.151518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17710b1-516b-466f-a567-ca5d972e9a4a None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:30.152485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17710b1-516b-466f-a567-ca5d972e9a4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:30.152910 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17710b1-516b-466f-a567-ca5d972e9a4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:30.154456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17710b1-516b-466f-a567-ca5d972e9a4a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:30.165314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0034f9-5bbd-4e21-8e42-b83294ecd67c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:30.168458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 324/631] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:30.169485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17710b1-516b-466f-a567-ca5d972e9a4a None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:30.206016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de97cf-1cb0-4e25-ba04-1ee08a12cd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:30.206699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de97cf-1cb0-4e25-ba04-1ee08a12cd83 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:30.207066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de97cf-1cb0-4e25-ba04-1ee08a12cd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:30.207348 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de97cf-1cb0-4e25-ba04-1ee08a12cd83 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:30.208144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de97cf-1cb0-4e25-ba04-1ee08a12cd83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:30.208496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de97cf-1cb0-4e25-ba04-1ee08a12cd83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:30.209925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de97cf-1cb0-4e25-ba04-1ee08a12cd83 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:30.219176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 308/632] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:30.220258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1731d-42db-47de-87a8-80f259cc351c None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:30.220543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1731d-42db-47de-87a8-80f259cc351c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:30.220819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1731d-42db-47de-87a8-80f259cc351c None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:30.225513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 309/633] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:30.225513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1731d-42db-47de-87a8-80f259cc351c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:30.282926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17710b1-516b-466f-a567-ca5d972e9a4a None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:30.297159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:30.319949 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e613849-5373-4a8f-b589-0633e0354bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:30.320770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e613849-5373-4a8f-b589-0633e0354bab None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:30.321088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e613849-5373-4a8f-b589-0633e0354bab None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:30.321423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e613849-5373-4a8f-b589-0633e0354bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:30.332246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:30.334033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e613849-5373-4a8f-b589-0633e0354bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:30.335710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e613849-5373-4a8f-b589-0633e0354bab None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:30.337603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1731d-42db-47de-87a8-80f259cc351c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-6e613849-5373-4a8f-b589-0633e0354bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:30.356282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:30.357424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:30.363573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:30.363573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:30.363573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:30.363573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:30.363573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 325/634] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:30.363573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e613849-5373-4a8f-b589-0633e0354bab None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:30.381117 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ec703-228e-42ec-96e3-c3dd1f4b2154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:30.382454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ec703-228e-42ec-96e3-c3dd1f4b2154 None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:30.382454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ec703-228e-42ec-96e3-c3dd1f4b2154 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:30.382848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ec703-228e-42ec-96e3-c3dd1f4b2154 None admin] PATH_INFO: `/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/16f8303298b04e009e22ea05ba24a3c5/roles/bc1cedb3c00f446dbe9f7c756a01d28a` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:30.400408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ec703-228e-42ec-96e3-c3dd1f4b2154 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d7163b6caf648d89fd2cd48f27b1a23, user_id=16f8303298b04e009e22ea05ba24a3c5, role_id=bc1cedb3c00f446dbe9f7c756a01d28a)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:30.401913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ec703-228e-42ec-96e3-c3dd1f4b2154 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:30.415922 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 310/635] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:07:30 2022] PUT /identity/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/16f8303298b04e009e22ea05ba24a3c5/roles/bc1cedb3c00f446dbe9f7c756a01d28a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:07:30.417318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab7943-007c-47df-84fc-8a10ed80820c None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:30.417661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab7943-007c-47df-84fc-8a10ed80820c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:30.417996 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab7943-007c-47df-84fc-8a10ed80820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:30.444372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-77ab7943-007c-47df-84fc-8a10ed80820c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:30.445754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-77ab7943-007c-47df-84fc-8a10ed80820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:30.491259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e613849-5373-4a8f-b589-0633e0354bab None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:30.528338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 311/636] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:30.529654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab7943-007c-47df-84fc-8a10ed80820c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:30.538486 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bf410-9074-4839-829b-0d11d1cd609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:30.539453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bf410-9074-4839-829b-0d11d1cd609f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:30.539740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bf410-9074-4839-829b-0d11d1cd609f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:30.540069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bf410-9074-4839-829b-0d11d1cd609f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:30.553342 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bf410-9074-4839-829b-0d11d1cd609f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:30.554868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bf410-9074-4839-829b-0d11d1cd609f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-838bf410-9074-4839-829b-0d11d1cd609f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:30.575925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:30.576888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:30.577788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:30.577788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:30.577788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:30.577788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:30.577788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 326/637] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:30.579301 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c8be1-2199-469b-b93f-f1cd3305cdcb None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:30.579590 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c8be1-2199-469b-b93f-f1cd3305cdcb None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:30.579867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c8be1-2199-469b-b93f-f1cd3305cdcb None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:30.582500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 327/638] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:30.583234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c8be1-2199-469b-b93f-f1cd3305cdcb None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:30.605266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:30.631474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:30.660130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab7943-007c-47df-84fc-8a10ed80820c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:30.699500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31598380-a07c-4ebe-a903-e5c153cf2b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:30.700340 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31598380-a07c-4ebe-a903-e5c153cf2b15 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:30.700630 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31598380-a07c-4ebe-a903-e5c153cf2b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:30.700910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31598380-a07c-4ebe-a903-e5c153cf2b15 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:30.701093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c8be1-2199-469b-b93f-f1cd3305cdcb None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:30.701674 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31598380-a07c-4ebe-a903-e5c153cf2b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:30.701984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31598380-a07c-4ebe-a903-e5c153cf2b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:30.703373 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31598380-a07c-4ebe-a903-e5c153cf2b15 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:30.715054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 312/639] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:30.715873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31598380-a07c-4ebe-a903-e5c153cf2b15 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:30.750293 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7b09c-a476-4e59-85ab-9239a4399742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:30.751116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7b09c-a476-4e59-85ab-9239a4399742 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:30.751397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7b09c-a476-4e59-85ab-9239a4399742 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:30.751673 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7b09c-a476-4e59-85ab-9239a4399742 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:30.763259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7b09c-a476-4e59-85ab-9239a4399742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-75d7b09c-a476-4e59-85ab-9239a4399742 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:30.771076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:30.772192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:30.773042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 328/640] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:30.773780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0fe5c-80ea-4dd8-8bc6-778690742be3 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:30.774426 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0fe5c-80ea-4dd8-8bc6-778690742be3 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:30.774426 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0fe5c-80ea-4dd8-8bc6-778690742be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:30.792702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-1cf0fe5c-80ea-4dd8-8bc6-778690742be3 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:30.793621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1cf0fe5c-80ea-4dd8-8bc6-778690742be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:30.830789 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31598380-a07c-4ebe-a903-e5c153cf2b15 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:30.867244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 329/641] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:30.868221 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0fe5c-80ea-4dd8-8bc6-778690742be3 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:30.876808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:30.882345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8427c61-8708-498c-a53a-44cdcfe45e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:30.883128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8427c61-8708-498c-a53a-44cdcfe45e36 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:30.883413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8427c61-8708-498c-a53a-44cdcfe45e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:30.885631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8427c61-8708-498c-a53a-44cdcfe45e36 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:30.885631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8427c61-8708-498c-a53a-44cdcfe45e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:30.885631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8427c61-8708-498c-a53a-44cdcfe45e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:30.886230 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8427c61-8708-498c-a53a-44cdcfe45e36 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:30.895281 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:30.902103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 313/642] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:30.902942 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8427c61-8708-498c-a53a-44cdcfe45e36 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:30.990144 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0fe5c-80ea-4dd8-8bc6-778690742be3 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:31.011678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8427c61-8708-498c-a53a-44cdcfe45e36 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:31.030282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195e302-b2cc-4d15-b7ff-8dd39572c882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:31.031092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195e302-b2cc-4d15-b7ff-8dd39572c882 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:31.031367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195e302-b2cc-4d15-b7ff-8dd39572c882 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:31.031639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195e302-b2cc-4d15-b7ff-8dd39572c882 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:31.038846 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195e302-b2cc-4d15-b7ff-8dd39572c882 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:31.040520 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195e302-b2cc-4d15-b7ff-8dd39572c882 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:31.046080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c17a76-7d6a-43d7-ae85-acf998e4a110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:31.046756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c17a76-7d6a-43d7-ae85-acf998e4a110 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:31.047033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c17a76-7d6a-43d7-ae85-acf998e4a110 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:31.047310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c17a76-7d6a-43d7-ae85-acf998e4a110 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:31.048059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c17a76-7d6a-43d7-ae85-acf998e4a110 None admin] RBAC: Adding query filter params (name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:31.048361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c17a76-7d6a-43d7-ae85-acf998e4a110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:31.049787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c17a76-7d6a-43d7-ae85-acf998e4a110 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-6195e302-b2cc-4d15-b7ff-8dd39572c882 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:31.056701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:31.057716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:31.058589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:31.058589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:31.058589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:31.058589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:31.058589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:31.058589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:31.058589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:31.058589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:31.059026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 330/643] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:31.063974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195e302-b2cc-4d15-b7ff-8dd39572c882 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:31.064123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 314/644] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:31.064123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c17a76-7d6a-43d7-ae85-acf998e4a110 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:31.130112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:31.132054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:31.167934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195e302-b2cc-4d15-b7ff-8dd39572c882 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:31.177484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c17a76-7d6a-43d7-ae85-acf998e4a110 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:31.201971 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27db41-c920-4a31-8e8c-ef6ab8c25b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:31.202874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27db41-c920-4a31-8e8c-ef6ab8c25b4b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:31.203262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27db41-c920-4a31-8e8c-ef6ab8c25b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:31.203553 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27db41-c920-4a31-8e8c-ef6ab8c25b4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:31.214767 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606d459-612d-4b90-bdc4-ef41a95974dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:31.215577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606d459-612d-4b90-bdc4-ef41a95974dd None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:31.215855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606d459-612d-4b90-bdc4-ef41a95974dd None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:31.215955 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27db41-c920-4a31-8e8c-ef6ab8c25b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:31.216124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606d459-612d-4b90-bdc4-ef41a95974dd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-2b27db41-c920-4a31-8e8c-ef6ab8c25b4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:31.223639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:31.224536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:31.225841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:31.225841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:31.225841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:31.225841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:31.225841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:31.225841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:31.225841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:31.225841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:31.225841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:31.225841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:31.225841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:31.225841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:31.226582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606d459-612d-4b90-bdc4-ef41a95974dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:31.226661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 331/645] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:31.226661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27db41-c920-4a31-8e8c-ef6ab8c25b4b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:31.229707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606d459-612d-4b90-bdc4-ef41a95974dd None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-5606d459-612d-4b90-bdc4-ef41a95974dd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:31.251947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:31.252960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:31.253946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:31.253946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:31.253946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:31.253946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:31.253946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:31.253946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:31.253946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:31.253946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:31.253946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 07 07:07:31.253946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:31.253946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 315/646] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:31.255111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606d459-612d-4b90-bdc4-ef41a95974dd None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:31.338353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27db41-c920-4a31-8e8c-ef6ab8c25b4b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:31.362130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606d459-612d-4b90-bdc4-ef41a95974dd None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:31.366805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:31.377495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2773f9-0f7c-4ca9-b20a-889ce34169c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:31.378343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2773f9-0f7c-4ca9-b20a-889ce34169c3 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:31.378587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2773f9-0f7c-4ca9-b20a-889ce34169c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:31.378874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2773f9-0f7c-4ca9-b20a-889ce34169c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:31.383262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:31.394069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2773f9-0f7c-4ca9-b20a-889ce34169c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:31.395836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2773f9-0f7c-4ca9-b20a-889ce34169c3 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:31.398562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cf4cd-4f23-4bdb-a814-b0d9a19ff1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:31.399378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cf4cd-4f23-4bdb-a814-b0d9a19ff1fb None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:31.399774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cf4cd-4f23-4bdb-a814-b0d9a19ff1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:31.400633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cf4cd-4f23-4bdb-a814-b0d9a19ff1fb None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:31.401080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cf4cd-4f23-4bdb-a814-b0d9a19ff1fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:31.401519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cf4cd-4f23-4bdb-a814-b0d9a19ff1fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:31.403156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cf4cd-4f23-4bdb-a814-b0d9a19ff1fb None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:31.416366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 316/647] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-2e2773f9-0f7c-4ca9-b20a-889ce34169c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:31.416499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:31.417390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:31.418280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:31.418280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:31.418280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:31.418280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:31.418496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cf4cd-4f23-4bdb-a814-b0d9a19ff1fb None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:31.419876 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 332/648] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:31.421135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2773f9-0f7c-4ca9-b20a-889ce34169c3 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:31.526803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cf4cd-4f23-4bdb-a814-b0d9a19ff1fb None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:31.530619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2773f9-0f7c-4ca9-b20a-889ce34169c3 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:31.562612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0f000-755c-45fe-9b32-a07e29ecbcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:31.563461 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0f000-755c-45fe-9b32-a07e29ecbcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:31.563743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0f000-755c-45fe-9b32-a07e29ecbcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:31.564015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0f000-755c-45fe-9b32-a07e29ecbcb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:31.564758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0f000-755c-45fe-9b32-a07e29ecbcb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:31.565076 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0f000-755c-45fe-9b32-a07e29ecbcb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:31.566471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0f000-755c-45fe-9b32-a07e29ecbcb5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:31.569401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697200d-6811-40e7-87fd-0189c3ac0fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:31.570241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697200d-6811-40e7-87fd-0189c3ac0fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:31.570661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697200d-6811-40e7-87fd-0189c3ac0fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:31.571155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697200d-6811-40e7-87fd-0189c3ac0fc3 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:31.572261 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697200d-6811-40e7-87fd-0189c3ac0fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:31.572709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697200d-6811-40e7-87fd-0189c3ac0fc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:31.574343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697200d-6811-40e7-87fd-0189c3ac0fc3 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:31.575067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 317/649] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:31.575885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0f000-755c-45fe-9b32-a07e29ecbcb5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:31.596308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 333/650] 10.222.0.62 () {56 vars in 1137 bytes} [Thu Jul 7 07:07:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:31.597407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697200d-6811-40e7-87fd-0189c3ac0fc3 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:31.628280 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:31.635979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:31.690052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0f000-755c-45fe-9b32-a07e29ecbcb5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:31.704054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697200d-6811-40e7-87fd-0189c3ac0fc3 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:31.728436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88068b8-69c9-47ec-ba5c-eecf69e9b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:31.729114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88068b8-69c9-47ec-ba5c-eecf69e9b13a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:31.729430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88068b8-69c9-47ec-ba5c-eecf69e9b13a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:31.729715 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88068b8-69c9-47ec-ba5c-eecf69e9b13a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:31.730552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88068b8-69c9-47ec-ba5c-eecf69e9b13a None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=42acdb53c342401da6b32be6b9f3d030) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:31.730877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88068b8-69c9-47ec-ba5c-eecf69e9b13a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:31.732341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88068b8-69c9-47ec-ba5c-eecf69e9b13a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:31.738360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 318/651] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:31 2022] GET /identity/v3/role_assignments?user.id=42acdb53c342401da6b32be6b9f3d030&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:31.739155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88068b8-69c9-47ec-ba5c-eecf69e9b13a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:31.752757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a912703-8b14-47e1-abb6-b4752db03402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:31.753887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a912703-8b14-47e1-abb6-b4752db03402 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:31.754236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a912703-8b14-47e1-abb6-b4752db03402 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:31.754638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a912703-8b14-47e1-abb6-b4752db03402 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:31.755460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a912703-8b14-47e1-abb6-b4752db03402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:31.755833 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a912703-8b14-47e1-abb6-b4752db03402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:31.757393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a912703-8b14-47e1-abb6-b4752db03402 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:31.771605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 334/652] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:31.772801 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a912703-8b14-47e1-abb6-b4752db03402 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:31.879279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:31.887266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a912703-8b14-47e1-abb6-b4752db03402 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:31.888724 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88068b8-69c9-47ec-ba5c-eecf69e9b13a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:31.902405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:31.933258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384c95e-2f63-413a-89f2-79b6a8406d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:31.933593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c95e-2f63-413a-89f2-79b6a8406d52 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:31.933922 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c95e-2f63-413a-89f2-79b6a8406d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:31.934294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c95e-2f63-413a-89f2-79b6a8406d52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:31.937639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2c50f-99c3-4d3c-a44d-172485b1b02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:31.937793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2c50f-99c3-4d3c-a44d-172485b1b02e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:31.937965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2c50f-99c3-4d3c-a44d-172485b1b02e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:31.938731 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2c50f-99c3-4d3c-a44d-172485b1b02e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:31.951259 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2c50f-99c3-4d3c-a44d-172485b1b02e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:31.952890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2c50f-99c3-4d3c-a44d-172485b1b02e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-8ff2c50f-99c3-4d3c-a44d-172485b1b02e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:31.976257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:31.977267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:31.978136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:31.978136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:31.978136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:31.978136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:31.978136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 319/653] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:31.978798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2c50f-99c3-4d3c-a44d-172485b1b02e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:32.037603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384c95e-2f63-413a-89f2-79b6a8406d52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:32.039118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384c95e-2f63-413a-89f2-79b6a8406d52 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:32.096186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2c50f-99c3-4d3c-a44d-172485b1b02e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:32.131588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d691f32-d277-4fc9-a92f-23825132ed4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:32.132494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d691f32-d277-4fc9-a92f-23825132ed4e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:32.132791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d691f32-d277-4fc9-a92f-23825132ed4e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:32.133066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d691f32-d277-4fc9-a92f-23825132ed4e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:32.141706 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d691f32-d277-4fc9-a92f-23825132ed4e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:32.143266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d691f32-d277-4fc9-a92f-23825132ed4e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-6d691f32-d277-4fc9-a92f-23825132ed4e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:32.160290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:32.161309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:32.162240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:32.162240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:32.162240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:32.162240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:32.162240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:32.162240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:32.162240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:32.162240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:32.162240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 07:07:32.162240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:32.166317 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 320/654] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:32.167250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d691f32-d277-4fc9-a92f-23825132ed4e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:32.168010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:32.178078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 335/655] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:32.179297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384c95e-2f63-413a-89f2-79b6a8406d52 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:32.193574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:32.297753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d691f32-d277-4fc9-a92f-23825132ed4e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:32.304676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384c95e-2f63-413a-89f2-79b6a8406d52 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:32.336948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e20e1-35ef-4c81-a811-6f4edd86d66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:32.337670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e20e1-35ef-4c81-a811-6f4edd86d66e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:32.337955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e20e1-35ef-4c81-a811-6f4edd86d66e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:32.338263 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e20e1-35ef-4c81-a811-6f4edd86d66e None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:32.339601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e20e1-35ef-4c81-a811-6f4edd86d66e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:32.340485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e20e1-35ef-4c81-a811-6f4edd86d66e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:32.341830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e20e1-35ef-4c81-a811-6f4edd86d66e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:32.360222 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 321/656] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:32.361976 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e20e1-35ef-4c81-a811-6f4edd86d66e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:32.365746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bc57b-b3dc-435e-b7ac-858737a40168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:32.366460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bc57b-b3dc-435e-b7ac-858737a40168 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:32.366739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bc57b-b3dc-435e-b7ac-858737a40168 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:32.367012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bc57b-b3dc-435e-b7ac-858737a40168 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:32.368357 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bc57b-b3dc-435e-b7ac-858737a40168 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:32.368357 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bc57b-b3dc-435e-b7ac-858737a40168 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:32.369860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bc57b-b3dc-435e-b7ac-858737a40168 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:32.391947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 336/657] 10.222.0.62 () {56 vars in 1137 bytes} [Thu Jul 7 07:07:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:32.393071 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bc57b-b3dc-435e-b7ac-858737a40168 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:32.452122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:32.459674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:32.477726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e20e1-35ef-4c81-a811-6f4edd86d66e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:32.508488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bc57b-b3dc-435e-b7ac-858737a40168 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:32.513004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93bdf3-30bf-4827-afec-a6c7799916c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:32.513863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93bdf3-30bf-4827-afec-a6c7799916c4 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:32.514155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93bdf3-30bf-4827-afec-a6c7799916c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:32.514431 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93bdf3-30bf-4827-afec-a6c7799916c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:32.525284 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93bdf3-30bf-4827-afec-a6c7799916c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:32.526765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93bdf3-30bf-4827-afec-a6c7799916c4 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:32.545891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423527f-2c5b-45e6-8eb3-e919bb77ef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:32.546694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423527f-2c5b-45e6-8eb3-e919bb77ef41 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-fb93bdf3-30bf-4827-afec-a6c7799916c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:32.546935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:32.547754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:32.554668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:32.554668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:32.554668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:32.554668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:32.554889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423527f-2c5b-45e6-8eb3-e919bb77ef41 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:32.554889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423527f-2c5b-45e6-8eb3-e919bb77ef41 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:32.555026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 322/658] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:32.555026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93bdf3-30bf-4827-afec-a6c7799916c4 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:32.559857 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423527f-2c5b-45e6-8eb3-e919bb77ef41 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:32.562074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423527f-2c5b-45e6-8eb3-e919bb77ef41 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-0423527f-2c5b-45e6-8eb3-e919bb77ef41 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:32.584430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:32.585473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:32.586461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:32.586461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:32.586461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:32.586461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:32.586461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:32.586461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:32.586461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:32.586461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:32.586461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 07 07:07:32.586461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:32.593141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 337/659] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:32.593141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455463c-94e9-488e-8cbc-08596067bb7e None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:32.593141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455463c-94e9-488e-8cbc-08596067bb7e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:32.593141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455463c-94e9-488e-8cbc-08596067bb7e None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:32.593141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 338/660] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:32.593141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455463c-94e9-488e-8cbc-08596067bb7e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:32.668249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93bdf3-30bf-4827-afec-a6c7799916c4 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:32.701945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:32.709295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad294b6e-3372-4674-8340-ea408b4fe8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:32.709957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad294b6e-3372-4674-8340-ea408b4fe8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:32.710235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad294b6e-3372-4674-8340-ea408b4fe8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:32.710506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad294b6e-3372-4674-8340-ea408b4fe8a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:32.718053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455463c-94e9-488e-8cbc-08596067bb7e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:32.735168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:32.759719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715f56c-b615-40dc-b233-4bcf7a67eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:32.760655 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715f56c-b615-40dc-b233-4bcf7a67eddb None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:32.760964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715f56c-b615-40dc-b233-4bcf7a67eddb None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:32.761349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715f56c-b615-40dc-b233-4bcf7a67eddb None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:32.762097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715f56c-b615-40dc-b233-4bcf7a67eddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:32.762400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715f56c-b615-40dc-b233-4bcf7a67eddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:32.763932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715f56c-b615-40dc-b233-4bcf7a67eddb None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:32.782616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 339/661] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:32.783610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715f56c-b615-40dc-b233-4bcf7a67eddb None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:32.785082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad294b6e-3372-4674-8340-ea408b4fe8a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:32.786638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad294b6e-3372-4674-8340-ea408b4fe8a3 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:32.895157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715f56c-b615-40dc-b233-4bcf7a67eddb None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:32.897268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 323/662] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:32.897268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbc1d1-91bf-44a2-9c20-32471ea648d6 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:32.897268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbc1d1-91bf-44a2-9c20-32471ea648d6 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:32.897564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbc1d1-91bf-44a2-9c20-32471ea648d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:32.915157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0ecbc1d1-91bf-44a2-9c20-32471ea648d6 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:32.916395 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0ecbc1d1-91bf-44a2-9c20-32471ea648d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:32.940350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac4b96-7900-4b71-8aeb-83a883621791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:32.940953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac4b96-7900-4b71-8aeb-83a883621791 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:32.941323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac4b96-7900-4b71-8aeb-83a883621791 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:32.941705 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac4b96-7900-4b71-8aeb-83a883621791 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:32.942924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:32.943809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac4b96-7900-4b71-8aeb-83a883621791 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:32.943984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac4b96-7900-4b71-8aeb-83a883621791 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:32.945820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac4b96-7900-4b71-8aeb-83a883621791 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:32.971596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 340/663] 10.222.0.62 () {56 vars in 1139 bytes} [Thu Jul 7 07:07:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:32.972521 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac4b96-7900-4b71-8aeb-83a883621791 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:33.001267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 324/664] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:33.001267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbc1d1-91bf-44a2-9c20-32471ea648d6 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:33.014358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:33.097590 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac4b96-7900-4b71-8aeb-83a883621791 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:33.131800 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbc1d1-91bf-44a2-9c20-32471ea648d6 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:33.136832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c2f69-5f29-4977-8b89-5537e1916b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:33.137702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c2f69-5f29-4977-8b89-5537e1916b0e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:33.137988 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c2f69-5f29-4977-8b89-5537e1916b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:33.138276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c2f69-5f29-4977-8b89-5537e1916b0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:33.147090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c2f69-5f29-4977-8b89-5537e1916b0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:33.148733 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c2f69-5f29-4977-8b89-5537e1916b0e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-d23c2f69-5f29-4977-8b89-5537e1916b0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:33.163460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:33.164838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:33.166470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:33.166470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:33.166470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:33.166470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:33.166470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:33.166470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:33.166470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:33.166470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:33.166470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 341/665] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:33.166470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c2f69-5f29-4977-8b89-5537e1916b0e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:33.175955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e6a8a-48b9-4644-93f1-39e48f370880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:33.176763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e6a8a-48b9-4644-93f1-39e48f370880 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:33.177046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e6a8a-48b9-4644-93f1-39e48f370880 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:33.177362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e6a8a-48b9-4644-93f1-39e48f370880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:33.190147 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e6a8a-48b9-4644-93f1-39e48f370880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:33.191965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e6a8a-48b9-4644-93f1-39e48f370880 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-342e6a8a-48b9-4644-93f1-39e48f370880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:33.212088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:33.213083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:33.214096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:33.214096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:33.214096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:33.214096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:33.214096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 325/666] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:33.215327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e6a8a-48b9-4644-93f1-39e48f370880 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:33.233720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:33.278434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:33.289885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c2f69-5f29-4977-8b89-5537e1916b0e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:33.328841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be5006-4873-42fb-900f-2cff51922b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:33.329529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5006-4873-42fb-900f-2cff51922b35 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:33.329811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5006-4873-42fb-900f-2cff51922b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:33.330092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5006-4873-42fb-900f-2cff51922b35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:33.364398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e6a8a-48b9-4644-93f1-39e48f370880 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:33.405077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875285aa-5e9c-40c8-a409-420222687142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:33.405938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875285aa-5e9c-40c8-a409-420222687142 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:33.406220 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875285aa-5e9c-40c8-a409-420222687142 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:33.406994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875285aa-5e9c-40c8-a409-420222687142 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:33.418210 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875285aa-5e9c-40c8-a409-420222687142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-875285aa-5e9c-40c8-a409-420222687142 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:33.426073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:33.427376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:33.428211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:33.428211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:33.428211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:33.428211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:33.428211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:33.428211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:33.428211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:33.428211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:33.428211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:33.428211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:33.428211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:33.428211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:33.429381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be5006-4873-42fb-900f-2cff51922b35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:33.429381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be5006-4873-42fb-900f-2cff51922b35 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:33.432527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 326/667] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:33.433526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875285aa-5e9c-40c8-a409-420222687142 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:33.515764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:33.548180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:33.549955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875285aa-5e9c-40c8-a409-420222687142 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:33.561360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 342/668] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:33.562654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be5006-4873-42fb-900f-2cff51922b35 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:33.589451 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829a8d7-e13e-48d9-a1d7-9df187975ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:33.590124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829a8d7-e13e-48d9-a1d7-9df187975ffa None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:33.590407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829a8d7-e13e-48d9-a1d7-9df187975ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:33.590686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829a8d7-e13e-48d9-a1d7-9df187975ffa None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:33.591564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829a8d7-e13e-48d9-a1d7-9df187975ffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:33.591875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829a8d7-e13e-48d9-a1d7-9df187975ffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:33.593361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829a8d7-e13e-48d9-a1d7-9df187975ffa None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:33.605971 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 327/669] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:33.606810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829a8d7-e13e-48d9-a1d7-9df187975ffa None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:33.684497 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be5006-4873-42fb-900f-2cff51922b35 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:33.723559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aad1a-3015-4683-888b-852b3221b7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:33.724240 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aad1a-3015-4683-888b-852b3221b7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:33.724513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aad1a-3015-4683-888b-852b3221b7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:33.724788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aad1a-3015-4683-888b-852b3221b7d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:33.725555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088aad1a-3015-4683-888b-852b3221b7d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:33.725865 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088aad1a-3015-4683-888b-852b3221b7d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:33.726165 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829a8d7-e13e-48d9-a1d7-9df187975ffa None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:33.727326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088aad1a-3015-4683-888b-852b3221b7d2 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:33.739674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 343/670] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:33.740541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aad1a-3015-4683-888b-852b3221b7d2 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:33.764693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:33.772288 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8155f-3c03-4432-b599-6daa4b0c4143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:33.773254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8155f-3c03-4432-b599-6daa4b0c4143 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:33.773690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8155f-3c03-4432-b599-6daa4b0c4143 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:33.773986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8155f-3c03-4432-b599-6daa4b0c4143 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:33.774795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8155f-3c03-4432-b599-6daa4b0c4143 None admin] RBAC: Adding query filter params (name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:33.775216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8155f-3c03-4432-b599-6daa4b0c4143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:33.776709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8155f-3c03-4432-b599-6daa4b0c4143 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:33.790838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 328/671] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:33.790838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8155f-3c03-4432-b599-6daa4b0c4143 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:33.804336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:33.860866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aad1a-3015-4683-888b-852b3221b7d2 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:33.899836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67a6ef-e9e2-4b5c-9510-a15f77ffde21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:33.900652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67a6ef-e9e2-4b5c-9510-a15f77ffde21 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:33.900936 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67a6ef-e9e2-4b5c-9510-a15f77ffde21 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:33.901212 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67a6ef-e9e2-4b5c-9510-a15f77ffde21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:33.901861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8155f-3c03-4432-b599-6daa4b0c4143 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:33.915137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67a6ef-e9e2-4b5c-9510-a15f77ffde21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:33.916599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67a6ef-e9e2-4b5c-9510-a15f77ffde21 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-fc67a6ef-e9e2-4b5c-9510-a15f77ffde21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:33.934003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:33.934942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:33.935813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:33.935813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:33.935813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:33.935813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:33.935813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 344/672] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:33.936079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67a6ef-e9e2-4b5c-9510-a15f77ffde21 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:33.944140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0707b-be2c-4536-8b8c-3cdddbe30cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:33.944932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0707b-be2c-4536-8b8c-3cdddbe30cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:33.945266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0707b-be2c-4536-8b8c-3cdddbe30cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:33.945651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0707b-be2c-4536-8b8c-3cdddbe30cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:33.946766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0707b-be2c-4536-8b8c-3cdddbe30cc3 None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=3a6af41d833941debd6afcecd952af0f) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:33.947203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0707b-be2c-4536-8b8c-3cdddbe30cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:33.948911 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0707b-be2c-4536-8b8c-3cdddbe30cc3 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:33.955432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 329/673] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:33 2022] GET /identity/v3/role_assignments?user.id=3a6af41d833941debd6afcecd952af0f&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:33.956215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0707b-be2c-4536-8b8c-3cdddbe30cc3 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:34.034509 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:34.054666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67a6ef-e9e2-4b5c-9510-a15f77ffde21 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:34.057684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:34.088852 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0707b-be2c-4536-8b8c-3cdddbe30cc3 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:34.097483 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ed669-bde5-41b3-b36c-cba9e5cfd5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:34.098313 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed669-bde5-41b3-b36c-cba9e5cfd5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:34.098861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed669-bde5-41b3-b36c-cba9e5cfd5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:34.098861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed669-bde5-41b3-b36c-cba9e5cfd5b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:34.107552 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ed669-bde5-41b3-b36c-cba9e5cfd5b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:34.109043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ed669-bde5-41b3-b36c-cba9e5cfd5b8 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-4e2ed669-bde5-41b3-b36c-cba9e5cfd5b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:34.124186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:34.125100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:34.126578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:34.126578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:34.126578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:34.126578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:34.126578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:34.126578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:34.126578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:34.126578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:34.126578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 345/674] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:34.127202 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53468da4-133b-4aaa-8bcb-2a2960e9c885 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:34.127390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53468da4-133b-4aaa-8bcb-2a2960e9c885 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:34.127671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53468da4-133b-4aaa-8bcb-2a2960e9c885 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:34.128966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 346/675] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:34.129677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53468da4-133b-4aaa-8bcb-2a2960e9c885 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:34.137176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035afbcd-4610-4aaa-8532-66911caafcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:34.138054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035afbcd-4610-4aaa-8532-66911caafcbb None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:34.138326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035afbcd-4610-4aaa-8532-66911caafcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:34.138603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035afbcd-4610-4aaa-8532-66911caafcbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:34.150479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035afbcd-4610-4aaa-8532-66911caafcbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:34.151939 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035afbcd-4610-4aaa-8532-66911caafcbb None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-035afbcd-4610-4aaa-8532-66911caafcbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:34.172550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:34.173547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:34.174434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:34.174434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:34.174434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:34.174434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:34.174434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 330/676] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:34.174700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035afbcd-4610-4aaa-8532-66911caafcbb None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:34.249869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53468da4-133b-4aaa-8bcb-2a2960e9c885 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:34.285329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411259c-3129-45ce-a09a-30441ed387a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:34.285958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411259c-3129-45ce-a09a-30441ed387a9 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:34.286246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411259c-3129-45ce-a09a-30441ed387a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:34.286528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411259c-3129-45ce-a09a-30441ed387a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:34.287279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411259c-3129-45ce-a09a-30441ed387a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:34.287591 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411259c-3129-45ce-a09a-30441ed387a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:34.289003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411259c-3129-45ce-a09a-30441ed387a9 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:34.298138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035afbcd-4610-4aaa-8532-66911caafcbb None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:34.300925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 347/677] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:34.302256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c9278-7914-47ef-a13a-5f4075476c1a None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:34.302550 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c9278-7914-47ef-a13a-5f4075476c1a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:34.302832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c9278-7914-47ef-a13a-5f4075476c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:34.314457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:34.322199 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-019c9278-7914-47ef-a13a-5f4075476c1a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:34.323440 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-019c9278-7914-47ef-a13a-5f4075476c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:34.342323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:34.346532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af018dc5-c93e-4326-89b4-7f85be06c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:34.347221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af018dc5-c93e-4326-89b4-7f85be06c37d None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:34.347562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af018dc5-c93e-4326-89b4-7f85be06c37d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:34.347753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af018dc5-c93e-4326-89b4-7f85be06c37d None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:34.348563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af018dc5-c93e-4326-89b4-7f85be06c37d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:34.348867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af018dc5-c93e-4326-89b4-7f85be06c37d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:34.350322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af018dc5-c93e-4326-89b4-7f85be06c37d None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:34.370953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 331/678] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:34.370953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af018dc5-c93e-4326-89b4-7f85be06c37d None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:34.404526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 348/679] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:34.404526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c9278-7914-47ef-a13a-5f4075476c1a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:34.491188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af018dc5-c93e-4326-89b4-7f85be06c37d None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:34.514987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c9278-7914-47ef-a13a-5f4075476c1a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:34.530004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408abad9-ac68-42b8-98b8-5c0645fbe2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:34.530686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408abad9-ac68-42b8-98b8-5c0645fbe2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:34.530974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408abad9-ac68-42b8-98b8-5c0645fbe2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:34.531243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408abad9-ac68-42b8-98b8-5c0645fbe2b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:34.532005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408abad9-ac68-42b8-98b8-5c0645fbe2b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:34.532314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408abad9-ac68-42b8-98b8-5c0645fbe2b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:34.533748 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408abad9-ac68-42b8-98b8-5c0645fbe2b5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:34.545579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 332/680] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:34.546403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408abad9-ac68-42b8-98b8-5c0645fbe2b5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:34.556867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ba34f-0f11-49c0-aa4b-e691a1504c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:34.557953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ba34f-0f11-49c0-aa4b-e691a1504c46 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:34.558503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ba34f-0f11-49c0-aa4b-e691a1504c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:34.558783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ba34f-0f11-49c0-aa4b-e691a1504c46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:34.566093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ba34f-0f11-49c0-aa4b-e691a1504c46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:34.567920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ba34f-0f11-49c0-aa4b-e691a1504c46 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:34.579162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-ff7ba34f-0f11-49c0-aa4b-e691a1504c46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:34.582009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:34.583148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:34.584027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:34.584027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:34.584027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:34.584027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:34.584027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:34.584027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:34.584027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:34.584027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:34.584027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 349/681] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:34.584496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ba34f-0f11-49c0-aa4b-e691a1504c46 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:34.602291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:34.658943 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408abad9-ac68-42b8-98b8-5c0645fbe2b5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:34.687848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ba34f-0f11-49c0-aa4b-e691a1504c46 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:34.698231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9478043-9eef-403e-8fd5-1abe78d6a9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:34.699238 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9478043-9eef-403e-8fd5-1abe78d6a9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:34.699755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9478043-9eef-403e-8fd5-1abe78d6a9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:34.700219 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9478043-9eef-403e-8fd5-1abe78d6a9c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:34.701386 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9478043-9eef-403e-8fd5-1abe78d6a9c3 None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=af7af6f0c53d4c599f5dd80150b4a22e) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:34.702008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9478043-9eef-403e-8fd5-1abe78d6a9c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:34.703543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9478043-9eef-403e-8fd5-1abe78d6a9c3 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:34.718854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 333/682] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:34 2022] GET /identity/v3/role_assignments?user.id=af7af6f0c53d4c599f5dd80150b4a22e&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:34.718854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9478043-9eef-403e-8fd5-1abe78d6a9c3 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:34.727107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7be91-ef19-4223-bf5b-cf1f9f77bee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:34.728283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7be91-ef19-4223-bf5b-cf1f9f77bee5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:34.728704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7be91-ef19-4223-bf5b-cf1f9f77bee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:34.729140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7be91-ef19-4223-bf5b-cf1f9f77bee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:34.746652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7be91-ef19-4223-bf5b-cf1f9f77bee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-81a7be91-ef19-4223-bf5b-cf1f9f77bee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:34.757664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:34.759002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:34.760021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:34.760021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:34.760021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:34.760021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:34.760021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:34.760021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:34.760021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:34.760021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:34.760021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:34.760021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:34.760021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:34.760021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:34.763373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 350/683] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:34.764541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7be91-ef19-4223-bf5b-cf1f9f77bee5 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:34.846091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:34.854713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9478043-9eef-403e-8fd5-1abe78d6a9c3 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:34.870493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:34.906971 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05ccac-6c59-4c35-882c-a06ad788dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:34.908033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05ccac-6c59-4c35-882c-a06ad788dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:34.908498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05ccac-6c59-4c35-882c-a06ad788dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:34.908760 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05ccac-6c59-4c35-882c-a06ad788dbb0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:34.908921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7be91-ef19-4223-bf5b-cf1f9f77bee5 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:34.918331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05ccac-6c59-4c35-882c-a06ad788dbb0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:34.920748 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05ccac-6c59-4c35-882c-a06ad788dbb0 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-2d05ccac-6c59-4c35-882c-a06ad788dbb0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:34.934817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:34.935781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:34.936704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:34.936704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:34.936704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:34.936704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:34.936704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:34.936704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:34.936704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:34.936704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:34.936704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 07 07:07:34.936704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:34.936704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 334/684] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:34.937980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05ccac-6c59-4c35-882c-a06ad788dbb0 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:34.956088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fe126-b1cd-43f0-b281-dfe14f27e5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:34.956781 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fe126-b1cd-43f0-b281-dfe14f27e5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:34.957059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fe126-b1cd-43f0-b281-dfe14f27e5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:34.957368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fe126-b1cd-43f0-b281-dfe14f27e5a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:34.958166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fe126-b1cd-43f0-b281-dfe14f27e5a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:34.958469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fe126-b1cd-43f0-b281-dfe14f27e5a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:34.959911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fe126-b1cd-43f0-b281-dfe14f27e5a4 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:34.974102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 351/685] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:34.974956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fe126-b1cd-43f0-b281-dfe14f27e5a4 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:35.060142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05ccac-6c59-4c35-882c-a06ad788dbb0 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:35.090477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fe126-b1cd-43f0-b281-dfe14f27e5a4 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:35.108162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a648079-9739-41e4-b6a4-50d36408eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:35.108766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a648079-9739-41e4-b6a4-50d36408eaeb None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:35.109055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a648079-9739-41e4-b6a4-50d36408eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:35.109353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a648079-9739-41e4-b6a4-50d36408eaeb None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:35.110126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a648079-9739-41e4-b6a4-50d36408eaeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:35.110431 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a648079-9739-41e4-b6a4-50d36408eaeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:35.111926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a648079-9739-41e4-b6a4-50d36408eaeb None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:35.125887 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 335/686] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:35.125887 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a648079-9739-41e4-b6a4-50d36408eaeb None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:35.142991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b86483-89dc-4af4-91e3-d5e8a3a07631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:35.145363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b86483-89dc-4af4-91e3-d5e8a3a07631 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:35.145681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b86483-89dc-4af4-91e3-d5e8a3a07631 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:35.145959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b86483-89dc-4af4-91e3-d5e8a3a07631 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:35.146868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b86483-89dc-4af4-91e3-d5e8a3a07631 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:35.147175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b86483-89dc-4af4-91e3-d5e8a3a07631 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:35.150106 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b86483-89dc-4af4-91e3-d5e8a3a07631 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:35.151534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:35.154648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:35.174037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 352/687] 10.222.0.62 () {56 vars in 1135 bytes} [Thu Jul 7 07:07:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:35.174696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b86483-89dc-4af4-91e3-d5e8a3a07631 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:35.252652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a648079-9739-41e4-b6a4-50d36408eaeb None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:35.287827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7cc16-25fc-4ff1-a4df-faf991618ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:35.288522 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7cc16-25fc-4ff1-a4df-faf991618ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:35.288800 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7cc16-25fc-4ff1-a4df-faf991618ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:35.289074 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7cc16-25fc-4ff1-a4df-faf991618ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:35.290344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7cc16-25fc-4ff1-a4df-faf991618ca0 None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=4d0c6b46b5d248e5bed2b1bbdfa74f59) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:35.290901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7cc16-25fc-4ff1-a4df-faf991618ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:35.292499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7cc16-25fc-4ff1-a4df-faf991618ca0 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:35.305619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 336/688] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:35 2022] GET /identity/v3/role_assignments?user.id=4d0c6b46b5d248e5bed2b1bbdfa74f59&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:35.306768 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7cc16-25fc-4ff1-a4df-faf991618ca0 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:35.308451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b86483-89dc-4af4-91e3-d5e8a3a07631 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:35.351885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275b1bd-d113-4322-b07d-14cbe40daf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:35.353349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275b1bd-d113-4322-b07d-14cbe40daf3f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:35.353849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275b1bd-d113-4322-b07d-14cbe40daf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:35.354331 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275b1bd-d113-4322-b07d-14cbe40daf3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:35.373763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275b1bd-d113-4322-b07d-14cbe40daf3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:35.375849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275b1bd-d113-4322-b07d-14cbe40daf3f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-2275b1bd-d113-4322-b07d-14cbe40daf3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:35.396987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:35.398022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:35.398905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:35.398905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:35.398905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:35.398905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:35.405327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 353/689] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:35.407339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275b1bd-d113-4322-b07d-14cbe40daf3f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:35.465958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:35.507686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:35.536142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275b1bd-d113-4322-b07d-14cbe40daf3f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:35.574519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7cc16-25fc-4ff1-a4df-faf991618ca0 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:35.582922 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21c9b3-fb3b-495f-851a-7329f2899e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:35.583694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21c9b3-fb3b-495f-851a-7329f2899e4e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:35.583972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21c9b3-fb3b-495f-851a-7329f2899e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:35.584244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21c9b3-fb3b-495f-851a-7329f2899e4e None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:35.584968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21c9b3-fb3b-495f-851a-7329f2899e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:35.585296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21c9b3-fb3b-495f-851a-7329f2899e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:35.587103 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21c9b3-fb3b-495f-851a-7329f2899e4e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:35.602339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 354/690] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:35.613862 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21c9b3-fb3b-495f-851a-7329f2899e4e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:35.633514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae760d3-94cb-4b89-8d7f-32be6a21d58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:35.634694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae760d3-94cb-4b89-8d7f-32be6a21d58f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:35.635120 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae760d3-94cb-4b89-8d7f-32be6a21d58f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:35.635773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae760d3-94cb-4b89-8d7f-32be6a21d58f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:35.727387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae760d3-94cb-4b89-8d7f-32be6a21d58f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:35.729131 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae760d3-94cb-4b89-8d7f-32be6a21d58f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:35.732667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21c9b3-fb3b-495f-851a-7329f2899e4e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:35.734775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:35.769567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32140643-f01b-4641-9f8f-3ab8c24d7015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:35.770571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32140643-f01b-4641-9f8f-3ab8c24d7015 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:35.770715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32140643-f01b-4641-9f8f-3ab8c24d7015 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:35.770919 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32140643-f01b-4641-9f8f-3ab8c24d7015 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:35.779875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32140643-f01b-4641-9f8f-3ab8c24d7015 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:35.781593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32140643-f01b-4641-9f8f-3ab8c24d7015 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-32140643-f01b-4641-9f8f-3ab8c24d7015 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:35.796344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:35.797530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:35.798732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:35.798732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:35.798732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:35.798732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:35.798732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:35.798732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:35.798732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:35.798732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:35.798732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:07:35.798732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:35.802786 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 355/691] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Jul 7 07:07:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:35.804161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32140643-f01b-4641-9f8f-3ab8c24d7015 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:35.818077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:35.840565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 337/692] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:35.846198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae760d3-94cb-4b89-8d7f-32be6a21d58f None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:35.914758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32140643-f01b-4641-9f8f-3ab8c24d7015 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:35.951239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f35d6b-5dc9-4661-a351-239faca8f28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:35.951963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f35d6b-5dc9-4661-a351-239faca8f28c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:35.952251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f35d6b-5dc9-4661-a351-239faca8f28c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:35.957238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f35d6b-5dc9-4661-a351-239faca8f28c None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:35.957238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f35d6b-5dc9-4661-a351-239faca8f28c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:35.957238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f35d6b-5dc9-4661-a351-239faca8f28c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:35.957238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f35d6b-5dc9-4661-a351-239faca8f28c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:35.978679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 356/693] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Jul 7 07:07:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:35.979998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f35d6b-5dc9-4661-a351-239faca8f28c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:36.005744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:36.014532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae760d3-94cb-4b89-8d7f-32be6a21d58f None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:36.098643 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45535d-edbf-4c1e-b6d2-28c8a08ee4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:36.099458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45535d-edbf-4c1e-b6d2-28c8a08ee4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:36.099742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45535d-edbf-4c1e-b6d2-28c8a08ee4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:36.100019 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45535d-edbf-4c1e-b6d2-28c8a08ee4c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:36.124599 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45535d-edbf-4c1e-b6d2-28c8a08ee4c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:36.127104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45535d-edbf-4c1e-b6d2-28c8a08ee4c8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-4f45535d-edbf-4c1e-b6d2-28c8a08ee4c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:36.153399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:36.154749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:36.155596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:36.155596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:36.155596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:36.155596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:36.155817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f35d6b-5dc9-4661-a351-239faca8f28c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:36.158204 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 338/694] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:36.163882 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085925c-c08c-4960-8c9b-43b7faadd81e None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:36.164440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085925c-c08c-4960-8c9b-43b7faadd81e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:36.165019 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085925c-c08c-4960-8c9b-43b7faadd81e None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:36.166904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 339/695] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:36.167781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085925c-c08c-4960-8c9b-43b7faadd81e None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:36.200745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7de11-8f7e-4205-87bb-ece5fdd64fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:36.201678 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7de11-8f7e-4205-87bb-ece5fdd64fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:36.202033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7de11-8f7e-4205-87bb-ece5fdd64fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:36.202408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7de11-8f7e-4205-87bb-ece5fdd64fa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:36.206395 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:36.280862 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7de11-8f7e-4205-87bb-ece5fdd64fa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:36.282583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7de11-8f7e-4205-87bb-ece5fdd64fa3 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:36.299648 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085925c-c08c-4960-8c9b-43b7faadd81e None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:36.311453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:36.348342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da29c53-52eb-4897-9745-906b6b312778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:36.349573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da29c53-52eb-4897-9745-906b6b312778 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:36.350265 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da29c53-52eb-4897-9745-906b6b312778 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:36.350710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da29c53-52eb-4897-9745-906b6b312778 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:36.352367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da29c53-52eb-4897-9745-906b6b312778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:36.352866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da29c53-52eb-4897-9745-906b6b312778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:36.355316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da29c53-52eb-4897-9745-906b6b312778 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:36.375415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 340/696] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:36.375415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9afd0c-7b90-4ac8-82f6-84d82e6753e0 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:36.375415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9afd0c-7b90-4ac8-82f6-84d82e6753e0 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:36.375415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9afd0c-7b90-4ac8-82f6-84d82e6753e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:36.404610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-8b9afd0c-7b90-4ac8-82f6-84d82e6753e0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:36.407473 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-8b9afd0c-7b90-4ac8-82f6-84d82e6753e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:36.414800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 357/697] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 07:07:36.416014 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7de11-8f7e-4205-87bb-ece5fdd64fa3 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:36.493363 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 341/698] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:36.494302 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9afd0c-7b90-4ac8-82f6-84d82e6753e0 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:36.535036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:36.544971 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7de11-8f7e-4205-87bb-ece5fdd64fa3 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:36.573996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:36.589327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cb1dc-c140-49c3-bb1b-19778135fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:36.590876 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cb1dc-c140-49c3-bb1b-19778135fc2b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:36.591376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cb1dc-c140-49c3-bb1b-19778135fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:36.591880 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cb1dc-c140-49c3-bb1b-19778135fc2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:36.601419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cb1dc-c140-49c3-bb1b-19778135fc2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:36.603273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cb1dc-c140-49c3-bb1b-19778135fc2b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:36.617542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9afd0c-7b90-4ac8-82f6-84d82e6753e0 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-ff5cb1dc-c140-49c3-bb1b-19778135fc2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:36.619712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:36.620585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:36.621601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:36.621601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:36.621601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:36.621601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:36.621601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:36.621601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:36.621601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:36.621601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:36.625750 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 358/699] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:36.626781 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cb1dc-c140-49c3-bb1b-19778135fc2b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:36.663182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6243a0-a833-4922-8123-b798fa526dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:36.664656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6243a0-a833-4922-8123-b798fa526dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:36.665604 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6243a0-a833-4922-8123-b798fa526dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:36.665892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6243a0-a833-4922-8123-b798fa526dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:36.677355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6243a0-a833-4922-8123-b798fa526dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:36.678811 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6243a0-a833-4922-8123-b798fa526dd1 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-2b6243a0-a833-4922-8123-b798fa526dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:36.697932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:36.698857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:36.699720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:36.699720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:36.699720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:36.699720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:36.703774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 342/700] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:36.704872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6243a0-a833-4922-8123-b798fa526dd1 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:36.749279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cb1dc-c140-49c3-bb1b-19778135fc2b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:36.787125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431334c-7c07-4295-b37c-c45c2718aa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:36.787952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431334c-7c07-4295-b37c-c45c2718aa8b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:36.788236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431334c-7c07-4295-b37c-c45c2718aa8b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:36.788515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431334c-7c07-4295-b37c-c45c2718aa8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:36.797663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:36.800985 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431334c-7c07-4295-b37c-c45c2718aa8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:36.802751 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431334c-7c07-4295-b37c-c45c2718aa8b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-4431334c-7c07-4295-b37c-c45c2718aa8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:36.821305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:36.822286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:36.823268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:36.823268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:36.823268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:36.823268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:36.823268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 359/701] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:36.824056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431334c-7c07-4295-b37c-c45c2718aa8b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:36.835498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6243a0-a833-4922-8123-b798fa526dd1 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:36.862894 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:36.886402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c638ccf-96d3-46fc-8478-93cae69daa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:36.887076 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c638ccf-96d3-46fc-8478-93cae69daa20 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:36.887359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c638ccf-96d3-46fc-8478-93cae69daa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:36.887637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c638ccf-96d3-46fc-8478-93cae69daa20 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:36.888432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c638ccf-96d3-46fc-8478-93cae69daa20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:36.888741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c638ccf-96d3-46fc-8478-93cae69daa20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:36.890221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c638ccf-96d3-46fc-8478-93cae69daa20 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:36.902877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 343/702] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:36.903750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c638ccf-96d3-46fc-8478-93cae69daa20 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:36.947773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431334c-7c07-4295-b37c-c45c2718aa8b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:36.982950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a65e6a-b64c-40d1-97ea-599c8268161d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:36.983622 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65e6a-b64c-40d1-97ea-599c8268161d None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:36.983949 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65e6a-b64c-40d1-97ea-599c8268161d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:36.984474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65e6a-b64c-40d1-97ea-599c8268161d None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:36.984977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65e6a-b64c-40d1-97ea-599c8268161d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:36.985327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65e6a-b64c-40d1-97ea-599c8268161d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:36.986742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65e6a-b64c-40d1-97ea-599c8268161d None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:37.000030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 360/703] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:37.000904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a65e6a-b64c-40d1-97ea-599c8268161d None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:37.035011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c638ccf-96d3-46fc-8478-93cae69daa20 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:37.071021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd710d5-9747-4651-a537-b643e038258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:37.071692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd710d5-9747-4651-a537-b643e038258e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:37.071975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd710d5-9747-4651-a537-b643e038258e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:37.072253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd710d5-9747-4651-a537-b643e038258e None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:37.072978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd710d5-9747-4651-a537-b643e038258e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:37.073314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd710d5-9747-4651-a537-b643e038258e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:37.074865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd710d5-9747-4651-a537-b643e038258e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:37.076357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:37.093264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 344/704] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:37.093264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051b6f8-12ab-4506-b62c-4eae6a9d08d1 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:37.093264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051b6f8-12ab-4506-b62c-4eae6a9d08d1 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:37.093264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051b6f8-12ab-4506-b62c-4eae6a9d08d1 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:37.093264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 345/705] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:37.093264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051b6f8-12ab-4506-b62c-4eae6a9d08d1 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:37.097733 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:37.106823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a65e6a-b64c-40d1-97ea-599c8268161d None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:37.141622 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0773c-f7b5-4957-8884-813d1bd63b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:37.142305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0773c-f7b5-4957-8884-813d1bd63b34 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:37.142581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0773c-f7b5-4957-8884-813d1bd63b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:37.142859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0773c-f7b5-4957-8884-813d1bd63b34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:37.143749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0773c-f7b5-4957-8884-813d1bd63b34 None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=16f8303298b04e009e22ea05ba24a3c5) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:37.143994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0773c-f7b5-4957-8884-813d1bd63b34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:37.145450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0773c-f7b5-4957-8884-813d1bd63b34 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:37.161268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 361/706] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:37 2022] GET /identity/v3/role_assignments?user.id=16f8303298b04e009e22ea05ba24a3c5&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:37.161268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce61cbc-87d4-4b80-948a-a19b088f9f96 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:37.161268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce61cbc-87d4-4b80-948a-a19b088f9f96 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:37.161268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce61cbc-87d4-4b80-948a-a19b088f9f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:37.180047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-dce61cbc-87d4-4b80-948a-a19b088f9f96 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:37.181472 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-dce61cbc-87d4-4b80-948a-a19b088f9f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:37.218261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051b6f8-12ab-4506-b62c-4eae6a9d08d1 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:37.263440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da762ba4-b708-44cd-93b8-9693e60c4a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:37.264432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da762ba4-b708-44cd-93b8-9693e60c4a98 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:37.264781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da762ba4-b708-44cd-93b8-9693e60c4a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:37.265193 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da762ba4-b708-44cd-93b8-9693e60c4a98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:37.274320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da762ba4-b708-44cd-93b8-9693e60c4a98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:37.275249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 362/707] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:37.276167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce61cbc-87d4-4b80-948a-a19b088f9f96 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:37.282755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da762ba4-b708-44cd-93b8-9693e60c4a98 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-da762ba4-b708-44cd-93b8-9693e60c4a98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:37.314836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:37.315826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:37.316718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:37.316718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:37.316718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:37.316718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:37.316718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:37.316718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:37.316718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:37.316718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:37.316718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 346/708] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:37.322954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da762ba4-b708-44cd-93b8-9693e60c4a98 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:37.388155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:37.395499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:37.416920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce61cbc-87d4-4b80-948a-a19b088f9f96 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:37.458326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da762ba4-b708-44cd-93b8-9693e60c4a98 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:37.469176 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ad44a-a323-4287-9921-6998ab45a391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:37.470375 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ad44a-a323-4287-9921-6998ab45a391 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:37.470875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ad44a-a323-4287-9921-6998ab45a391 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:37.471351 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ad44a-a323-4287-9921-6998ab45a391 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:37.472278 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ad44a-a323-4287-9921-6998ab45a391 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:37.473999 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ad44a-a323-4287-9921-6998ab45a391 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:37.501782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 363/709] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:07:37 2022] POST /identity/v3/users => generated 254 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:07:37.503093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ad44a-a323-4287-9921-6998ab45a391 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:37.512798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809585a0-cf00-4c3c-99bc-25f08014a5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:37.513897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809585a0-cf00-4c3c-99bc-25f08014a5ea None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:37.513897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809585a0-cf00-4c3c-99bc-25f08014a5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:37.514090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809585a0-cf00-4c3c-99bc-25f08014a5ea None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:37.514817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809585a0-cf00-4c3c-99bc-25f08014a5ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:37.515130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809585a0-cf00-4c3c-99bc-25f08014a5ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:37.516578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809585a0-cf00-4c3c-99bc-25f08014a5ea None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:37.538664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 347/710] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:37.544807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809585a0-cf00-4c3c-99bc-25f08014a5ea None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:37.626011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ad44a-a323-4287-9921-6998ab45a391 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:37.655209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809585a0-cf00-4c3c-99bc-25f08014a5ea None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:37.667169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9cce9-d92d-4519-a5ff-5d9d108bb75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:37.668475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9cce9-d92d-4519-a5ff-5d9d108bb75e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:37.668960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9cce9-d92d-4519-a5ff-5d9d108bb75e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:37.669502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9cce9-d92d-4519-a5ff-5d9d108bb75e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:37.670488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9cce9-d92d-4519-a5ff-5d9d108bb75e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:37.671526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:37.673244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9cce9-d92d-4519-a5ff-5d9d108bb75e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-abe9cce9-d92d-4519-a5ff-5d9d108bb75e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:37.691232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:37.692319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 07:07:37.693603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:37.696172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62f1c0-67d1-447b-b5fd-cad061674695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:37.696878 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62f1c0-67d1-447b-b5fd-cad061674695 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:37.697348 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62f1c0-67d1-447b-b5fd-cad061674695 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:37.697568 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62f1c0-67d1-447b-b5fd-cad061674695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:37.698021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 364/711] 10.222.0.62 () {56 vars in 1129 bytes} [Thu Jul 7 07:07:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:37.698546 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62f1c0-67d1-447b-b5fd-cad061674695 None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=42acdb53c342401da6b32be6b9f3d030) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:37.698855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62f1c0-67d1-447b-b5fd-cad061674695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:37.700349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62f1c0-67d1-447b-b5fd-cad061674695 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:37.707472 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9cce9-d92d-4519-a5ff-5d9d108bb75e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:37.712751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 348/712] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:37 2022] GET /identity/v3/role_assignments?user.id=42acdb53c342401da6b32be6b9f3d030&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:37.732714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:37.846209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42560ad6-94c8-45c0-9248-b5d9a44720b9 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:37.846484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42560ad6-94c8-45c0-9248-b5d9a44720b9 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:37.846758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42560ad6-94c8-45c0-9248-b5d9a44720b9 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:37.848676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 349/713] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:07:37.850310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9cce9-d92d-4519-a5ff-5d9d108bb75e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:37.854492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6c8f-ca70-4bd9-b642-3354b83d0faf None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:37.854773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6c8f-ca70-4bd9-b642-3354b83d0faf None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:37.855052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6c8f-ca70-4bd9-b642-3354b83d0faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:37.873998 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-962b6c8f-ca70-4bd9-b642-3354b83d0faf None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:37.875308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-962b6c8f-ca70-4bd9-b642-3354b83d0faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:37.891410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dee4c2-c74a-45dc-9416-0d7b1a1c2f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:37.892464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dee4c2-c74a-45dc-9416-0d7b1a1c2f96 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:37.894492 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dee4c2-c74a-45dc-9416-0d7b1a1c2f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:37.895007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dee4c2-c74a-45dc-9416-0d7b1a1c2f96 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:37.896043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dee4c2-c74a-45dc-9416-0d7b1a1c2f96 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:37.896591 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dee4c2-c74a-45dc-9416-0d7b1a1c2f96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:37.898280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dee4c2-c74a-45dc-9416-0d7b1a1c2f96 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:37.909873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 365/714] 10.222.0.62 () {56 vars in 1124 bytes} [Thu Jul 7 07:07:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:37.915882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dee4c2-c74a-45dc-9416-0d7b1a1c2f96 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:37.970047 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 350/715] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:07:37.995396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b6c8f-ca70-4bd9-b642-3354b83d0faf None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:38.020061 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:38.058291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dee4c2-c74a-45dc-9416-0d7b1a1c2f96 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:38.103059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a9848-291f-42b7-be34-1703c1778f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:38.104222 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a9848-291f-42b7-be34-1703c1778f66 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:38.104710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a9848-291f-42b7-be34-1703c1778f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:38.105174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a9848-291f-42b7-be34-1703c1778f66 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:38.107274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a9848-291f-42b7-be34-1703c1778f66 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:38.107813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a9848-291f-42b7-be34-1703c1778f66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:38.109430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a9848-291f-42b7-be34-1703c1778f66 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:38.116973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 366/716] 10.222.0.62 () {56 vars in 1124 bytes} [Thu Jul 7 07:07:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:38.159541 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b6c8f-ca70-4bd9-b642-3354b83d0faf None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:38.175845 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:38.204787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc1f7f-69ca-4db2-b414-e8e8fd2f8cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:38.206086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc1f7f-69ca-4db2-b414-e8e8fd2f8cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:38.206661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc1f7f-69ca-4db2-b414-e8e8fd2f8cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:38.207142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc1f7f-69ca-4db2-b414-e8e8fd2f8cf6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:38.207997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc1f7f-69ca-4db2-b414-e8e8fd2f8cf6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:38.209686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc1f7f-69ca-4db2-b414-e8e8fd2f8cf6 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-26cc1f7f-69ca-4db2-b414-e8e8fd2f8cf6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:38.224866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:38.226351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 07:07:38.227336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:38.230508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 351/717] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:37 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:38.237819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a9848-291f-42b7-be34-1703c1778f66 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:38.363589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a9848-291f-42b7-be34-1703c1778f66 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:38.410434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff871f-cf1c-470d-9ba7-7752faffbc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:38.411485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff871f-cf1c-470d-9ba7-7752faffbc34 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:38.411485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff871f-cf1c-470d-9ba7-7752faffbc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:38.411641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff871f-cf1c-470d-9ba7-7752faffbc34 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:38.413248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff871f-cf1c-470d-9ba7-7752faffbc34 None admin] RBAC: Adding query filter params (name=network) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:38.413248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff871f-cf1c-470d-9ba7-7752faffbc34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:38.414101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff871f-cf1c-470d-9ba7-7752faffbc34 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:38.416226 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:38.420078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 367/718] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:07:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:38.426614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc1f7f-69ca-4db2-b414-e8e8fd2f8cf6 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:38.538515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc1f7f-69ca-4db2-b414-e8e8fd2f8cf6 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:38.573186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96453a-a34e-4587-b6a1-6ebcd5488257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:38.574299 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96453a-a34e-4587-b6a1-6ebcd5488257 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:38.574840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96453a-a34e-4587-b6a1-6ebcd5488257 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:38.575313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96453a-a34e-4587-b6a1-6ebcd5488257 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:38.576211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96453a-a34e-4587-b6a1-6ebcd5488257 None admin] RBAC: Adding query filter params (type=network) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:38.576707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96453a-a34e-4587-b6a1-6ebcd5488257 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:38.578320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96453a-a34e-4587-b6a1-6ebcd5488257 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:38.585280 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 352/719] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:07:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:39.851777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d67d28-0a5f-4fe2-87cd-65c647753b1a None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:39.852384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d67d28-0a5f-4fe2-87cd-65c647753b1a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:39.852459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d67d28-0a5f-4fe2-87cd-65c647753b1a None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:39.854138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 368/720] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:39.859754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01018c1-4c6d-4d12-87e2-c75446cd5e54 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:39.860186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01018c1-4c6d-4d12-87e2-c75446cd5e54 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:39.860359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01018c1-4c6d-4d12-87e2-c75446cd5e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:39.886305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-b01018c1-4c6d-4d12-87e2-c75446cd5e54 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:39.887545 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b01018c1-4c6d-4d12-87e2-c75446cd5e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:39.929933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:39.979544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 353/721] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:07:40.014652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d67d28-0a5f-4fe2-87cd-65c647753b1a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:40.065667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ea40d-b0fb-487e-8456-1911a8a21392 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:40.066309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ea40d-b0fb-487e-8456-1911a8a21392 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:40.066810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ea40d-b0fb-487e-8456-1911a8a21392 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:40.069005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 354/722] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:07:40.074453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b016b3a-bd90-4401-9d59-641aa01def4b None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:40.075002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b016b3a-bd90-4401-9d59-641aa01def4b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:40.075483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b016b3a-bd90-4401-9d59-641aa01def4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:40.103477 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-5b016b3a-bd90-4401-9d59-641aa01def4b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:40.105773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5b016b3a-bd90-4401-9d59-641aa01def4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:40.188416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d67d28-0a5f-4fe2-87cd-65c647753b1a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:40.243168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6168e32-a419-4dbe-a469-b3b189f32553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:40.244337 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6168e32-a419-4dbe-a469-b3b189f32553 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:40.244843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6168e32-a419-4dbe-a469-b3b189f32553 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:40.245363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6168e32-a419-4dbe-a469-b3b189f32553 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:40.257240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 355/723] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 07:07:40.273936 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6168e32-a419-4dbe-a469-b3b189f32553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-e6168e32-a419-4dbe-a469-b3b189f32553 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:40.281913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:40.282822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:40.283643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:40.283643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:40.283643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:40.283643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:40.283643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:40.283643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:40.283643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:40.283643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:40.283643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:40.283643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:40.283643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:40.283643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:40.286368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 369/724] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:40.292620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b016b3a-bd90-4401-9d59-641aa01def4b None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:40.297608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6168e32-a419-4dbe-a469-b3b189f32553 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:40.365873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:40.417052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6168e32-a419-4dbe-a469-b3b189f32553 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:40.441764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:40.450704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b016b3a-bd90-4401-9d59-641aa01def4b None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:40.452504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279b536-9e7f-4ebc-8ec6-ab1554bd860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:40.453595 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279b536-9e7f-4ebc-8ec6-ab1554bd860b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:40.454101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279b536-9e7f-4ebc-8ec6-ab1554bd860b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:40.454562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279b536-9e7f-4ebc-8ec6-ab1554bd860b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:40.466701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279b536-9e7f-4ebc-8ec6-ab1554bd860b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-b279b536-9e7f-4ebc-8ec6-ab1554bd860b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:40.474851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:40.475800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:40.476609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:40.476609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:40.476609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:40.476609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:40.476609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:40.476609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:40.476609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:40.476609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:40.476609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:40.476609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:40.476609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:40.476609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:40.479528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 370/725] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:40.481085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20793-c13b-4a54-a6b1-0d1a0ca9415c None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:40.481603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20793-c13b-4a54-a6b1-0d1a0ca9415c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:40.482328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20793-c13b-4a54-a6b1-0d1a0ca9415c None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:40.484805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 371/726] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:40.490367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf20793-c13b-4a54-a6b1-0d1a0ca9415c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:40.498071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069bf43-973e-420f-bc15-20c446cccd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:40.498761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069bf43-973e-420f-bc15-20c446cccd7b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:40.499046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069bf43-973e-420f-bc15-20c446cccd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:40.499318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069bf43-973e-420f-bc15-20c446cccd7b None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:40.500076 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069bf43-973e-420f-bc15-20c446cccd7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:40.500384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069bf43-973e-420f-bc15-20c446cccd7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:40.501868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069bf43-973e-420f-bc15-20c446cccd7b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:40.511659 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 356/727] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:40.517644 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576d23-6cec-4459-9249-f2f0c38ec403 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:40.517938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576d23-6cec-4459-9249-f2f0c38ec403 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:40.518217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576d23-6cec-4459-9249-f2f0c38ec403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:40.535585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-50576d23-6cec-4459-9249-f2f0c38ec403 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:40.536992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-50576d23-6cec-4459-9249-f2f0c38ec403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:40.603369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf20793-c13b-4a54-a6b1-0d1a0ca9415c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:40.609728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 357/728] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:40.610777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50576d23-6cec-4459-9249-f2f0c38ec403 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:40.637690 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:40.664376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf5abc-6818-41b0-9d07-517ec7725160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:40.665531 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf5abc-6818-41b0-9d07-517ec7725160 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:40.665953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf5abc-6818-41b0-9d07-517ec7725160 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:40.666383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf5abc-6818-41b0-9d07-517ec7725160 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:40.667276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf5abc-6818-41b0-9d07-517ec7725160 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:40.667718 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf5abc-6818-41b0-9d07-517ec7725160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:40.669267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf5abc-6818-41b0-9d07-517ec7725160 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:40.679234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 372/729] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:40.680361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf5abc-6818-41b0-9d07-517ec7725160 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:40.714317 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:40.729807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50576d23-6cec-4459-9249-f2f0c38ec403 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:40.765731 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a56b3-fd7d-44fb-8115-689bb4c280fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:40.766538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a56b3-fd7d-44fb-8115-689bb4c280fb None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:40.766825 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a56b3-fd7d-44fb-8115-689bb4c280fb None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:40.767104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a56b3-fd7d-44fb-8115-689bb4c280fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:40.777969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a56b3-fd7d-44fb-8115-689bb4c280fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:40.779575 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a56b3-fd7d-44fb-8115-689bb4c280fb None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-ca8a56b3-fd7d-44fb-8115-689bb4c280fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:40.798936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:40.799848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:40.800728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:40.800728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:40.800728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:40.800728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:40.800953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf5abc-6818-41b0-9d07-517ec7725160 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:40.804859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 358/730] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:40.805863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a56b3-fd7d-44fb-8115-689bb4c280fb None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:40.837777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b53db-a548-434c-9a29-530e11145fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:40.838586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b53db-a548-434c-9a29-530e11145fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:40.838926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b53db-a548-434c-9a29-530e11145fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:40.839251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b53db-a548-434c-9a29-530e11145fe0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:40.853595 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b53db-a548-434c-9a29-530e11145fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-6e8b53db-a548-434c-9a29-530e11145fe0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:40.861459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:40.862656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 373/731] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:40.864101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48208ccd-d9d8-4846-9c20-2408add00846 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:40.865046 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48208ccd-d9d8-4846-9c20-2408add00846 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:40.865046 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48208ccd-d9d8-4846-9c20-2408add00846 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:40.870613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 374/732] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:40.870613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48208ccd-d9d8-4846-9c20-2408add00846 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:40.915638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:40.927194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a56b3-fd7d-44fb-8115-689bb4c280fb None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:40.964913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba0546-3ee3-46d4-85c8-2d8075d34b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:40.965776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba0546-3ee3-46d4-85c8-2d8075d34b86 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:40.966057 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba0546-3ee3-46d4-85c8-2d8075d34b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:40.966325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba0546-3ee3-46d4-85c8-2d8075d34b86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:40.975537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:40.977956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba0546-3ee3-46d4-85c8-2d8075d34b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:40.980075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba0546-3ee3-46d4-85c8-2d8075d34b86 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:40.986494 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48208ccd-d9d8-4846-9c20-2408add00846 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-5fba0546-3ee3-46d4-85c8-2d8075d34b86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:40.998376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:40.999444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:41.000349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:41.000349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:41.000349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:41.000349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:41.000349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 359/733] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:41.001128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba0546-3ee3-46d4-85c8-2d8075d34b86 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:41.030748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3e879-9978-4f01-adfb-2aff19000869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:41.031960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3e879-9978-4f01-adfb-2aff19000869 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.032339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3e879-9978-4f01-adfb-2aff19000869 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.032612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3e879-9978-4f01-adfb-2aff19000869 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.033400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3e879-9978-4f01-adfb-2aff19000869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:41.033711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3e879-9978-4f01-adfb-2aff19000869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:41.035221 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3e879-9978-4f01-adfb-2aff19000869 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:41.050003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 375/734] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:41.051344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ab8d7-0b55-41b4-9cc2-74ca7f2e4d4b None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.051636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ab8d7-0b55-41b4-9cc2-74ca7f2e4d4b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.051917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ab8d7-0b55-41b4-9cc2-74ca7f2e4d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.074636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ef4ab8d7-0b55-41b4-9cc2-74ca7f2e4d4b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:41.075860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ef4ab8d7-0b55-41b4-9cc2-74ca7f2e4d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:41.112843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba0546-3ee3-46d4-85c8-2d8075d34b86 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:41.147003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 376/735] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:41.148072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ab8d7-0b55-41b4-9cc2-74ca7f2e4d4b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:41.148351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52eef7-2cbc-42f4-b666-bf812619bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:41.149062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52eef7-2cbc-42f4-b666-bf812619bd3c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.149374 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52eef7-2cbc-42f4-b666-bf812619bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.149649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52eef7-2cbc-42f4-b666-bf812619bd3c None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.150400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52eef7-2cbc-42f4-b666-bf812619bd3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:41.150704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52eef7-2cbc-42f4-b666-bf812619bd3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:41.152081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52eef7-2cbc-42f4-b666-bf812619bd3c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:41.167811 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 360/736] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:41.168432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52eef7-2cbc-42f4-b666-bf812619bd3c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:41.191254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:41.223458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:41.264770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ab8d7-0b55-41b4-9cc2-74ca7f2e4d4b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:41.270213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52eef7-2cbc-42f4-b666-bf812619bd3c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:41.299137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b1ba5-865c-4c5e-a813-e69c676c21e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:41.299800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b1ba5-865c-4c5e-a813-e69c676c21e4 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.300067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b1ba5-865c-4c5e-a813-e69c676c21e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.300346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b1ba5-865c-4c5e-a813-e69c676c21e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.301061 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b1ba5-865c-4c5e-a813-e69c676c21e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:41.301393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b1ba5-865c-4c5e-a813-e69c676c21e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:41.302765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b1ba5-865c-4c5e-a813-e69c676c21e4 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:41.305022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1e430-b1d0-4ca6-8a17-c7bf5c346563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:41.305857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1e430-b1d0-4ca6-8a17-c7bf5c346563 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.306140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1e430-b1d0-4ca6-8a17-c7bf5c346563 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.306423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1e430-b1d0-4ca6-8a17-c7bf5c346563 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.313958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 377/737] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:41.314209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1e430-b1d0-4ca6-8a17-c7bf5c346563 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:41.315410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77649ebf-8a35-4705-8411-a500b6580a27 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.315686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77649ebf-8a35-4705-8411-a500b6580a27 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.315791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1e430-b1d0-4ca6-8a17-c7bf5c346563 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:41.315975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77649ebf-8a35-4705-8411-a500b6580a27 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.317340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 378/738] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:41.318390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77649ebf-8a35-4705-8411-a500b6580a27 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-d9f1e430-b1d0-4ca6-8a17-c7bf5c346563 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:41.335277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:41.336322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:41.337279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:41.337279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:41.337279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:41.337279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:41.337279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:41.337279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:41.337279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:41.337279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:41.337279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 07 07:07:41.337279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:41.337279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 361/739] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:41.337882 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1e430-b1d0-4ca6-8a17-c7bf5c346563 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:41.417380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:41.427498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77649ebf-8a35-4705-8411-a500b6580a27 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:41.438346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1e430-b1d0-4ca6-8a17-c7bf5c346563 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:41.452248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:41.463833 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d494cc0-3591-422f-b28e-226fbc24d9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:41.464513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d494cc0-3591-422f-b28e-226fbc24d9af None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.464803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d494cc0-3591-422f-b28e-226fbc24d9af None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.465084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d494cc0-3591-422f-b28e-226fbc24d9af None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.465852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d494cc0-3591-422f-b28e-226fbc24d9af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:41.467256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d494cc0-3591-422f-b28e-226fbc24d9af None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:41.472101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1996b-37c4-4b00-9c16-68e672417eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:41.472934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1996b-37c4-4b00-9c16-68e672417eac None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.473328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1996b-37c4-4b00-9c16-68e672417eac None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.473643 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1996b-37c4-4b00-9c16-68e672417eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.484474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 379/740] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:07:41 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:07:41.485844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d494cc0-3591-422f-b28e-226fbc24d9af None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:41.487138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1996b-37c4-4b00-9c16-68e672417eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:41.488615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1996b-37c4-4b00-9c16-68e672417eac None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-77c1996b-37c4-4b00-9c16-68e672417eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:41.509631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:41.510692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:41.511765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:41.511765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:41.511765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:41.511765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:41.511765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 362/741] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:41.512538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e94a9-8f7b-4b44-8d12-1fe6ee4aa9af None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.512796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e94a9-8f7b-4b44-8d12-1fe6ee4aa9af None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.513034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e94a9-8f7b-4b44-8d12-1fe6ee4aa9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.531601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-4e6e94a9-8f7b-4b44-8d12-1fe6ee4aa9af None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:41.532810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4e6e94a9-8f7b-4b44-8d12-1fe6ee4aa9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:41.620955 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d494cc0-3591-422f-b28e-226fbc24d9af None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:41.621995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 363/742] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 07:07:41.622929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e94a9-8f7b-4b44-8d12-1fe6ee4aa9af None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:41.674101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc5e88-b0ae-41e7-9385-fe85687f727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:41.674914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc5e88-b0ae-41e7-9385-fe85687f727e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.675197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc5e88-b0ae-41e7-9385-fe85687f727e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.675474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc5e88-b0ae-41e7-9385-fe85687f727e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.684305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc5e88-b0ae-41e7-9385-fe85687f727e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:41.685775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc5e88-b0ae-41e7-9385-fe85687f727e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-64dc5e88-b0ae-41e7-9385-fe85687f727e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:41.701385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:41.702518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:41.704250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:41.704250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:41.704250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:41.704250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:41.704250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:41.704250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:41.704250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:41.704250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:41.704250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:07:41.704250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:41.704250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 380/743] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Jul 7 07:07:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:41.704250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc5e88-b0ae-41e7-9385-fe85687f727e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:41.716752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:41.733205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:41.744121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e94a9-8f7b-4b44-8d12-1fe6ee4aa9af None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:41.779403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77ff35-f2a2-4e02-9f1c-ce83207f8792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:41.780082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77ff35-f2a2-4e02-9f1c-ce83207f8792 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.780363 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77ff35-f2a2-4e02-9f1c-ce83207f8792 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.780718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77ff35-f2a2-4e02-9f1c-ce83207f8792 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.781486 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77ff35-f2a2-4e02-9f1c-ce83207f8792 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:41.781798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77ff35-f2a2-4e02-9f1c-ce83207f8792 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:41.783243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77ff35-f2a2-4e02-9f1c-ce83207f8792 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:41.803188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 364/744] 10.222.0.62 () {56 vars in 1135 bytes} [Thu Jul 7 07:07:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:41.804036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77ff35-f2a2-4e02-9f1c-ce83207f8792 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:41.819317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc5e88-b0ae-41e7-9385-fe85687f727e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:41.858483 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f504c4-4bc9-405e-803e-23bc36a160a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:41.859175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f504c4-4bc9-405e-803e-23bc36a160a2 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.859470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f504c4-4bc9-405e-803e-23bc36a160a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.859753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f504c4-4bc9-405e-803e-23bc36a160a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.860497 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f504c4-4bc9-405e-803e-23bc36a160a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:41.860809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f504c4-4bc9-405e-803e-23bc36a160a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:41.862274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f504c4-4bc9-405e-803e-23bc36a160a2 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:41.879873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 381/745] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:41.879873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f504c4-4bc9-405e-803e-23bc36a160a2 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:41.915804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77ff35-f2a2-4e02-9f1c-ce83207f8792 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:41.948666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:41.954398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbb6b3-f3c4-493a-99f1-d5621298eacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:41.955090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbb6b3-f3c4-493a-99f1-d5621298eacb None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:41.955400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbb6b3-f3c4-493a-99f1-d5621298eacb None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:41.955679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbb6b3-f3c4-493a-99f1-d5621298eacb None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:41.956413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbb6b3-f3c4-493a-99f1-d5621298eacb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:41.957829 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbb6b3-f3c4-493a-99f1-d5621298eacb None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:41.973705 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 365/746] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:07:41 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:07:41.974480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbb6b3-f3c4-493a-99f1-d5621298eacb None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:41.990139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f504c4-4bc9-405e-803e-23bc36a160a2 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:41.994315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:42.047341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e00a8-3d2a-44d0-83a4-498b0000bbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:42.048524 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e00a8-3d2a-44d0-83a4-498b0000bbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:42.048951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e00a8-3d2a-44d0-83a4-498b0000bbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:42.049404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e00a8-3d2a-44d0-83a4-498b0000bbc2 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:42.050414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e00a8-3d2a-44d0-83a4-498b0000bbc2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:42.050872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e00a8-3d2a-44d0-83a4-498b0000bbc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:42.052535 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e00a8-3d2a-44d0-83a4-498b0000bbc2 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:42.075168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 382/747] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Jul 7 07:07:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:42.076289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e00a8-3d2a-44d0-83a4-498b0000bbc2 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:42.106525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbb6b3-f3c4-493a-99f1-d5621298eacb None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:42.145261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3b6c6-fb42-4e35-9946-041fc7f989d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:42.146159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3b6c6-fb42-4e35-9946-041fc7f989d4 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:42.146545 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3b6c6-fb42-4e35-9946-041fc7f989d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:42.146948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3b6c6-fb42-4e35-9946-041fc7f989d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:42.187439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e00a8-3d2a-44d0-83a4-498b0000bbc2 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:42.227182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3b6c6-fb42-4e35-9946-041fc7f989d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:42.227921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:42.229859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3b6c6-fb42-4e35-9946-041fc7f989d4 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:42.243153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:42.243353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fafd54-39ff-4d72-9734-567409def45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:42.244585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fafd54-39ff-4d72-9734-567409def45b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:42.244843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fafd54-39ff-4d72-9734-567409def45b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:42.245183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fafd54-39ff-4d72-9734-567409def45b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:42.256601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fafd54-39ff-4d72-9734-567409def45b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:42.258486 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fafd54-39ff-4d72-9734-567409def45b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-46fafd54-39ff-4d72-9734-567409def45b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:42.284412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:42.285462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:42.286822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:42.286822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:42.286822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:42.286822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:42.286822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:42.286822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:42.286822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:42.286822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:42.286822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 07:07:42.286822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:42.286822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 383/748] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Jul 7 07:07:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:42.287562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fafd54-39ff-4d72-9734-567409def45b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:42.365811 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 366/749] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:07:42.366712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3b6c6-fb42-4e35-9946-041fc7f989d4 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:42.407871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fafd54-39ff-4d72-9734-567409def45b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:42.446012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263b92a-e106-43ea-860c-9c79b1b6646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:42.447153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263b92a-e106-43ea-860c-9c79b1b6646e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:42.447750 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263b92a-e106-43ea-860c-9c79b1b6646e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:42.448172 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263b92a-e106-43ea-860c-9c79b1b6646e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:42.459518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263b92a-e106-43ea-860c-9c79b1b6646e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:42.461340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263b92a-e106-43ea-860c-9c79b1b6646e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-f263b92a-e106-43ea-860c-9c79b1b6646e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:42.490662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:42.491589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:42.493178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:42.493178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:42.493178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:42.493178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:42.493178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 384/750] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:42.493178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263b92a-e106-43ea-860c-9c79b1b6646e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:42.502942 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3b6c6-fb42-4e35-9946-041fc7f989d4 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:42.515081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:42.540844 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4374a-b173-4dfb-909c-8fd2a87192d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:42.541966 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4374a-b173-4dfb-909c-8fd2a87192d6 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:42.542324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:42.542689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4374a-b173-4dfb-909c-8fd2a87192d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:42.543165 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4374a-b173-4dfb-909c-8fd2a87192d6 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:42.544422 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4374a-b173-4dfb-909c-8fd2a87192d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:42.545003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4374a-b173-4dfb-909c-8fd2a87192d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:42.547065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4374a-b173-4dfb-909c-8fd2a87192d6 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:42.567200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 367/751] 10.222.0.62 () {56 vars in 1149 bytes} [Thu Jul 7 07:07:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:42.568929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4374a-b173-4dfb-909c-8fd2a87192d6 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:42.631517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263b92a-e106-43ea-860c-9c79b1b6646e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:42.676148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108f469-650f-4f69-a29a-e09a761abe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:42.677676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108f469-650f-4f69-a29a-e09a761abe32 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:42.678534 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108f469-650f-4f69-a29a-e09a761abe32 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:42.679024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108f469-650f-4f69-a29a-e09a761abe32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:42.694663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108f469-650f-4f69-a29a-e09a761abe32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:42.697135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108f469-650f-4f69-a29a-e09a761abe32 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:42.697305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4374a-b173-4dfb-909c-8fd2a87192d6 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-5108f469-650f-4f69-a29a-e09a761abe32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:42.720343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:42.721343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:42.722232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:42.722232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:42.722232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:42.722232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:42.724934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 385/752] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:42.726166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108f469-650f-4f69-a29a-e09a761abe32 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:42.738779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5152da-8f9e-4c4d-84f6-c722ac34e47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:42.739600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5152da-8f9e-4c4d-84f6-c722ac34e47c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:42.739999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5152da-8f9e-4c4d-84f6-c722ac34e47c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:42.740370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5152da-8f9e-4c4d-84f6-c722ac34e47c None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:42.741671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5152da-8f9e-4c4d-84f6-c722ac34e47c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:42.742023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5152da-8f9e-4c4d-84f6-c722ac34e47c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:42.744375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5152da-8f9e-4c4d-84f6-c722ac34e47c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:42.761310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 368/753] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:42.762437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5152da-8f9e-4c4d-84f6-c722ac34e47c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:42.794515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:42.840577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:42.858603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108f469-650f-4f69-a29a-e09a761abe32 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:42.874330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5152da-8f9e-4c4d-84f6-c722ac34e47c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:42.902488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b73e25-a24d-4ed3-a57e-d7300e5058f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:42.903285 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b73e25-a24d-4ed3-a57e-d7300e5058f5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:42.903670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b73e25-a24d-4ed3-a57e-d7300e5058f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:42.904048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b73e25-a24d-4ed3-a57e-d7300e5058f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:42.910266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a829304-d2f1-4434-aad8-715cf12f443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:42.911109 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a829304-d2f1-4434-aad8-715cf12f443b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:42.911557 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a829304-d2f1-4434-aad8-715cf12f443b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:42.912018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a829304-d2f1-4434-aad8-715cf12f443b None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:42.912893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a829304-d2f1-4434-aad8-715cf12f443b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:42.913364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a829304-d2f1-4434-aad8-715cf12f443b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:42.914960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a829304-d2f1-4434-aad8-715cf12f443b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:42.927852 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 369/754] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:42.928968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a829304-d2f1-4434-aad8-715cf12f443b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:42.978581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b73e25-a24d-4ed3-a57e-d7300e5058f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:42.980070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b73e25-a24d-4ed3-a57e-d7300e5058f5 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:43.019822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:43.033562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a829304-d2f1-4434-aad8-715cf12f443b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:43.068961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa1f03-b255-494a-8f61-a0904db58748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:43.069985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa1f03-b255-494a-8f61-a0904db58748 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:43.070359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa1f03-b255-494a-8f61-a0904db58748 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:43.070793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa1f03-b255-494a-8f61-a0904db58748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:43.073113 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:43.079836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa1f03-b255-494a-8f61-a0904db58748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:43.081636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa1f03-b255-494a-8f61-a0904db58748 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:43.092528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 386/755] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:07:43.093943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b73e25-a24d-4ed3-a57e-d7300e5058f5 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-a8aa1f03-b255-494a-8f61-a0904db58748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:43.098396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:43.099453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:43.100528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:43.100528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:43.100528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:43.100528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:43.100528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:43.100528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:43.100528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:43.100528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:43.106952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 370/756] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:43.106952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa1f03-b255-494a-8f61-a0904db58748 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:43.216274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa1f03-b255-494a-8f61-a0904db58748 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:43.223371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b73e25-a24d-4ed3-a57e-d7300e5058f5 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:43.253620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de158228-7c03-47e4-b0a2-2c318deadbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:43.254753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de158228-7c03-47e4-b0a2-2c318deadbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:43.255193 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de158228-7c03-47e4-b0a2-2c318deadbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:43.255595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de158228-7c03-47e4-b0a2-2c318deadbf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:43.261360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3903ef-6ab6-4e58-b063-2b6fd2b61ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:43.262378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3903ef-6ab6-4e58-b063-2b6fd2b61ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:43.262800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3903ef-6ab6-4e58-b063-2b6fd2b61ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:43.263243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3903ef-6ab6-4e58-b063-2b6fd2b61ae9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:43.269168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de158228-7c03-47e4-b0a2-2c318deadbf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:43.271084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de158228-7c03-47e4-b0a2-2c318deadbf2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:43.271317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3903ef-6ab6-4e58-b063-2b6fd2b61ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:43.273024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3903ef-6ab6-4e58-b063-2b6fd2b61ae9 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:43.287508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-fc3903ef-6ab6-4e58-b063-2b6fd2b61ae9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:43.288458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:43.289946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:43.291163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:43.291163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:43.291163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:43.291163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:43.291163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:43.291163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:43.291163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:43.291163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:43.292989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 387/757] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:43.294020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3903ef-6ab6-4e58-b063-2b6fd2b61ae9 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-de158228-7c03-47e4-b0a2-2c318deadbf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:43.302529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:43.303663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:43.304534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:43.304534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:43.304534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:43.304534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:43.304534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 371/758] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:43.305132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de158228-7c03-47e4-b0a2-2c318deadbf2 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:43.350541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:43.416368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de158228-7c03-47e4-b0a2-2c318deadbf2 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:43.419525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3903ef-6ab6-4e58-b063-2b6fd2b61ae9 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:43.453336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472a251-c055-4a44-9b74-01ce92ad3569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:43.454080 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc551bf-e326-4a02-8d94-9514459879c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:43.454418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472a251-c055-4a44-9b74-01ce92ad3569 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:43.454845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc551bf-e326-4a02-8d94-9514459879c5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:43.454989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472a251-c055-4a44-9b74-01ce92ad3569 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:43.455122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc551bf-e326-4a02-8d94-9514459879c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:43.455400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc551bf-e326-4a02-8d94-9514459879c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:43.455665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472a251-c055-4a44-9b74-01ce92ad3569 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:43.456188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc551bf-e326-4a02-8d94-9514459879c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:43.456494 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc551bf-e326-4a02-8d94-9514459879c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:43.456886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472a251-c055-4a44-9b74-01ce92ad3569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:43.457353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472a251-c055-4a44-9b74-01ce92ad3569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:43.457960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc551bf-e326-4a02-8d94-9514459879c5 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:43.459076 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472a251-c055-4a44-9b74-01ce92ad3569 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:43.476408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 388/759] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:43.476408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc551bf-e326-4a02-8d94-9514459879c5 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:43.481643 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 372/760] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:43.482689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472a251-c055-4a44-9b74-01ce92ad3569 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:43.569148 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:43.601002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc551bf-e326-4a02-8d94-9514459879c5 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:43.611305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:43.615932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472a251-c055-4a44-9b74-01ce92ad3569 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:43.650050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8489f4a-2c42-4d9a-8a4f-405ac3926420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:43.650975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72985926-4bc9-4ec6-a2bb-d2e8ab316602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:43.651142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8489f4a-2c42-4d9a-8a4f-405ac3926420 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:43.651561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8489f4a-2c42-4d9a-8a4f-405ac3926420 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:43.651863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72985926-4bc9-4ec6-a2bb-d2e8ab316602 None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:43.652127 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8489f4a-2c42-4d9a-8a4f-405ac3926420 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:43.652232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72985926-4bc9-4ec6-a2bb-d2e8ab316602 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:43.652401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72985926-4bc9-4ec6-a2bb-d2e8ab316602 None admin] PATH_INFO: `/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/42acdb53c342401da6b32be6b9f3d030/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:43.653248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8489f4a-2c42-4d9a-8a4f-405ac3926420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:43.653694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8489f4a-2c42-4d9a-8a4f-405ac3926420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:43.654371 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72985926-4bc9-4ec6-a2bb-d2e8ab316602 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d7163b6caf648d89fd2cd48f27b1a23, user_id=42acdb53c342401da6b32be6b9f3d030, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:43.655397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8489f4a-2c42-4d9a-8a4f-405ac3926420 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:43.655777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72985926-4bc9-4ec6-a2bb-d2e8ab316602 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:43.669755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 389/761] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:43.670604 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8489f4a-2c42-4d9a-8a4f-405ac3926420 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:43.679642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 373/762] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:07:43 2022] PUT /identity/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/42acdb53c342401da6b32be6b9f3d030/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:07:43.681671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bee002-1c49-4596-93ca-8282bd1f43d3 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:43.682160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bee002-1c49-4596-93ca-8282bd1f43d3 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:43.682652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bee002-1c49-4596-93ca-8282bd1f43d3 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:43.684327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 374/763] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:43.685397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bee002-1c49-4596-93ca-8282bd1f43d3 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:43.809653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8489f4a-2c42-4d9a-8a4f-405ac3926420 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:43.810022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bee002-1c49-4596-93ca-8282bd1f43d3 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:43.841077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:43.848097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541a3f3-ffe5-4cb0-973c-0cc7e479f002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:43.849996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541a3f3-ffe5-4cb0-973c-0cc7e479f002 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:43.849996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541a3f3-ffe5-4cb0-973c-0cc7e479f002 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:43.849996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541a3f3-ffe5-4cb0-973c-0cc7e479f002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:43.850246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541a3f3-ffe5-4cb0-973c-0cc7e479f002 None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=16f8303298b04e009e22ea05ba24a3c5) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:43.850489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541a3f3-ffe5-4cb0-973c-0cc7e479f002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:43.852466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541a3f3-ffe5-4cb0-973c-0cc7e479f002 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:43.860759 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8072cce-5f9e-48b3-a553-3c2aa36b7afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:43.861682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8072cce-5f9e-48b3-a553-3c2aa36b7afd None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:43.861966 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8072cce-5f9e-48b3-a553-3c2aa36b7afd None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:43.862241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8072cce-5f9e-48b3-a553-3c2aa36b7afd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:43.863208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 390/764] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:43 2022] GET /identity/v3/role_assignments?user.id=16f8303298b04e009e22ea05ba24a3c5&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:43.865334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3cb79-0bd9-4321-a2e3-2588544c0a4b None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:43.865628 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3cb79-0bd9-4321-a2e3-2588544c0a4b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:43.865908 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3cb79-0bd9-4321-a2e3-2588544c0a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:43.869719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8072cce-5f9e-48b3-a553-3c2aa36b7afd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:43.870954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8072cce-5f9e-48b3-a553-3c2aa36b7afd None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-c8072cce-5f9e-48b3-a553-3c2aa36b7afd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:43.888515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:43.889493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:43.890351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:43.890351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:43.890351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:43.890351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:43.890351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:43.890351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:43.890351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:43.890351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:43.893034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 375/765] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:43.899251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8072cce-5f9e-48b3-a553-3c2aa36b7afd None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:43.907044 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-15e3cb79-0bd9-4321-a2e3-2588544c0a4b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:43.908271 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-15e3cb79-0bd9-4321-a2e3-2588544c0a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:43.973707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:44.008741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 391/766] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:07:44.047844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3cb79-0bd9-4321-a2e3-2588544c0a4b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:44.055606 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8072cce-5f9e-48b3-a553-3c2aa36b7afd None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:44.109974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07b7f5-5102-4706-8555-869ade9da7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:44.110567 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07b7f5-5102-4706-8555-869ade9da7df None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:44.110855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07b7f5-5102-4706-8555-869ade9da7df None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:44.111136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07b7f5-5102-4706-8555-869ade9da7df None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:44.112002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07b7f5-5102-4706-8555-869ade9da7df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:44.112313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07b7f5-5102-4706-8555-869ade9da7df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:44.113909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07b7f5-5102-4706-8555-869ade9da7df None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:44.127335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 376/767] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:44.133460 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07b7f5-5102-4706-8555-869ade9da7df None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:44.181702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:44.206607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3cb79-0bd9-4321-a2e3-2588544c0a4b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:44.246561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ae5c6-b006-45e2-8821-4bc84390aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:44.247404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ae5c6-b006-45e2-8821-4bc84390aea3 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:44.247674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ae5c6-b006-45e2-8821-4bc84390aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:44.247946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ae5c6-b006-45e2-8821-4bc84390aea3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:44.248716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ae5c6-b006-45e2-8821-4bc84390aea3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:44.250241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ae5c6-b006-45e2-8821-4bc84390aea3 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:44.252583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07b7f5-5102-4706-8555-869ade9da7df None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-054ae5c6-b006-45e2-8821-4bc84390aea3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:44.263416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:44.264392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 07:07:44.265230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:44.269898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 392/768] 10.222.0.62 () {56 vars in 1129 bytes} [Thu Jul 7 07:07:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:44.271481 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498c3b9-8373-4eba-b409-c2c348aa6bb7 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:44.271775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498c3b9-8373-4eba-b409-c2c348aa6bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:44.272058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498c3b9-8373-4eba-b409-c2c348aa6bb7 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:44.273871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 393/769] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:44.274581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498c3b9-8373-4eba-b409-c2c348aa6bb7 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:44.292770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eec003-7b0a-4f11-9a07-f620287e90f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:44.293653 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eec003-7b0a-4f11-9a07-f620287e90f8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:44.294058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eec003-7b0a-4f11-9a07-f620287e90f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:44.294345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eec003-7b0a-4f11-9a07-f620287e90f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:44.295190 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eec003-7b0a-4f11-9a07-f620287e90f8 None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=5dbfbf3cbf304d8c85dabb7ad26380e9) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:44.295768 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eec003-7b0a-4f11-9a07-f620287e90f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:44.298023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eec003-7b0a-4f11-9a07-f620287e90f8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:44.306187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 377/770] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:44 2022] GET /identity/v3/role_assignments?user.id=5dbfbf3cbf304d8c85dabb7ad26380e9&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:44.307692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:44.309554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb24ef-5af3-4d73-98b7-2f1b89828804 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:44.310054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb24ef-5af3-4d73-98b7-2f1b89828804 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:44.310513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb24ef-5af3-4d73-98b7-2f1b89828804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:44.335012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-9dbb24ef-5af3-4d73-98b7-2f1b89828804 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:44.336827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-9dbb24ef-5af3-4d73-98b7-2f1b89828804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:44.425016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 378/771] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:07:44.438021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498c3b9-8373-4eba-b409-c2c348aa6bb7 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:44.471398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb24ef-5af3-4d73-98b7-2f1b89828804 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:44.496190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91afc8-5770-4253-893a-b64a91194ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:44.497144 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91afc8-5770-4253-893a-b64a91194ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:44.497762 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91afc8-5770-4253-893a-b64a91194ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:44.498184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91afc8-5770-4253-893a-b64a91194ad5 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:44.499061 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91afc8-5770-4253-893a-b64a91194ad5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:44.499733 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91afc8-5770-4253-893a-b64a91194ad5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:44.501352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91afc8-5770-4253-893a-b64a91194ad5 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:44.508309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 394/772] 10.222.0.62 () {56 vars in 1124 bytes} [Thu Jul 7 07:07:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:44.515123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91afc8-5770-4253-893a-b64a91194ad5 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:44.572257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:44.633616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:44.650420 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91afc8-5770-4253-893a-b64a91194ad5 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:44.698211 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474005e-b55b-46b6-bc1a-22f7a50a79b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:44.698816 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474005e-b55b-46b6-bc1a-22f7a50a79b0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:44.699102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474005e-b55b-46b6-bc1a-22f7a50a79b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:44.699380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474005e-b55b-46b6-bc1a-22f7a50a79b0 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:44.700102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474005e-b55b-46b6-bc1a-22f7a50a79b0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:44.700409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474005e-b55b-46b6-bc1a-22f7a50a79b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:44.701829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474005e-b55b-46b6-bc1a-22f7a50a79b0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:44.710205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb24ef-5af3-4d73-98b7-2f1b89828804 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:44.721701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 395/773] 10.222.0.62 () {56 vars in 1124 bytes} [Thu Jul 7 07:07:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:44.727008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474005e-b55b-46b6-bc1a-22f7a50a79b0 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:44.783691 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc6d67-1281-435f-ae4d-b244696eb7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:44.784508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc6d67-1281-435f-ae4d-b244696eb7ae None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:44.784789 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc6d67-1281-435f-ae4d-b244696eb7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:44.785067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc6d67-1281-435f-ae4d-b244696eb7ae None admin] PATH_INFO: `/v3/services/network` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:44.785755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc6d67-1281-435f-ae4d-b244696eb7ae None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:44.787146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc6d67-1281-435f-ae4d-b244696eb7ae None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-5ddc6d67-1281-435f-ae4d-b244696eb7ae None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:44.815205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:44.816268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:44.817689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 379/774] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:44 2022] GET /identity/v3/services/network => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:44.822563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc6d67-1281-435f-ae4d-b244696eb7ae None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:44.951452 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc6d67-1281-435f-ae4d-b244696eb7ae None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:44.968416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474005e-b55b-46b6-bc1a-22f7a50a79b0 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:44.973743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:44.998680 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2092e8-66de-4771-a43c-2477ce6c55c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:44.999740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2092e8-66de-4771-a43c-2477ce6c55c6 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:45.000360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2092e8-66de-4771-a43c-2477ce6c55c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:45.001970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2092e8-66de-4771-a43c-2477ce6c55c6 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:45.002893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2092e8-66de-4771-a43c-2477ce6c55c6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:45.003633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2092e8-66de-4771-a43c-2477ce6c55c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:45.005981 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2092e8-66de-4771-a43c-2477ce6c55c6 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:45.016298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 380/775] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:07:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:45.022551 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2092e8-66de-4771-a43c-2477ce6c55c6 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:45.056683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5333596-174c-4fdc-9616-5a43f9d63152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:45.058666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5333596-174c-4fdc-9616-5a43f9d63152 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:45.060281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5333596-174c-4fdc-9616-5a43f9d63152 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:45.060762 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5333596-174c-4fdc-9616-5a43f9d63152 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:45.062177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5333596-174c-4fdc-9616-5a43f9d63152 None admin] RBAC: Adding query filter params (interface=public, service_id=779ad73503cc4946a3c37f0a0ce35a76, region_id=RegionOne) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:45.063679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5333596-174c-4fdc-9616-5a43f9d63152 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:45.068294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5333596-174c-4fdc-9616-5a43f9d63152 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:45.082850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 396/776] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Jul 7 07:07:44 2022] GET /identity/v3/endpoints?service_id=779ad73503cc4946a3c37f0a0ce35a76&interface=public®ion_id=RegionOne => generated 194 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:45.088829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5333596-174c-4fdc-9616-5a43f9d63152 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:45.130669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:45.199380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2092e8-66de-4771-a43c-2477ce6c55c6 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:45.247186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf7a4-36c4-4c09-8e09-b7a6a9a58d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:45.248259 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf7a4-36c4-4c09-8e09-b7a6a9a58d4b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:45.248764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf7a4-36c4-4c09-8e09-b7a6a9a58d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:45.249288 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf7a4-36c4-4c09-8e09-b7a6a9a58d4b None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:45.250209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf7a4-36c4-4c09-8e09-b7a6a9a58d4b None admin] RBAC: Adding query filter params (type=network) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:45.250737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf7a4-36c4-4c09-8e09-b7a6a9a58d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:45.252327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf7a4-36c4-4c09-8e09-b7a6a9a58d4b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:45.265817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 381/777] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:07:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:45.272501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf7a4-36c4-4c09-8e09-b7a6a9a58d4b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:45.278460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5333596-174c-4fdc-9616-5a43f9d63152 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:45.312570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e656f-e809-45f1-967b-c802bed9761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:45.313270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e656f-e809-45f1-967b-c802bed9761c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:45.313570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e656f-e809-45f1-967b-c802bed9761c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:45.313855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e656f-e809-45f1-967b-c802bed9761c None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:45.314617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e656f-e809-45f1-967b-c802bed9761c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:45.316029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e656f-e809-45f1-967b-c802bed9761c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:45.322984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 397/778] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Jul 7 07:07:45 2022] GET /identity/v3/services => generated 772 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:45.340391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:45.451053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf7a4-36c4-4c09-8e09-b7a6a9a58d4b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:45.513129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dda10-bd1c-4d64-ae72-890f36cc4997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:45.513763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dda10-bd1c-4d64-ae72-890f36cc4997 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:45.514046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dda10-bd1c-4d64-ae72-890f36cc4997 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:45.514322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dda10-bd1c-4d64-ae72-890f36cc4997 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:45.515192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dda10-bd1c-4d64-ae72-890f36cc4997 None admin] RBAC: Adding query filter params (interface=public, service_id=18499580561845db8dd57b11f4633b7d, region_id=RegionOne) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:45.515510 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dda10-bd1c-4d64-ae72-890f36cc4997 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:45.516903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dda10-bd1c-4d64-ae72-890f36cc4997 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:45.525446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 382/779] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Jul 7 07:07:45 2022] GET /identity/v3/endpoints?service_id=18499580561845db8dd57b11f4633b7d&interface=public®ion_id=RegionOne => generated 194 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:45.530885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e656f-e809-45f1-967b-c802bed9761c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:45.614964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:45.634482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e656f-e809-45f1-967b-c802bed9761c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:45.672427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ab9c7-d1f1-4d91-b187-fc499aa11149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:45.673105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab9c7-d1f1-4d91-b187-fc499aa11149 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:45.673414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab9c7-d1f1-4d91-b187-fc499aa11149 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:45.673692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab9c7-d1f1-4d91-b187-fc499aa11149 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:45.674382 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ab9c7-d1f1-4d91-b187-fc499aa11149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:45.675769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ab9c7-d1f1-4d91-b187-fc499aa11149 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:45.683468 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 398/780] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Jul 7 07:07:45 2022] GET /identity/v3/services => generated 772 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:46.159563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951f4ae-3b30-4b33-9e80-4730e920ffe8 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:46.159935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951f4ae-3b30-4b33-9e80-4730e920ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:46.160137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951f4ae-3b30-4b33-9e80-4730e920ffe8 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:46.161945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 383/781] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:46.168846 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28b0da-c2d4-4e6e-b155-7534d5beedef None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:46.169788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28b0da-c2d4-4e6e-b155-7534d5beedef None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:46.170268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28b0da-c2d4-4e6e-b155-7534d5beedef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:46.192219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-5a28b0da-c2d4-4e6e-b155-7534d5beedef None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:46.194247 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-5a28b0da-c2d4-4e6e-b155-7534d5beedef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:46.285207 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 399/782] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:07:46.305437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6b52-6006-4a60-99ba-6d01008e3ed8 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:46.305974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6b52-6006-4a60-99ba-6d01008e3ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:46.305974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6b52-6006-4a60-99ba-6d01008e3ed8 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:46.307735 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 384/783] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:46.313511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2346e-9cc5-47ee-a048-1b276e28e1fa None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:46.313807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2346e-9cc5-47ee-a048-1b276e28e1fa None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:46.314099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2346e-9cc5-47ee-a048-1b276e28e1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:46.326713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a6b52-6006-4a60-99ba-6d01008e3ed8 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:46.333198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-7aa2346e-9cc5-47ee-a048-1b276e28e1fa None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:46.334439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7aa2346e-9cc5-47ee-a048-1b276e28e1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:46.466632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 400/784] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:07:46.487885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2346e-9cc5-47ee-a048-1b276e28e1fa None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:46.492954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:46.544236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:46.569493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a6b52-6006-4a60-99ba-6d01008e3ed8 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:46.605637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2346e-9cc5-47ee-a048-1b276e28e1fa None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:46.643260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502a00c-42d6-4230-8622-46fc3cf21b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:46.644181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502a00c-42d6-4230-8622-46fc3cf21b3d None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:46.644472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502a00c-42d6-4230-8622-46fc3cf21b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:46.644754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502a00c-42d6-4230-8622-46fc3cf21b3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:46.645603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8b71c-aeac-453a-843f-8b7595094f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:46.646412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8b71c-aeac-453a-843f-8b7595094f2d None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:46.646693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8b71c-aeac-453a-843f-8b7595094f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:46.653575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8b71c-aeac-453a-843f-8b7595094f2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:46.659537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502a00c-42d6-4230-8622-46fc3cf21b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-d502a00c-42d6-4230-8622-46fc3cf21b3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:46.667547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:46.668471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:46.669791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 385/785] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:46.676961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502a00c-42d6-4230-8622-46fc3cf21b3d None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:46.678177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8b71c-aeac-453a-843f-8b7595094f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-1ed8b71c-aeac-453a-843f-8b7595094f2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:46.685943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:46.686840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:46.688720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 401/786] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:46.696576 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8b71c-aeac-453a-843f-8b7595094f2d None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:46.811404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:46.838918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502a00c-42d6-4230-8622-46fc3cf21b3d None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:46.862754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8b71c-aeac-453a-843f-8b7595094f2d None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:46.891140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acfbf9-11d8-4f19-b2c3-5350de265aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:46.892365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acfbf9-11d8-4f19-b2c3-5350de265aea None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:46.893105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acfbf9-11d8-4f19-b2c3-5350de265aea None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:46.893596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acfbf9-11d8-4f19-b2c3-5350de265aea None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:46.895177 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acfbf9-11d8-4f19-b2c3-5350de265aea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:46.895664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acfbf9-11d8-4f19-b2c3-5350de265aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:46.897919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acfbf9-11d8-4f19-b2c3-5350de265aea None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:46.902419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc4497-36f0-4d27-8309-0f122c670698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:46.903353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc4497-36f0-4d27-8309-0f122c670698 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:46.903600 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc4497-36f0-4d27-8309-0f122c670698 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:46.903820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc4497-36f0-4d27-8309-0f122c670698 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:46.904633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc4497-36f0-4d27-8309-0f122c670698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:46.905637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc4497-36f0-4d27-8309-0f122c670698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:46.907054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc4497-36f0-4d27-8309-0f122c670698 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:46.910096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 386/787] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:46.911639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b2916-d229-4704-ab7b-2339700f4bd0 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:46.912103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b2916-d229-4704-ab7b-2339700f4bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:46.912564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b2916-d229-4704-ab7b-2339700f4bd0 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:46.915245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 387/788] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:46.916140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b2916-d229-4704-ab7b-2339700f4bd0 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:46.921083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 402/789] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:46.922688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240502ab-89d2-452b-b3b1-687e3c627954 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:46.923037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240502ab-89d2-452b-b3b1-687e3c627954 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:46.923417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240502ab-89d2-452b-b3b1-687e3c627954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:46.935202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:46.943550 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-240502ab-89d2-452b-b3b1-687e3c627954 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:46.944810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-240502ab-89d2-452b-b3b1-687e3c627954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:47.021264 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 403/790] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:07:47.022484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240502ab-89d2-452b-b3b1-687e3c627954 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:47.056141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b2916-d229-4704-ab7b-2339700f4bd0 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:47.088671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:47.097745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64c82-5a39-44c1-a9ab-8db62f2f745c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:47.098688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64c82-5a39-44c1-a9ab-8db62f2f745c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:47.099046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64c82-5a39-44c1-a9ab-8db62f2f745c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:47.099392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64c82-5a39-44c1-a9ab-8db62f2f745c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:47.111045 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae64c82-5a39-44c1-a9ab-8db62f2f745c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:47.112863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae64c82-5a39-44c1-a9ab-8db62f2f745c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-1ae64c82-5a39-44c1-a9ab-8db62f2f745c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:47.131255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:47.132324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:47.133436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:47.133436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:47.133436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:47.133436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:47.133656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 388/791] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:47.134938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64c82-5a39-44c1-a9ab-8db62f2f745c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:47.143584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240502ab-89d2-452b-b3b1-687e3c627954 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:47.188535 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1a357-3ffb-47b1-aad7-184d0033a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:47.190165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1a357-3ffb-47b1-aad7-184d0033a07a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:47.190642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1a357-3ffb-47b1-aad7-184d0033a07a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:47.191517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1a357-3ffb-47b1-aad7-184d0033a07a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:47.201365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:47.207123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1a357-3ffb-47b1-aad7-184d0033a07a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:47.209446 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1a357-3ffb-47b1-aad7-184d0033a07a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-6ff1a357-3ffb-47b1-aad7-184d0033a07a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:47.235753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:47.236940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:47.237906 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:47.237906 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:47.237906 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:47.237906 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:47.243886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 404/792] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:47.243886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1a357-3ffb-47b1-aad7-184d0033a07a None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:47.254664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64c82-5a39-44c1-a9ab-8db62f2f745c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:47.298276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4207-48d0-4198-9035-1228537b9c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:47.299934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4207-48d0-4198-9035-1228537b9c12 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:47.300420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4207-48d0-4198-9035-1228537b9c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:47.300871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4207-48d0-4198-9035-1228537b9c12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:47.314823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f4207-48d0-4198-9035-1228537b9c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-1e7f4207-48d0-4198-9035-1228537b9c12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:47.326331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:47.327539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:47.328401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:47.328401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:47.328401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:47.328401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:47.328401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:47.328401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:47.328401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:47.328401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:47.328401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:47.328401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:47.328401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:47.328401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:47.332044 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 389/793] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:47.333158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4207-48d0-4198-9035-1228537b9c12 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:47.371279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1a357-3ffb-47b1-aad7-184d0033a07a None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:47.382146 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:47.421648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47a385-5c97-4426-a092-7e23a4f8b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:47.422566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47a385-5c97-4426-a092-7e23a4f8b21b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:47.422866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47a385-5c97-4426-a092-7e23a4f8b21b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:47.423201 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47a385-5c97-4426-a092-7e23a4f8b21b None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:47.424006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47a385-5c97-4426-a092-7e23a4f8b21b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:47.424375 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47a385-5c97-4426-a092-7e23a4f8b21b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:47.425949 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47a385-5c97-4426-a092-7e23a4f8b21b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:47.439032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 405/794] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:47.440452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47a385-5c97-4426-a092-7e23a4f8b21b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:47.450103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4207-48d0-4198-9035-1228537b9c12 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:47.474228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:47.487231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed98113-f57d-4492-9f38-ce3361a53be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:47.488279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed98113-f57d-4492-9f38-ce3361a53be4 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:47.488760 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed98113-f57d-4492-9f38-ce3361a53be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:47.489253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed98113-f57d-4492-9f38-ce3361a53be4 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:47.490191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed98113-f57d-4492-9f38-ce3361a53be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:47.490693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed98113-f57d-4492-9f38-ce3361a53be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:47.492309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed98113-f57d-4492-9f38-ce3361a53be4 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:47.509973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 390/795] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:47.511140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed98113-f57d-4492-9f38-ce3361a53be4 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:47.555922 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47a385-5c97-4426-a092-7e23a4f8b21b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:47.592580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9d70f-a38d-4914-ae17-53667562e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:47.593342 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9d70f-a38d-4914-ae17-53667562e856 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:47.593624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9d70f-a38d-4914-ae17-53667562e856 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:47.593943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9d70f-a38d-4914-ae17-53667562e856 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:47.595035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9d70f-a38d-4914-ae17-53667562e856 None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:47.595343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9d70f-a38d-4914-ae17-53667562e856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:47.597523 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9d70f-a38d-4914-ae17-53667562e856 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:47.609003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 406/796] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:47.613371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9d70f-a38d-4914-ae17-53667562e856 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:47.625095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed98113-f57d-4492-9f38-ce3361a53be4 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:47.648953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:47.675242 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba199d-180a-4505-8cac-b9b504b14b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:47.676952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba199d-180a-4505-8cac-b9b504b14b61 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:47.677549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba199d-180a-4505-8cac-b9b504b14b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:47.678092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba199d-180a-4505-8cac-b9b504b14b61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:47.688684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba199d-180a-4505-8cac-b9b504b14b61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:47.690745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba199d-180a-4505-8cac-b9b504b14b61 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-ecba199d-180a-4505-8cac-b9b504b14b61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:47.717383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:47.718533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:47.719651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:47.719651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:47.719651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:47.719651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:47.719651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:47.719651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:47.719651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:47.719651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:47.719651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:07:47.719651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:47.722610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 391/797] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Jul 7 07:07:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:47.723935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba199d-180a-4505-8cac-b9b504b14b61 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:47.737245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9d70f-a38d-4914-ae17-53667562e856 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:47.775004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:47.779366 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0a92e-f053-4925-8e72-1294dbabe01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:47.780670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0a92e-f053-4925-8e72-1294dbabe01e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:47.781415 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0a92e-f053-4925-8e72-1294dbabe01e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:47.781698 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0a92e-f053-4925-8e72-1294dbabe01e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:47.792821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0a92e-f053-4925-8e72-1294dbabe01e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:47.795249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0a92e-f053-4925-8e72-1294dbabe01e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-6eb0a92e-f053-4925-8e72-1294dbabe01e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:47.814184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:47.815152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:47.816076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:47.816076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:47.816076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:47.816076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:47.816076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:47.816076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:47.816076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:47.816076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:47.816076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 07 07:07:47.816076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:47.817200 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 407/798] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:47.818450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0a92e-f053-4925-8e72-1294dbabe01e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:47.840442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba199d-180a-4505-8cac-b9b504b14b61 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:47.881916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9203a40-b75b-4ed2-b94c-0795d9f629d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:47.882639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9203a40-b75b-4ed2-b94c-0795d9f629d1 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:47.882926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9203a40-b75b-4ed2-b94c-0795d9f629d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:47.883520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9203a40-b75b-4ed2-b94c-0795d9f629d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:47.895022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9203a40-b75b-4ed2-b94c-0795d9f629d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:47.896758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9203a40-b75b-4ed2-b94c-0795d9f629d1 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-a9203a40-b75b-4ed2-b94c-0795d9f629d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:47.917753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:47.919453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:47.921064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:47.921064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:47.921064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:47.921064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:47.921064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 392/799] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:47.921064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1068cf1-8d6c-4b60-9a4b-ac9251bf6595 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:47.921064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1068cf1-8d6c-4b60-9a4b-ac9251bf6595 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:47.921064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1068cf1-8d6c-4b60-9a4b-ac9251bf6595 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:47.923316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 393/800] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:47.923910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1068cf1-8d6c-4b60-9a4b-ac9251bf6595 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:47.946509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:47.960885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0a92e-f053-4925-8e72-1294dbabe01e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:48.010753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f734d2c-90d1-4f8a-8b31-05e51c7e402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:48.011810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f734d2c-90d1-4f8a-8b31-05e51c7e402f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.012099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f734d2c-90d1-4f8a-8b31-05e51c7e402f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.012718 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f734d2c-90d1-4f8a-8b31-05e51c7e402f None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.013692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f734d2c-90d1-4f8a-8b31-05e51c7e402f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:48.014011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f734d2c-90d1-4f8a-8b31-05e51c7e402f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:48.015462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f734d2c-90d1-4f8a-8b31-05e51c7e402f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:48.032645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:48.045970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 408/801] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Jul 7 07:07:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:48.045970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f734d2c-90d1-4f8a-8b31-05e51c7e402f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:48.046267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1068cf1-8d6c-4b60-9a4b-ac9251bf6595 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:48.093584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422e22d-abe4-4aa4-a3c4-fa8e0ab4a3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:48.094302 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422e22d-abe4-4aa4-a3c4-fa8e0ab4a3ef None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.094580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422e22d-abe4-4aa4-a3c4-fa8e0ab4a3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.094811 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422e22d-abe4-4aa4-a3c4-fa8e0ab4a3ef None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.095647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422e22d-abe4-4aa4-a3c4-fa8e0ab4a3ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:48.096008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422e22d-abe4-4aa4-a3c4-fa8e0ab4a3ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:48.097432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422e22d-abe4-4aa4-a3c4-fa8e0ab4a3ef None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:48.121253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 394/802] 10.222.0.62 () {56 vars in 1135 bytes} [Thu Jul 7 07:07:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:48.121253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa97498-ca43-427f-852b-62b941717c21 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.121253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa97498-ca43-427f-852b-62b941717c21 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.121253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa97498-ca43-427f-852b-62b941717c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.140737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-3aa97498-ca43-427f-852b-62b941717c21 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:48.141606 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3aa97498-ca43-427f-852b-62b941717c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:48.167761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f734d2c-90d1-4f8a-8b31-05e51c7e402f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:48.201677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcef23-b27f-482c-902a-fc70374f3544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:48.202353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcef23-b27f-482c-902a-fc70374f3544 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.202599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcef23-b27f-482c-902a-fc70374f3544 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.202875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcef23-b27f-482c-902a-fc70374f3544 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.203595 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcef23-b27f-482c-902a-fc70374f3544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:48.203895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcef23-b27f-482c-902a-fc70374f3544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:48.205276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcef23-b27f-482c-902a-fc70374f3544 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:48.217630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 409/803] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:48.217964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 395/804] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:07:48.222403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcef23-b27f-482c-902a-fc70374f3544 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:48.222543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa97498-ca43-427f-852b-62b941717c21 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:48.234285 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:48.310888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:48.329688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa97498-ca43-427f-852b-62b941717c21 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:48.330616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcef23-b27f-482c-902a-fc70374f3544 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:48.363793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce4b8-c31c-4c37-a046-3006f1db8ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:48.364483 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5204b-4084-42b6-a38e-e746da9dec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:48.364684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce4b8-c31c-4c37-a046-3006f1db8ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.364972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce4b8-c31c-4c37-a046-3006f1db8ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.365143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5204b-4084-42b6-a38e-e746da9dec3f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.365293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce4b8-c31c-4c37-a046-3006f1db8ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.365452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5204b-4084-42b6-a38e-e746da9dec3f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.365731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5204b-4084-42b6-a38e-e746da9dec3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.375423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ce4b8-c31c-4c37-a046-3006f1db8ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:48.376879 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ce4b8-c31c-4c37-a046-3006f1db8ad4 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-472ce4b8-c31c-4c37-a046-3006f1db8ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:48.394381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:48.395329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:48.396220 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:48.396220 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:48.396220 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:48.396220 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:48.396220 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 396/805] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:48.396726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee416073-018e-492f-be73-8cab95066246 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.397008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee416073-018e-492f-be73-8cab95066246 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.397306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee416073-018e-492f-be73-8cab95066246 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.398611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 397/806] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:48.399315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee416073-018e-492f-be73-8cab95066246 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:48.441525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5204b-4084-42b6-a38e-e746da9dec3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:48.443663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5204b-4084-42b6-a38e-e746da9dec3f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:48.453859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:48.501784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee416073-018e-492f-be73-8cab95066246 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:48.537392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53a045-4e45-4e02-a05e-9b7e35d440e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:48.538215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a045-4e45-4e02-a05e-9b7e35d440e9 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.538499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a045-4e45-4e02-a05e-9b7e35d440e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.538784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a045-4e45-4e02-a05e-9b7e35d440e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.541092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 410/807] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:07:48.541965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5204b-4084-42b6-a38e-e746da9dec3f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:48.546079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53a045-4e45-4e02-a05e-9b7e35d440e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:48.546590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:48.548433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53a045-4e45-4e02-a05e-9b7e35d440e9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-fa53a045-4e45-4e02-a05e-9b7e35d440e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:48.565421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:48.566440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:48.567702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:48.567702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:48.567702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:48.567702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:48.567702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:48.567702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:48.567702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:48.567702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:48.567702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 07:07:48.567702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:48.567702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 398/808] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Jul 7 07:07:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:48.567702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53a045-4e45-4e02-a05e-9b7e35d440e9 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:48.642738 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5204b-4084-42b6-a38e-e746da9dec3f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:48.652307 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:48.668423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53a045-4e45-4e02-a05e-9b7e35d440e9 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:48.677463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26854d18-4ef7-46df-8305-a5da52c0648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:48.678277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26854d18-4ef7-46df-8305-a5da52c0648a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.678557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26854d18-4ef7-46df-8305-a5da52c0648a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.678817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26854d18-4ef7-46df-8305-a5da52c0648a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.679479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26854d18-4ef7-46df-8305-a5da52c0648a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:48.680894 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26854d18-4ef7-46df-8305-a5da52c0648a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-26854d18-4ef7-46df-8305-a5da52c0648a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:48.693120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:48.694294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:48.695315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 411/809] 10.222.0.62 () {56 vars in 1129 bytes} [Thu Jul 7 07:07:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:48.696422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a9e5b-b132-488f-99fe-6be7ee4d17c9 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.696422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a9e5b-b132-488f-99fe-6be7ee4d17c9 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.696422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a9e5b-b132-488f-99fe-6be7ee4d17c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.709829 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff68445-9705-4bcc-a65b-1ace57e72b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:48.710496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff68445-9705-4bcc-a65b-1ace57e72b24 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.710781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff68445-9705-4bcc-a65b-1ace57e72b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.711059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff68445-9705-4bcc-a65b-1ace57e72b24 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.711784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff68445-9705-4bcc-a65b-1ace57e72b24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:48.712093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff68445-9705-4bcc-a65b-1ace57e72b24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:48.712353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-3e9a9e5b-b132-488f-99fe-6be7ee4d17c9 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:48.713492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff68445-9705-4bcc-a65b-1ace57e72b24 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:48.713594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3e9a9e5b-b132-488f-99fe-6be7ee4d17c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:48.724921 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 399/810] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:48.725761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff68445-9705-4bcc-a65b-1ace57e72b24 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:48.782411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:48.786343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 412/811] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:07:48.787237 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a9e5b-b132-488f-99fe-6be7ee4d17c9 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:48.829968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff68445-9705-4bcc-a65b-1ace57e72b24 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:48.863948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35c210-834a-465e-8241-35937bdcebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:48.864840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35c210-834a-465e-8241-35937bdcebd5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.865234 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35c210-834a-465e-8241-35937bdcebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.865557 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35c210-834a-465e-8241-35937bdcebd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.876481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35c210-834a-465e-8241-35937bdcebd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:48.877974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35c210-834a-465e-8241-35937bdcebd5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-cc35c210-834a-465e-8241-35937bdcebd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:48.896183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:48.897110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:48.898615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:48.898615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:48.898615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:48.898615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:48.898615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 400/812] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:48.898615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35c210-834a-465e-8241-35937bdcebd5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:48.904437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a9e5b-b132-488f-99fe-6be7ee4d17c9 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:48.906127 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:48.940984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19ea28-520e-4766-a979-9741a67b6f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:48.941694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19ea28-520e-4766-a979-9741a67b6f0f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:48.941953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19ea28-520e-4766-a979-9741a67b6f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:48.942259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19ea28-520e-4766-a979-9741a67b6f0f None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:48.943423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19ea28-520e-4766-a979-9741a67b6f0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:48.943732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19ea28-520e-4766-a979-9741a67b6f0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:48.945179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19ea28-520e-4766-a979-9741a67b6f0f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:48.962696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 413/813] 10.222.0.62 () {56 vars in 1149 bytes} [Thu Jul 7 07:07:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:48.963514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19ea28-520e-4766-a979-9741a67b6f0f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:49.001128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35c210-834a-465e-8241-35937bdcebd5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:49.010008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:49.035104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e54ea-5073-4bf1-93e3-0117ead07bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:49.035776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e54ea-5073-4bf1-93e3-0117ead07bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:49.036065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e54ea-5073-4bf1-93e3-0117ead07bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:49.036345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e54ea-5073-4bf1-93e3-0117ead07bf4 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:49.037089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e54ea-5073-4bf1-93e3-0117ead07bf4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:49.037460 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e54ea-5073-4bf1-93e3-0117ead07bf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:49.038959 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e54ea-5073-4bf1-93e3-0117ead07bf4 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:49.043759 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 401/814] 10.222.0.62 () {56 vars in 1124 bytes} [Thu Jul 7 07:07:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:49.044540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e54ea-5073-4bf1-93e3-0117ead07bf4 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:49.068150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19ea28-520e-4766-a979-9741a67b6f0f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:49.103820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc7013-649f-413d-a257-523275b3f974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:49.104625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc7013-649f-413d-a257-523275b3f974 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:49.104911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc7013-649f-413d-a257-523275b3f974 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:49.105187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc7013-649f-413d-a257-523275b3f974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:49.112141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc7013-649f-413d-a257-523275b3f974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:49.113644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc7013-649f-413d-a257-523275b3f974 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-78dc7013-649f-413d-a257-523275b3f974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:49.127358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:49.128365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:49.129605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:49.129605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:49.129605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:49.129605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:49.129605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:49.129605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:49.129605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:49.129605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:49.129605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 414/815] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:49.129605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc7013-649f-413d-a257-523275b3f974 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:49.145526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e54ea-5073-4bf1-93e3-0117ead07bf4 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:49.151327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:49.178282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23267b1-d27c-4b50-9729-f79881ec9bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:49.179004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23267b1-d27c-4b50-9729-f79881ec9bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:49.179281 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23267b1-d27c-4b50-9729-f79881ec9bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:49.179552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23267b1-d27c-4b50-9729-f79881ec9bd7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:49.180318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23267b1-d27c-4b50-9729-f79881ec9bd7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:49.181718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23267b1-d27c-4b50-9729-f79881ec9bd7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-c23267b1-d27c-4b50-9729-f79881ec9bd7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:49.194430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:49.195397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:49.196235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 402/816] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:49 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:49.197026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23267b1-d27c-4b50-9729-f79881ec9bd7 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:49.231453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:49.232716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc7013-649f-413d-a257-523275b3f974 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:49.271073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f4f32-8067-4908-b3c7-0bbc71b9dec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:49.271732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f4f32-8067-4908-b3c7-0bbc71b9dec7 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:49.272019 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f4f32-8067-4908-b3c7-0bbc71b9dec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:49.272296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f4f32-8067-4908-b3c7-0bbc71b9dec7 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:49.273038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f4f32-8067-4908-b3c7-0bbc71b9dec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:49.273384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f4f32-8067-4908-b3c7-0bbc71b9dec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:49.275125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f4f32-8067-4908-b3c7-0bbc71b9dec7 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:49.290372 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 415/817] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:49.291203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f4f32-8067-4908-b3c7-0bbc71b9dec7 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:49.301994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23267b1-d27c-4b50-9729-f79881ec9bd7 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:49.337123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb13fa6-efdb-4479-8cbf-34ad3e6bf04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:49.337951 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb13fa6-efdb-4479-8cbf-34ad3e6bf04a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:49.338330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb13fa6-efdb-4479-8cbf-34ad3e6bf04a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:49.338498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb13fa6-efdb-4479-8cbf-34ad3e6bf04a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:49.349982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb13fa6-efdb-4479-8cbf-34ad3e6bf04a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:49.351461 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb13fa6-efdb-4479-8cbf-34ad3e6bf04a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-dcb13fa6-efdb-4479-8cbf-34ad3e6bf04a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:49.368872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:49.369893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:49.370975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:49.370975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:49.370975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:49.370975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:49.370975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 403/818] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:49.370975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb13fa6-efdb-4479-8cbf-34ad3e6bf04a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:49.376057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:49.396930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f4f32-8067-4908-b3c7-0bbc71b9dec7 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:49.435109 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd1dbf-94a1-4025-9c5c-28bd749842cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:49.435710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd1dbf-94a1-4025-9c5c-28bd749842cf None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:49.435995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd1dbf-94a1-4025-9c5c-28bd749842cf None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:49.436274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd1dbf-94a1-4025-9c5c-28bd749842cf None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:49.437000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd1dbf-94a1-4025-9c5c-28bd749842cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:49.437348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd1dbf-94a1-4025-9c5c-28bd749842cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:49.438775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd1dbf-94a1-4025-9c5c-28bd749842cf None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:49.445151 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 416/819] 10.222.0.62 () {56 vars in 1124 bytes} [Thu Jul 7 07:07:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:49.446182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd1dbf-94a1-4025-9c5c-28bd749842cf None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:49.550783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd1dbf-94a1-4025-9c5c-28bd749842cf None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:49.582523 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:49.587035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62579459-8e4a-4229-a0ef-04939acb151d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:49.587720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62579459-8e4a-4229-a0ef-04939acb151d None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:49.587992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62579459-8e4a-4229-a0ef-04939acb151d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:49.588286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62579459-8e4a-4229-a0ef-04939acb151d None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:49.588995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62579459-8e4a-4229-a0ef-04939acb151d None admin] RBAC: Adding query filter params (name=network) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:49.589336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62579459-8e4a-4229-a0ef-04939acb151d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:49.590766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62579459-8e4a-4229-a0ef-04939acb151d None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:49.595363 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb13fa6-efdb-4479-8cbf-34ad3e6bf04a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:49.597371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 417/820] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:07:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:49.598369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62579459-8e4a-4229-a0ef-04939acb151d None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:49.608896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:49.630474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a31e7-2ce9-490a-aec6-237909f20496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:49.630908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a31e7-2ce9-490a-aec6-237909f20496 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:49.631186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a31e7-2ce9-490a-aec6-237909f20496 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:49.631459 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a31e7-2ce9-490a-aec6-237909f20496 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:49.632238 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a31e7-2ce9-490a-aec6-237909f20496 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:49.632544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a31e7-2ce9-490a-aec6-237909f20496 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:49.634051 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a31e7-2ce9-490a-aec6-237909f20496 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:49.645516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 404/821] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:49.646323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a31e7-2ce9-490a-aec6-237909f20496 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:49.704766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62579459-8e4a-4229-a0ef-04939acb151d None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:49.740716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e88b7-3ca0-4812-8d25-2a9a1c4b6b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:49.741560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e88b7-3ca0-4812-8d25-2a9a1c4b6b60 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:49.741843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e88b7-3ca0-4812-8d25-2a9a1c4b6b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:49.742119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e88b7-3ca0-4812-8d25-2a9a1c4b6b60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:49.744641 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a31e7-2ce9-490a-aec6-237909f20496 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:49.749098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e88b7-3ca0-4812-8d25-2a9a1c4b6b60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:49.750585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e88b7-3ca0-4812-8d25-2a9a1c4b6b60 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-302e88b7-3ca0-4812-8d25-2a9a1c4b6b60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:49.764410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:49.765466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:49.766346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:49.766346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:49.766346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:49.766346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:49.766346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:49.766346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:49.766346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:49.766346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:49.766346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 418/822] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:49.766826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e88b7-3ca0-4812-8d25-2a9a1c4b6b60 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:49.784057 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7106d2-371a-4578-8fdd-b2cea54c4b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:49.784717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7106d2-371a-4578-8fdd-b2cea54c4b97 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:49.785000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7106d2-371a-4578-8fdd-b2cea54c4b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:49.785297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7106d2-371a-4578-8fdd-b2cea54c4b97 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:49.786033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7106d2-371a-4578-8fdd-b2cea54c4b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:49.786339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7106d2-371a-4578-8fdd-b2cea54c4b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:49.787712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7106d2-371a-4578-8fdd-b2cea54c4b97 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:49.800029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 405/823] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:49.800888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7106d2-371a-4578-8fdd-b2cea54c4b97 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:49.811788 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:49.833512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:49.868530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e88b7-3ca0-4812-8d25-2a9a1c4b6b60 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:49.900701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7106d2-371a-4578-8fdd-b2cea54c4b97 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:49.902529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6420436-6dc5-4eb7-88f2-97354cf1e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:49.903193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6420436-6dc5-4eb7-88f2-97354cf1e3ee None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:49.903476 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6420436-6dc5-4eb7-88f2-97354cf1e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:49.903794 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6420436-6dc5-4eb7-88f2-97354cf1e3ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:49.904489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6420436-6dc5-4eb7-88f2-97354cf1e3ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:49.905909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6420436-6dc5-4eb7-88f2-97354cf1e3ee None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:49.927812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 419/824] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Jul 7 07:07:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:07:49.928625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6420436-6dc5-4eb7-88f2-97354cf1e3ee None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:49.954760 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0926f1-89c6-47ae-9ca5-e026eda4c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:49.955532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0926f1-89c6-47ae-9ca5-e026eda4c6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:49.955728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0926f1-89c6-47ae-9ca5-e026eda4c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:49.956026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0926f1-89c6-47ae-9ca5-e026eda4c6d5 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:49.956731 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0926f1-89c6-47ae-9ca5-e026eda4c6d5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:49.957033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0926f1-89c6-47ae-9ca5-e026eda4c6d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:49.958527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0926f1-89c6-47ae-9ca5-e026eda4c6d5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:49.964633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 406/825] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:07:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:49.965572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0926f1-89c6-47ae-9ca5-e026eda4c6d5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:50.039986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:50.061118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6420436-6dc5-4eb7-88f2-97354cf1e3ee None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:50.077886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0926f1-89c6-47ae-9ca5-e026eda4c6d5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:50.087454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:50.103545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437fac1-ebad-40ef-8f34-b1136908871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:50.104458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437fac1-ebad-40ef-8f34-b1136908871f None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:50.104740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437fac1-ebad-40ef-8f34-b1136908871f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:50.105018 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437fac1-ebad-40ef-8f34-b1136908871f None admin] PATH_INFO: `/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/16f8303298b04e009e22ea05ba24a3c5/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:50.109256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437fac1-ebad-40ef-8f34-b1136908871f None admin] RBAC: Authorizing `identity:create_grant(project_id=2d7163b6caf648d89fd2cd48f27b1a23, user_id=16f8303298b04e009e22ea05ba24a3c5, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:50.110721 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437fac1-ebad-40ef-8f34-b1136908871f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:50.117163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28d267-a40e-4545-ac40-dbd90bbeab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:50.117940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28d267-a40e-4545-ac40-dbd90bbeab2a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:50.118992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28d267-a40e-4545-ac40-dbd90bbeab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:50.118992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28d267-a40e-4545-ac40-dbd90bbeab2a None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:50.119477 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28d267-a40e-4545-ac40-dbd90bbeab2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:50.119791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28d267-a40e-4545-ac40-dbd90bbeab2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:50.121267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28d267-a40e-4545-ac40-dbd90bbeab2a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:50.125344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 420/826] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:07:49 2022] PUT /identity/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/16f8303298b04e009e22ea05ba24a3c5/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:07:50.126064 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437fac1-ebad-40ef-8f34-b1136908871f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:50.135074 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 407/827] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:50.138902 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28d267-a40e-4545-ac40-dbd90bbeab2a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:50.276273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437fac1-ebad-40ef-8f34-b1136908871f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:50.291330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28d267-a40e-4545-ac40-dbd90bbeab2a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:50.319659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fa4f0-10e0-4075-828a-b2ea806f6bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:50.320512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fa4f0-10e0-4075-828a-b2ea806f6bff None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:50.320793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fa4f0-10e0-4075-828a-b2ea806f6bff None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:50.321063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fa4f0-10e0-4075-828a-b2ea806f6bff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:50.328080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:50.330472 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fa4f0-10e0-4075-828a-b2ea806f6bff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:50.331994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fa4f0-10e0-4075-828a-b2ea806f6bff None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:50.339573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf824cd7-3e21-4ea3-9e22-ec71588eaab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:50.340285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf824cd7-3e21-4ea3-9e22-ec71588eaab8 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:50.340570 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf824cd7-3e21-4ea3-9e22-ec71588eaab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:50.340842 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf824cd7-3e21-4ea3-9e22-ec71588eaab8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:50.341617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf824cd7-3e21-4ea3-9e22-ec71588eaab8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:50.342980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf824cd7-3e21-4ea3-9e22-ec71588eaab8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-330fa4f0-10e0-4075-828a-b2ea806f6bff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:50.349147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:50.350074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:50.350959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:50.350959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:50.350959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:50.350959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:50.350959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:50.350959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:50.350959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:50.350959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:50.350959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 421/828] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:50.351731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fa4f0-10e0-4075-828a-b2ea806f6bff None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:50.370371 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 408/829] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Jul 7 07:07:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:07:50.371736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf824cd7-3e21-4ea3-9e22-ec71588eaab8 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:50.403498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:50.467803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fa4f0-10e0-4075-828a-b2ea806f6bff None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:50.506841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf824cd7-3e21-4ea3-9e22-ec71588eaab8 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:50.510998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db5c2-5e4b-4004-9813-b9ffb3be5545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:50.511670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db5c2-5e4b-4004-9813-b9ffb3be5545 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:50.511948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db5c2-5e4b-4004-9813-b9ffb3be5545 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:50.512226 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db5c2-5e4b-4004-9813-b9ffb3be5545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:50.513204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083db5c2-5e4b-4004-9813-b9ffb3be5545 None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=42acdb53c342401da6b32be6b9f3d030) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:50.513531 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083db5c2-5e4b-4004-9813-b9ffb3be5545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:50.515259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083db5c2-5e4b-4004-9813-b9ffb3be5545 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:50.530017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 422/830] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:50 2022] GET /identity/v3/role_assignments?user.id=42acdb53c342401da6b32be6b9f3d030&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:50.579859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb38d9-ac54-4d22-aefa-38c7098e2e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:50.580954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb38d9-ac54-4d22-aefa-38c7098e2e08 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:50.581410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb38d9-ac54-4d22-aefa-38c7098e2e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:50.581840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb38d9-ac54-4d22-aefa-38c7098e2e08 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:50.582878 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb38d9-ac54-4d22-aefa-38c7098e2e08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:50.583347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb38d9-ac54-4d22-aefa-38c7098e2e08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:50.584992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb38d9-ac54-4d22-aefa-38c7098e2e08 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:50.606892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 409/831] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:50.613265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db5c2-5e4b-4004-9813-b9ffb3be5545 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:50.757429 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db5c2-5e4b-4004-9813-b9ffb3be5545 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:50.761102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:50.797856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f911878-0f87-46d6-9eca-590bbf14504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:50.798757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f911878-0f87-46d6-9eca-590bbf14504d None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:50.799036 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f911878-0f87-46d6-9eca-590bbf14504d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:50.799321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f911878-0f87-46d6-9eca-590bbf14504d None admin] PATH_INFO: `/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/5dbfbf3cbf304d8c85dabb7ad26380e9/roles/bc1cedb3c00f446dbe9f7c756a01d28a` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:50.816709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f911878-0f87-46d6-9eca-590bbf14504d None admin] RBAC: Authorizing `identity:create_grant(project_id=2d7163b6caf648d89fd2cd48f27b1a23, user_id=5dbfbf3cbf304d8c85dabb7ad26380e9, role_id=bc1cedb3c00f446dbe9f7c756a01d28a)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:50.818543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f911878-0f87-46d6-9eca-590bbf14504d None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:50.834837 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 423/832] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:07:50 2022] PUT /identity/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/5dbfbf3cbf304d8c85dabb7ad26380e9/roles/bc1cedb3c00f446dbe9f7c756a01d28a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:07:52.104219 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e3691-957b-437f-9c36-012dd61e4dc9 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.104747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e3691-957b-437f-9c36-012dd61e4dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.104747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e3691-957b-437f-9c36-012dd61e4dc9 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.106445 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 410/833] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:52.111813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205226c-6d08-4510-88be-dbbf5c1743bd None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.112218 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205226c-6d08-4510-88be-dbbf5c1743bd None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.112436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205226c-6d08-4510-88be-dbbf5c1743bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.129332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-d205226c-6d08-4510-88be-dbbf5c1743bd None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:52.130537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d205226c-6d08-4510-88be-dbbf5c1743bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:52.210400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 424/834] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:07:52.232349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e3691-957b-437f-9c36-012dd61e4dc9 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:52.276354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:52.338978 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310a3ef-1412-43e1-8016-457b8756f3a9 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.339423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e3691-957b-437f-9c36-012dd61e4dc9 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:52.339847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310a3ef-1412-43e1-8016-457b8756f3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.340339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310a3ef-1412-43e1-8016-457b8756f3a9 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.346193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 425/835] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:07:52.348321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed564499-42e2-4d7a-967e-1bcaf3d3b821 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.348822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed564499-42e2-4d7a-967e-1bcaf3d3b821 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.349384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed564499-42e2-4d7a-967e-1bcaf3d3b821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.367720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ed564499-42e2-4d7a-967e-1bcaf3d3b821 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:52.369395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ed564499-42e2-4d7a-967e-1bcaf3d3b821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:52.374873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e216ad6-a09c-4270-9d5e-e3ed78b6ca2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:52.375689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e216ad6-a09c-4270-9d5e-e3ed78b6ca2b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.375971 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e216ad6-a09c-4270-9d5e-e3ed78b6ca2b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.376245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e216ad6-a09c-4270-9d5e-e3ed78b6ca2b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.376909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e216ad6-a09c-4270-9d5e-e3ed78b6ca2b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:52.378320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e216ad6-a09c-4270-9d5e-e3ed78b6ca2b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-7e216ad6-a09c-4270-9d5e-e3ed78b6ca2b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:52.390662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:52.391689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:52.392681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 411/836] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:07:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:52.401280 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e216ad6-a09c-4270-9d5e-e3ed78b6ca2b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:52.463127 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 426/837] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:07:52.486334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed564499-42e2-4d7a-967e-1bcaf3d3b821 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:52.501959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:52.503541 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e216ad6-a09c-4270-9d5e-e3ed78b6ca2b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:52.506231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:52.539863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29e08-f395-423d-a59d-3db0833a8008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:52.540542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29e08-f395-423d-a59d-3db0833a8008 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.540835 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29e08-f395-423d-a59d-3db0833a8008 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.541123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29e08-f395-423d-a59d-3db0833a8008 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.541869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f29e08-f395-423d-a59d-3db0833a8008 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:52.542178 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f29e08-f395-423d-a59d-3db0833a8008 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:52.543558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f29e08-f395-423d-a59d-3db0833a8008 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:52.548889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 412/838] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:07:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:52.558270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29e08-f395-423d-a59d-3db0833a8008 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:52.616630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed564499-42e2-4d7a-967e-1bcaf3d3b821 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:52.667324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72399ecd-1971-4a8c-8288-3e80bf2954cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:52.668457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72399ecd-1971-4a8c-8288-3e80bf2954cd None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.669475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72399ecd-1971-4a8c-8288-3e80bf2954cd None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.669961 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72399ecd-1971-4a8c-8288-3e80bf2954cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.682528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29e08-f395-423d-a59d-3db0833a8008 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:52.683935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72399ecd-1971-4a8c-8288-3e80bf2954cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-72399ecd-1971-4a8c-8288-3e80bf2954cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:52.694835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:52.695853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:52.696811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:52.696811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:52.696811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:52.696811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:52.696811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:52.696811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:52.696811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:52.696811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:52.696811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:52.696811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:52.696811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:07:52.696811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:52.703840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 427/839] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:52.705333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72399ecd-1971-4a8c-8288-3e80bf2954cd None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:52.731344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed8d7e-eab1-48a8-b70f-ad91c86ae3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:52.732532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed8d7e-eab1-48a8-b70f-ad91c86ae3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.733078 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed8d7e-eab1-48a8-b70f-ad91c86ae3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.733579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed8d7e-eab1-48a8-b70f-ad91c86ae3b3 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.734590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed8d7e-eab1-48a8-b70f-ad91c86ae3b3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:52.735195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed8d7e-eab1-48a8-b70f-ad91c86ae3b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:52.736814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed8d7e-eab1-48a8-b70f-ad91c86ae3b3 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:52.742849 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 413/840] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:07:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:52.795846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12a2b7-7af3-464b-bc29-37bfeee4862d None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.796168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12a2b7-7af3-464b-bc29-37bfeee4862d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.796412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12a2b7-7af3-464b-bc29-37bfeee4862d None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.798709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 414/841] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:07:52.803919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c185d1-4b7f-4610-85c4-9213e0015816 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.804256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c185d1-4b7f-4610-85c4-9213e0015816 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.804484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c185d1-4b7f-4610-85c4-9213e0015816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.805292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:52.825366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-53c185d1-4b7f-4610-85c4-9213e0015816 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:52.826421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-53c185d1-4b7f-4610-85c4-9213e0015816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:52.842642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72399ecd-1971-4a8c-8288-3e80bf2954cd None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:52.857322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:52.891677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f452-d473-4256-af30-d81c14c3fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:52.892301 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f452-d473-4256-af30-d81c14c3fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.892699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f452-d473-4256-af30-d81c14c3fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.892980 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f452-d473-4256-af30-d81c14c3fdf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.893875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f452-d473-4256-af30-d81c14c3fdf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:52.894237 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f452-d473-4256-af30-d81c14c3fdf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:52.895594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f452-d473-4256-af30-d81c14c3fdf2 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:52.904751 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 428/842] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:07:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:52.905846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 415/843] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:07:52.906747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b2c2f-1ada-4daf-9d9b-10b5bb5987de None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.907124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b2c2f-1ada-4daf-9d9b-10b5bb5987de None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.907413 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b2c2f-1ada-4daf-9d9b-10b5bb5987de None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.909251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 429/844] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:52.910693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c185d1-4b7f-4610-85c4-9213e0015816 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:52.915172 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624f473-261a-4be0-a023-5e7a436c5335 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:52.915172 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624f473-261a-4be0-a023-5e7a436c5335 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:52.915172 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624f473-261a-4be0-a023-5e7a436c5335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:52.934588 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a624f473-261a-4be0-a023-5e7a436c5335 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:52.935699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a624f473-261a-4be0-a023-5e7a436c5335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:53.006103 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 430/845] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:07:53.007067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624f473-261a-4be0-a023-5e7a436c5335 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:53.026449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c185d1-4b7f-4610-85c4-9213e0015816 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:53.063201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84637e-8896-4288-9e27-eee81ec2e455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:53.063998 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84637e-8896-4288-9e27-eee81ec2e455 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:53.064282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84637e-8896-4288-9e27-eee81ec2e455 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:53.064562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84637e-8896-4288-9e27-eee81ec2e455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:53.073431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:53.079277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84637e-8896-4288-9e27-eee81ec2e455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:53.080894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84637e-8896-4288-9e27-eee81ec2e455 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-3d84637e-8896-4288-9e27-eee81ec2e455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:53.101833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:53.102786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:53.103660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:53.103660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:53.103660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:53.103660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:53.103660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 416/846] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:53.103660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84637e-8896-4288-9e27-eee81ec2e455 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:53.119244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624f473-261a-4be0-a023-5e7a436c5335 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:53.121054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:53.157555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f4729-6b2d-4acb-995f-8df61bcc9c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:53.158468 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f4729-6b2d-4acb-995f-8df61bcc9c24 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:53.158790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f4729-6b2d-4acb-995f-8df61bcc9c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:53.159197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f4729-6b2d-4acb-995f-8df61bcc9c24 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:53.159812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f4729-6b2d-4acb-995f-8df61bcc9c24 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:53.161269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f4729-6b2d-4acb-995f-8df61bcc9c24 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-2e0f4729-6b2d-4acb-995f-8df61bcc9c24 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:53.174675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:53.175828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:53.176652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 431/847] 10.222.0.62 () {56 vars in 1132 bytes} [Thu Jul 7 07:07:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:53.177515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f4729-6b2d-4acb-995f-8df61bcc9c24 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:53.217011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84637e-8896-4288-9e27-eee81ec2e455 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:53.251786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333c677-7504-4a95-8084-4a1016687b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:53.252596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333c677-7504-4a95-8084-4a1016687b07 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:53.252870 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333c677-7504-4a95-8084-4a1016687b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:53.253148 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333c677-7504-4a95-8084-4a1016687b07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:53.263901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333c677-7504-4a95-8084-4a1016687b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-8333c677-7504-4a95-8084-4a1016687b07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:53.271698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:53.272646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 417/848] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:53.273860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333c677-7504-4a95-8084-4a1016687b07 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:53.302598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f4729-6b2d-4acb-995f-8df61bcc9c24 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:53.344532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:53.351592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb0aa-89e3-42fa-8ee8-e3f0e3e99f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:53.352539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb0aa-89e3-42fa-8ee8-e3f0e3e99f86 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:53.352998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb0aa-89e3-42fa-8ee8-e3f0e3e99f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:53.353480 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb0aa-89e3-42fa-8ee8-e3f0e3e99f86 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:53.354398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb0aa-89e3-42fa-8ee8-e3f0e3e99f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:53.354893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb0aa-89e3-42fa-8ee8-e3f0e3e99f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:53.356461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb0aa-89e3-42fa-8ee8-e3f0e3e99f86 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:53.372574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:53.375991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 432/849] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:53.381539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb0aa-89e3-42fa-8ee8-e3f0e3e99f86 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:53.408579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333c677-7504-4a95-8084-4a1016687b07 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:53.447057 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffd0ee-fabc-4bc0-99f5-f1d47a39dfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:53.447743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffd0ee-fabc-4bc0-99f5-f1d47a39dfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:53.448008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffd0ee-fabc-4bc0-99f5-f1d47a39dfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:53.448279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffd0ee-fabc-4bc0-99f5-f1d47a39dfd0 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:53.448985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffd0ee-fabc-4bc0-99f5-f1d47a39dfd0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:53.449334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffd0ee-fabc-4bc0-99f5-f1d47a39dfd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:53.450712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffd0ee-fabc-4bc0-99f5-f1d47a39dfd0 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:53.455892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 418/850] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Jul 7 07:07:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:53.456714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffd0ee-fabc-4bc0-99f5-f1d47a39dfd0 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:53.494769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb0aa-89e3-42fa-8ee8-e3f0e3e99f86 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:53.532239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e19f6-8e0e-4e6f-b442-4967e23637e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:53.532916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e19f6-8e0e-4e6f-b442-4967e23637e2 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:53.533275 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e19f6-8e0e-4e6f-b442-4967e23637e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:53.533493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e19f6-8e0e-4e6f-b442-4967e23637e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:53.534247 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e19f6-8e0e-4e6f-b442-4967e23637e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:53.534553 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e19f6-8e0e-4e6f-b442-4967e23637e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:53.535933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e19f6-8e0e-4e6f-b442-4967e23637e2 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:53.549069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 433/851] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:07:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:53.549069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e19f6-8e0e-4e6f-b442-4967e23637e2 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:53.574873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffd0ee-fabc-4bc0-99f5-f1d47a39dfd0 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:53.608599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:53.609716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631f1b0-f71c-43c7-91b4-7bf745076d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:53.610518 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f1b0-f71c-43c7-91b4-7bf745076d98 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:53.610842 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f1b0-f71c-43c7-91b4-7bf745076d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:53.611100 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f1b0-f71c-43c7-91b4-7bf745076d98 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:53.619071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631f1b0-f71c-43c7-91b4-7bf745076d98 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:53.620581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631f1b0-f71c-43c7-91b4-7bf745076d98 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:53.622432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-e631f1b0-f71c-43c7-91b4-7bf745076d98 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:53.635430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:53.636389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:53.637404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:53.637404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:53.637404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:53.637404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:53.637404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:53.637404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:53.637404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:53.637404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:53.637404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 07 07:07:53.637404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:53.641504 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 419/852] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:07:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:53.642347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631f1b0-f71c-43c7-91b4-7bf745076d98 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:53.663655 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e19f6-8e0e-4e6f-b442-4967e23637e2 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:53.705569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999971c-3d09-4656-8767-39264848e9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:53.706288 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999971c-3d09-4656-8767-39264848e9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:53.706623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999971c-3d09-4656-8767-39264848e9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:53.706846 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999971c-3d09-4656-8767-39264848e9b3 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:53.707629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999971c-3d09-4656-8767-39264848e9b3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:53.707965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999971c-3d09-4656-8767-39264848e9b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:53.709469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999971c-3d09-4656-8767-39264848e9b3 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:53.714983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 434/853] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Jul 7 07:07:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:53.716133 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999971c-3d09-4656-8767-39264848e9b3 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:53.762544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631f1b0-f71c-43c7-91b4-7bf745076d98 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:53.815464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de04353-afc3-4d33-84aa-1f28b0229e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:53.817607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de04353-afc3-4d33-84aa-1f28b0229e26 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:53.818214 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de04353-afc3-4d33-84aa-1f28b0229e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:53.818741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de04353-afc3-4d33-84aa-1f28b0229e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:53.834054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de04353-afc3-4d33-84aa-1f28b0229e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:53.836783 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de04353-afc3-4d33-84aa-1f28b0229e26 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:53.850976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999971c-3d09-4656-8767-39264848e9b3 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-0de04353-afc3-4d33-84aa-1f28b0229e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:53.861453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:53.862399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:53.863286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:53.863286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:53.863286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:53.863286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:53.866420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 420/854] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:53.872058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de04353-afc3-4d33-84aa-1f28b0229e26 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:53.878008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:53.900722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663053f2-92d7-4cae-819a-3bbae5576f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:53.901832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663053f2-92d7-4cae-819a-3bbae5576f5f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:53.902320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663053f2-92d7-4cae-819a-3bbae5576f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:53.902795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663053f2-92d7-4cae-819a-3bbae5576f5f None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:53.903868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663053f2-92d7-4cae-819a-3bbae5576f5f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:53.904388 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663053f2-92d7-4cae-819a-3bbae5576f5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:53.906064 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663053f2-92d7-4cae-819a-3bbae5576f5f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:53.929335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 435/855] 10.222.0.62 () {56 vars in 1135 bytes} [Thu Jul 7 07:07:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:53.931485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663053f2-92d7-4cae-819a-3bbae5576f5f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:53.935166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:53.996407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de04353-afc3-4d33-84aa-1f28b0229e26 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:54.031005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d32aa-ed11-47c6-ae15-01ceef3c46c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:54.031762 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d32aa-ed11-47c6-ae15-01ceef3c46c4 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:54.032116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d32aa-ed11-47c6-ae15-01ceef3c46c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:54.032462 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d32aa-ed11-47c6-ae15-01ceef3c46c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:54.033346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d32aa-ed11-47c6-ae15-01ceef3c46c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:54.033813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d32aa-ed11-47c6-ae15-01ceef3c46c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:54.035286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d32aa-ed11-47c6-ae15-01ceef3c46c4 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:54.048172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 421/856] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:54.053566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663053f2-92d7-4cae-819a-3bbae5576f5f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:54.053751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d32aa-ed11-47c6-ae15-01ceef3c46c4 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:54.165648 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d32aa-ed11-47c6-ae15-01ceef3c46c4 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:54.182434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:54.209599 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93219e3-29f3-46d8-bd08-55534705645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:54.210667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93219e3-29f3-46d8-bd08-55534705645d None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:54.211158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93219e3-29f3-46d8-bd08-55534705645d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:54.211561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93219e3-29f3-46d8-bd08-55534705645d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:54.218764 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cb00f-bef3-419b-a41a-fbd60b2ef32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:54.219420 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cb00f-bef3-419b-a41a-fbd60b2ef32d None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:54.219698 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cb00f-bef3-419b-a41a-fbd60b2ef32d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:54.219968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cb00f-bef3-419b-a41a-fbd60b2ef32d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:54.220257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93219e3-29f3-46d8-bd08-55534705645d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:54.221859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93219e3-29f3-46d8-bd08-55534705645d None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-b93219e3-29f3-46d8-bd08-55534705645d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:54.238004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:54.239866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:54.242174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:54.242174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:54.242174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:54.242174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:54.242174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:54.242174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:54.242174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:54.242174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:54.242174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 07:07:54.242174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:54.253276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 422/857] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Jul 7 07:07:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:54.253276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93219e3-29f3-46d8-bd08-55534705645d None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:54.267914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:54.297034 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cb00f-bef3-419b-a41a-fbd60b2ef32d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:54.298632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cb00f-bef3-419b-a41a-fbd60b2ef32d None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:54.352082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93219e3-29f3-46d8-bd08-55534705645d None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:54.390804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720225dd-ba75-4597-aaa1-8595c26a4205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:54.390804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720225dd-ba75-4597-aaa1-8595c26a4205 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:54.390804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720225dd-ba75-4597-aaa1-8595c26a4205 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:54.390804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720225dd-ba75-4597-aaa1-8595c26a4205 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:54.391574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720225dd-ba75-4597-aaa1-8595c26a4205 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:54.391574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720225dd-ba75-4597-aaa1-8595c26a4205 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:54.397241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720225dd-ba75-4597-aaa1-8595c26a4205 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:54.411844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 436/858] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 07 07:07:54.423421 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cb00f-bef3-419b-a41a-fbd60b2ef32d None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:54.423647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 423/859] 10.222.0.62 () {56 vars in 1149 bytes} [Thu Jul 7 07:07:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:54.423647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720225dd-ba75-4597-aaa1-8595c26a4205 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:54.462209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:54.506199 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:54.533391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cb00f-bef3-419b-a41a-fbd60b2ef32d None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:54.568445 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720225dd-ba75-4597-aaa1-8595c26a4205 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:54.570050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be606e44-1436-437f-80d3-e5a8cf2bb9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:54.570974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be606e44-1436-437f-80d3-e5a8cf2bb9fe None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:54.571356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be606e44-1436-437f-80d3-e5a8cf2bb9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:54.571731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be606e44-1436-437f-80d3-e5a8cf2bb9fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:54.583020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be606e44-1436-437f-80d3-e5a8cf2bb9fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:54.584592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be606e44-1436-437f-80d3-e5a8cf2bb9fe None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-be606e44-1436-437f-80d3-e5a8cf2bb9fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:54.602139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:54.603085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:54.603956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:54.603956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:54.603956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:54.603956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:54.608572 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 437/860] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:54.610009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be606e44-1436-437f-80d3-e5a8cf2bb9fe None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:54.611694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9bce9-c1ed-40c1-a168-c4c79cd632d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:54.612516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bce9-c1ed-40c1-a168-c4c79cd632d9 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:54.613244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bce9-c1ed-40c1-a168-c4c79cd632d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:54.613686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bce9-c1ed-40c1-a168-c4c79cd632d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:54.709305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9bce9-c1ed-40c1-a168-c4c79cd632d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:54.711746 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9bce9-c1ed-40c1-a168-c4c79cd632d9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:54.719197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be606e44-1436-437f-80d3-e5a8cf2bb9fe None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:54.745925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:54.751685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:54.757108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af53ebd-cee8-4d6e-9c04-7c4e8c2291fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:54.757983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af53ebd-cee8-4d6e-9c04-7c4e8c2291fc None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:54.758327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af53ebd-cee8-4d6e-9c04-7c4e8c2291fc None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:54.758740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af53ebd-cee8-4d6e-9c04-7c4e8c2291fc None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:54.759534 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af53ebd-cee8-4d6e-9c04-7c4e8c2291fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:54.759908 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af53ebd-cee8-4d6e-9c04-7c4e8c2291fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:54.762036 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af53ebd-cee8-4d6e-9c04-7c4e8c2291fc None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:54.778692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 438/861] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:54.780036 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af53ebd-cee8-4d6e-9c04-7c4e8c2291fc None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:54.840638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 424/862] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:07:54.842069 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63cfbc-4d7e-4992-8710-d63051d49384 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:54.842353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63cfbc-4d7e-4992-8710-d63051d49384 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:54.842884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63cfbc-4d7e-4992-8710-d63051d49384 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:54.844224 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 425/863] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:54.853339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb028f-c94a-45bd-86b5-ab0d8aca465d None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:54.853339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb028f-c94a-45bd-86b5-ab0d8aca465d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:54.853339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb028f-c94a-45bd-86b5-ab0d8aca465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:54.874797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-63cb028f-c94a-45bd-86b5-ab0d8aca465d None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:54.875979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-63cb028f-c94a-45bd-86b5-ab0d8aca465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:54.891161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af53ebd-cee8-4d6e-9c04-7c4e8c2291fc None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:54.932457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b387ac-ab1e-4596-b4c6-a7607731b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:54.933708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b387ac-ab1e-4596-b4c6-a7607731b735 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:54.933995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b387ac-ab1e-4596-b4c6-a7607731b735 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:54.934413 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b387ac-ab1e-4596-b4c6-a7607731b735 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:54.941934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b387ac-ab1e-4596-b4c6-a7607731b735 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:54.943705 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b387ac-ab1e-4596-b4c6-a7607731b735 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:54.953355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 426/864] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:07:54.954455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb028f-c94a-45bd-86b5-ab0d8aca465d None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-a9b387ac-ab1e-4596-b4c6-a7607731b735 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:54.957803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:54.958651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:54.959545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:54.959545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:54.959545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:54.959545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:54.959545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:54.959545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:54.959545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:54.959545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:54.963797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 439/865] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:54.965057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b387ac-ab1e-4596-b4c6-a7607731b735 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:55.015564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:55.024498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:55.069492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb028f-c94a-45bd-86b5-ab0d8aca465d None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:55.073669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b387ac-ab1e-4596-b4c6-a7607731b735 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:55.106766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c577993-1bb6-4aca-b87a-e40aadf9b3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:55.107481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c577993-1bb6-4aca-b87a-e40aadf9b3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:55.107764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c577993-1bb6-4aca-b87a-e40aadf9b3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:55.108040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c577993-1bb6-4aca-b87a-e40aadf9b3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:55.108388 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20cb63-e847-4e44-8b7b-438bbfb3eeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:55.109103 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20cb63-e847-4e44-8b7b-438bbfb3eeff None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:55.109426 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20cb63-e847-4e44-8b7b-438bbfb3eeff None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:55.109704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20cb63-e847-4e44-8b7b-438bbfb3eeff None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:55.110491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20cb63-e847-4e44-8b7b-438bbfb3eeff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:55.110802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20cb63-e847-4e44-8b7b-438bbfb3eeff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:55.112274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20cb63-e847-4e44-8b7b-438bbfb3eeff None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:55.118736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c577993-1bb6-4aca-b87a-e40aadf9b3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:55.120159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c577993-1bb6-4aca-b87a-e40aadf9b3a3 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:55.130047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 440/866] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:55.130047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20cb63-e847-4e44-8b7b-438bbfb3eeff None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-3c577993-1bb6-4aca-b87a-e40aadf9b3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:55.143710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:55.144617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:55.146042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:55.146042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:55.146042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:55.146042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:55.146042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 427/867] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:55.146042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c577993-1bb6-4aca-b87a-e40aadf9b3a3 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:55.240519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20cb63-e847-4e44-8b7b-438bbfb3eeff None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:55.248545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:55.258693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c577993-1bb6-4aca-b87a-e40aadf9b3a3 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:55.270626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:55.277317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8de0f-24c4-4205-b272-984820e56347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:55.277995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8de0f-24c4-4205-b272-984820e56347 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:55.278277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8de0f-24c4-4205-b272-984820e56347 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:55.278554 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8de0f-24c4-4205-b272-984820e56347 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:55.279353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8de0f-24c4-4205-b272-984820e56347 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:55.280738 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8de0f-24c4-4205-b272-984820e56347 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:55.294907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 441/868] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:07:55 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:07:55.295823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8de0f-24c4-4205-b272-984820e56347 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:55.315032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fde181-1756-4aed-83a5-4ce5befed6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:55.316123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fde181-1756-4aed-83a5-4ce5befed6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:55.316597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fde181-1756-4aed-83a5-4ce5befed6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:55.317055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fde181-1756-4aed-83a5-4ce5befed6a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:55.318495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fde181-1756-4aed-83a5-4ce5befed6a6 None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=16f8303298b04e009e22ea05ba24a3c5) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:55.319011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fde181-1756-4aed-83a5-4ce5befed6a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:55.320875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fde181-1756-4aed-83a5-4ce5befed6a6 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:55.330125 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 428/869] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:55 2022] GET /identity/v3/role_assignments?user.id=16f8303298b04e009e22ea05ba24a3c5&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:55.459129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8de0f-24c4-4205-b272-984820e56347 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:55.508414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00b02d-ddfb-4eb3-a210-7187d63484df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:55.509121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00b02d-ddfb-4eb3-a210-7187d63484df None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:55.509443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00b02d-ddfb-4eb3-a210-7187d63484df None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:55.509730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00b02d-ddfb-4eb3-a210-7187d63484df None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:55.510512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00b02d-ddfb-4eb3-a210-7187d63484df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:55.510819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00b02d-ddfb-4eb3-a210-7187d63484df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:55.512253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00b02d-ddfb-4eb3-a210-7187d63484df None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:55.526449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 442/870] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:55.532217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fde181-1756-4aed-83a5-4ce5befed6a6 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:55.640045 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fde181-1756-4aed-83a5-4ce5befed6a6 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:55.675344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ac450-9488-4f5b-a7d1-6e644bc1bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:55.676077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac450-9488-4f5b-a7d1-6e644bc1bf2c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:55.676358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac450-9488-4f5b-a7d1-6e644bc1bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:55.676632 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac450-9488-4f5b-a7d1-6e644bc1bf2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:55.684055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ac450-9488-4f5b-a7d1-6e644bc1bf2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:55.685552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ac450-9488-4f5b-a7d1-6e644bc1bf2c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-037ac450-9488-4f5b-a7d1-6e644bc1bf2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:07:55.700603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:55.701549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:55.702428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:07:55.702428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:07:55.702428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:07:55.702428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:07:55.702428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:07:55.702428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:07:55.702428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:07:55.702428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:55.702428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 429/871] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:55.708010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00b02d-ddfb-4eb3-a210-7187d63484df None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:55.737352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:55.819088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00b02d-ddfb-4eb3-a210-7187d63484df None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:55.840067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65829-f7e1-4fbf-89d4-340eece8fea8 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:55.840381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65829-f7e1-4fbf-89d4-340eece8fea8 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:55.840638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65829-f7e1-4fbf-89d4-340eece8fea8 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:55.845250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 430/872] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:55.847087 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d97f6-4882-47e7-9a5e-3a32cecd2ce3 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:55.847382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d97f6-4882-47e7-9a5e-3a32cecd2ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:55.847758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d97f6-4882-47e7-9a5e-3a32cecd2ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:55.859322 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08743953-d0ab-4e54-93c5-d8a24c1818da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:55.859997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08743953-d0ab-4e54-93c5-d8a24c1818da None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:55.860280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08743953-d0ab-4e54-93c5-d8a24c1818da None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:55.860555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08743953-d0ab-4e54-93c5-d8a24c1818da None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:55.861387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08743953-d0ab-4e54-93c5-d8a24c1818da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:55.861695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08743953-d0ab-4e54-93c5-d8a24c1818da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:55.863265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08743953-d0ab-4e54-93c5-d8a24c1818da None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:55.865950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-721d97f6-4882-47e7-9a5e-3a32cecd2ce3 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:55.867240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-721d97f6-4882-47e7-9a5e-3a32cecd2ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:55.880850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 443/873] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:55.881839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08743953-d0ab-4e54-93c5-d8a24c1818da None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:55.894755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:55.957762 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 431/874] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:07:55.974648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:55.976285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d97f6-4882-47e7-9a5e-3a32cecd2ce3 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:55.995070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08743953-d0ab-4e54-93c5-d8a24c1818da None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:56.044033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0fe79-802f-492f-a348-44b1ab388735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:56.044999 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0fe79-802f-492f-a348-44b1ab388735 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:56.045565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0fe79-802f-492f-a348-44b1ab388735 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:56.045845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0fe79-802f-492f-a348-44b1ab388735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:56.046682 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0fe79-802f-492f-a348-44b1ab388735 None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=5dbfbf3cbf304d8c85dabb7ad26380e9) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:56.046998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0fe79-802f-492f-a348-44b1ab388735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:56.049279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0fe79-802f-492f-a348-44b1ab388735 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:56.057427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 444/875] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:07:55 2022] GET /identity/v3/role_assignments?user.id=5dbfbf3cbf304d8c85dabb7ad26380e9&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:56.095091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d97f6-4882-47e7-9a5e-3a32cecd2ce3 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:56.134600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2e70c-2e13-4de4-bdb2-a202ec07523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:56.135285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2e70c-2e13-4de4-bdb2-a202ec07523a None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:56.135568 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2e70c-2e13-4de4-bdb2-a202ec07523a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:56.135845 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2e70c-2e13-4de4-bdb2-a202ec07523a None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:56.136657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2e70c-2e13-4de4-bdb2-a202ec07523a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:56.138204 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2e70c-2e13-4de4-bdb2-a202ec07523a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:56.157333 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 432/876] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:07:55 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:07:57.466632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b4976-be28-4107-90ac-61257e60de2e None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:57.467614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b4976-be28-4107-90ac-61257e60de2e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:57.468129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b4976-be28-4107-90ac-61257e60de2e None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:57.470053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 445/877] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:57.475453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1786-cb95-4c47-8bec-7b21047b8e67 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:57.476300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1786-cb95-4c47-8bec-7b21047b8e67 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:57.476783 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1786-cb95-4c47-8bec-7b21047b8e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:57.494149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a53d1786-cb95-4c47-8bec-7b21047b8e67 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:57.495660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a53d1786-cb95-4c47-8bec-7b21047b8e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:57.511008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:57.514833 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78c76-ff17-40e6-b13b-478e1e70e631 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:57.515391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78c76-ff17-40e6-b13b-478e1e70e631 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:57.515868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78c76-ff17-40e6-b13b-478e1e70e631 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:57.518790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 446/878] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:57.523188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a5ab9-db66-4532-b69a-8cc97d429f46 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:57.523614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a5ab9-db66-4532-b69a-8cc97d429f46 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:57.524097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a5ab9-db66-4532-b69a-8cc97d429f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:57.542563 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e63a5ab9-db66-4532-b69a-8cc97d429f46 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:57.544088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e63a5ab9-db66-4532-b69a-8cc97d429f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:57.584830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 433/879] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:07:57.608255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d1786-cb95-4c47-8bec-7b21047b8e67 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:57.629241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 447/880] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:07:57.645725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a5ab9-db66-4532-b69a-8cc97d429f46 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:57.718968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d1786-cb95-4c47-8bec-7b21047b8e67 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:57.754476 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:57.756269 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9e262-d54f-4400-9596-b98efc2ebe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:57.757832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9e262-d54f-4400-9596-b98efc2ebe37 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:57.758329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9e262-d54f-4400-9596-b98efc2ebe37 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:57.758830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9e262-d54f-4400-9596-b98efc2ebe37 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:57.759786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9e262-d54f-4400-9596-b98efc2ebe37 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:57.761408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9e262-d54f-4400-9596-b98efc2ebe37 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-bfd9e262-d54f-4400-9596-b98efc2ebe37 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:57.773995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:57.775018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 07:07:57.775839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:57.776583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a5ab9-db66-4532-b69a-8cc97d429f46 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:57.783562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 434/881] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:07:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:57.784716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9e262-d54f-4400-9596-b98efc2ebe37 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:57.800678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:57.815101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e56c27-58b7-45cb-9196-99917d765bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:57.816304 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e56c27-58b7-45cb-9196-99917d765bea None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:57.816889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e56c27-58b7-45cb-9196-99917d765bea None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:57.817801 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e56c27-58b7-45cb-9196-99917d765bea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:57.818661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e56c27-58b7-45cb-9196-99917d765bea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:57.820429 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e56c27-58b7-45cb-9196-99917d765bea None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-89e56c27-58b7-45cb-9196-99917d765bea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:57.833627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:57.834643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:07:57.835490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:57.843230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 448/882] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Jul 7 07:07:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:57.844505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e56c27-58b7-45cb-9196-99917d765bea None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:57.916328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9e262-d54f-4400-9596-b98efc2ebe37 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:57.953898 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da119d2b-5951-411d-8e98-d25e22bee825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:57.954977 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da119d2b-5951-411d-8e98-d25e22bee825 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:57.955512 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da119d2b-5951-411d-8e98-d25e22bee825 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:57.956005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da119d2b-5951-411d-8e98-d25e22bee825 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:57.956916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da119d2b-5951-411d-8e98-d25e22bee825 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:57.957474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da119d2b-5951-411d-8e98-d25e22bee825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:57.959048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da119d2b-5951-411d-8e98-d25e22bee825 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:57.962904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e56c27-58b7-45cb-9196-99917d765bea None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:57.969428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 435/883] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:07:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:57.970561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da119d2b-5951-411d-8e98-d25e22bee825 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:58.005695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3af769-8d57-43e6-9f15-3d67ac67a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:58.006369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3af769-8d57-43e6-9f15-3d67ac67a308 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.006654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3af769-8d57-43e6-9f15-3d67ac67a308 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.006931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3af769-8d57-43e6-9f15-3d67ac67a308 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.007694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3af769-8d57-43e6-9f15-3d67ac67a308 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:58.008256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3af769-8d57-43e6-9f15-3d67ac67a308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:58.010613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3af769-8d57-43e6-9f15-3d67ac67a308 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:58.021106 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 449/884] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Jul 7 07:07:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:58.022488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3af769-8d57-43e6-9f15-3d67ac67a308 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:58.035763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:58.062747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:58.094851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da119d2b-5951-411d-8e98-d25e22bee825 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:58.138323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab5849-b2be-4fca-afea-aa2beded2464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:58.139632 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab5849-b2be-4fca-afea-aa2beded2464 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.140269 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab5849-b2be-4fca-afea-aa2beded2464 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.140748 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab5849-b2be-4fca-afea-aa2beded2464 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.142217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab5849-b2be-4fca-afea-aa2beded2464 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:58.142753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab5849-b2be-4fca-afea-aa2beded2464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:58.144867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab5849-b2be-4fca-afea-aa2beded2464 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:58.148086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3af769-8d57-43e6-9f15-3d67ac67a308 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:58.157573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 436/885] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:07:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:58.158313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab5849-b2be-4fca-afea-aa2beded2464 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:58.192873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f38ecf-ec88-4190-9949-8379a02f352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:58.193807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f38ecf-ec88-4190-9949-8379a02f352c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.194088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f38ecf-ec88-4190-9949-8379a02f352c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.194691 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f38ecf-ec88-4190-9949-8379a02f352c None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.195661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f38ecf-ec88-4190-9949-8379a02f352c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:58.195970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f38ecf-ec88-4190-9949-8379a02f352c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:58.197806 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f38ecf-ec88-4190-9949-8379a02f352c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:58.203295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 450/886] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Jul 7 07:07:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:58.204752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbdeac-9c17-462e-86d2-fa3745877e1e None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.205038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbdeac-9c17-462e-86d2-fa3745877e1e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.205342 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbdeac-9c17-462e-86d2-fa3745877e1e None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.209257 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 451/887] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:58.213875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b63a67-84ae-4b3d-a151-74d24d5aeb97 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.214603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b63a67-84ae-4b3d-a151-74d24d5aeb97 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.215122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b63a67-84ae-4b3d-a151-74d24d5aeb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.234354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-98b63a67-84ae-4b3d-a151-74d24d5aeb97 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:58.235852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-98b63a67-84ae-4b3d-a151-74d24d5aeb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:58.290249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab5849-b2be-4fca-afea-aa2beded2464 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:58.314077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 452/888] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:07:58.315408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996df87-ddc1-4f81-bad0-aab848cc462b None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.315690 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996df87-ddc1-4f81-bad0-aab848cc462b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.316023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996df87-ddc1-4f81-bad0-aab848cc462b None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.321262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 453/889] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:07:58.323561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541dd70-325e-48b8-8a19-dc86294999d5 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.323924 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541dd70-325e-48b8-8a19-dc86294999d5 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.324218 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541dd70-325e-48b8-8a19-dc86294999d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.331853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:58.342342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7f138-5593-440f-ae80-cc53f7931fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:58.343092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7f138-5593-440f-ae80-cc53f7931fcf None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.343442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7f138-5593-440f-ae80-cc53f7931fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.343899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7f138-5593-440f-ae80-cc53f7931fcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.344876 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7f138-5593-440f-ae80-cc53f7931fcf None admin] RBAC: Adding query filter params (interface=public, service_id=67f7d8c3fa66440c93cd6ac1514f43d5, region_id=RegionOne) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:58.345186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7f138-5593-440f-ae80-cc53f7931fcf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:58.346655 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7f138-5593-440f-ae80-cc53f7931fcf None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:58.350509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-0541dd70-325e-48b8-8a19-dc86294999d5 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:07:58.352128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0541dd70-325e-48b8-8a19-dc86294999d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:07:58.353188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 437/890] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Jul 7 07:07:58 2022] GET /identity/v3/endpoints?service_id=67f7d8c3fa66440c93cd6ac1514f43d5&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:58.354136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7f138-5593-440f-ae80-cc53f7931fcf None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:58.362292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:58.436584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 454/891] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:07:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:07:58.437551 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541dd70-325e-48b8-8a19-dc86294999d5 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:58.481602 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7f138-5593-440f-ae80-cc53f7931fcf None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:58.517151 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1b24b-f46f-4d67-96af-2ebbc0e0fc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:58.518048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1b24b-f46f-4d67-96af-2ebbc0e0fc8c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.518397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1b24b-f46f-4d67-96af-2ebbc0e0fc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.518744 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1b24b-f46f-4d67-96af-2ebbc0e0fc8c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.531178 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1b24b-f46f-4d67-96af-2ebbc0e0fc8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-82d1b24b-f46f-4d67-96af-2ebbc0e0fc8c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:07:58.539554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:58.540483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:58.541336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 438/892] 10.222.0.62 () {56 vars in 1120 bytes} [Thu Jul 7 07:07:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:58.542415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1b24b-f46f-4d67-96af-2ebbc0e0fc8c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:58.558360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541dd70-325e-48b8-8a19-dc86294999d5 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:58.591871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:58.597206 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808854-8756-4b54-9a37-42553cc939c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:58.597913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808854-8756-4b54-9a37-42553cc939c0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.598199 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808854-8756-4b54-9a37-42553cc939c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.598477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808854-8756-4b54-9a37-42553cc939c0 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.599167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90808854-8756-4b54-9a37-42553cc939c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:58.600554 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90808854-8756-4b54-9a37-42553cc939c0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:58.607326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 455/893] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Jul 7 07:07:58 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:07:58.608131 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808854-8756-4b54-9a37-42553cc939c0 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:58.622788 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:58.683147 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1b24b-f46f-4d67-96af-2ebbc0e0fc8c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:58.722893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31d8d5-868f-49c7-a413-89b0dfff5038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:58.723894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31d8d5-868f-49c7-a413-89b0dfff5038 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.724280 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31d8d5-868f-49c7-a413-89b0dfff5038 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.724648 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31d8d5-868f-49c7-a413-89b0dfff5038 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.725430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31d8d5-868f-49c7-a413-89b0dfff5038 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:58.726919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31d8d5-868f-49c7-a413-89b0dfff5038 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-fc31d8d5-868f-49c7-a413-89b0dfff5038 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:58.740896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:58.742252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 07:07:58.743167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:07:58.748101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 439/894] 10.222.0.62 () {56 vars in 1132 bytes} [Thu Jul 7 07:07:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:58.750411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31d8d5-868f-49c7-a413-89b0dfff5038 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:58.761606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808854-8756-4b54-9a37-42553cc939c0 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:58.809964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb07f3d-cce9-451a-b42f-b4cc119f439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:58.810985 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb07f3d-cce9-451a-b42f-b4cc119f439f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.811272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb07f3d-cce9-451a-b42f-b4cc119f439f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.811551 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb07f3d-cce9-451a-b42f-b4cc119f439f None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.812338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb07f3d-cce9-451a-b42f-b4cc119f439f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:58.812647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb07f3d-cce9-451a-b42f-b4cc119f439f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:58.814440 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb07f3d-cce9-451a-b42f-b4cc119f439f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:58.824954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 456/895] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Jul 7 07:07:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:58.830294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb07f3d-cce9-451a-b42f-b4cc119f439f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:58.881280 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31d8d5-868f-49c7-a413-89b0dfff5038 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:58.905523 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:58.910315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:58.920601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b614b3-bb70-411e-99e8-fe839212e3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:58.921662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b614b3-bb70-411e-99e8-fe839212e3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:58.922216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b614b3-bb70-411e-99e8-fe839212e3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:58.922699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b614b3-bb70-411e-99e8-fe839212e3d4 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:58.923697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b614b3-bb70-411e-99e8-fe839212e3d4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:58.924212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b614b3-bb70-411e-99e8-fe839212e3d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:58.925841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b614b3-bb70-411e-99e8-fe839212e3d4 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:58.931593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 440/896] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Jul 7 07:07:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:58.941293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b614b3-bb70-411e-99e8-fe839212e3d4 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:58.961162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb07f3d-cce9-451a-b42f-b4cc119f439f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:59.006004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14095f0-6326-456f-a070-ba1f5914a100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:59.007065 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14095f0-6326-456f-a070-ba1f5914a100 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:59.007875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14095f0-6326-456f-a070-ba1f5914a100 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:59.008200 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14095f0-6326-456f-a070-ba1f5914a100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:59.022436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14095f0-6326-456f-a070-ba1f5914a100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:59.024258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14095f0-6326-456f-a070-ba1f5914a100 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-d14095f0-6326-456f-a070-ba1f5914a100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:07:59.044776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:59.045966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:59.048001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:07:59.048001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:07:59.048001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:07:59.048001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:59.050591 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 457/897] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:07:59.052626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b614b3-bb70-411e-99e8-fe839212e3d4 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:59.061357 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14095f0-6326-456f-a070-ba1f5914a100 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:59.097320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797287d7-432c-412b-a9c6-9ae5cce332bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:59.098309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797287d7-432c-412b-a9c6-9ae5cce332bd None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:59.098847 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797287d7-432c-412b-a9c6-9ae5cce332bd None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:59.099277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797287d7-432c-412b-a9c6-9ae5cce332bd None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:59.100155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797287d7-432c-412b-a9c6-9ae5cce332bd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:59.100645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797287d7-432c-412b-a9c6-9ae5cce332bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:59.102435 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797287d7-432c-412b-a9c6-9ae5cce332bd None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:59.108581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 441/898] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Jul 7 07:07:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:59.114098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797287d7-432c-412b-a9c6-9ae5cce332bd None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:59.170369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14095f0-6326-456f-a070-ba1f5914a100 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:59.182406 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:59.182744 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:59.210969 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7543f-0aba-4b15-bad4-c850d5ddda44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:59.212179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7543f-0aba-4b15-bad4-c850d5ddda44 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:59.212672 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7543f-0aba-4b15-bad4-c850d5ddda44 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:59.213186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7543f-0aba-4b15-bad4-c850d5ddda44 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:59.214170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7543f-0aba-4b15-bad4-c850d5ddda44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:59.214686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7543f-0aba-4b15-bad4-c850d5ddda44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:59.216276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7543f-0aba-4b15-bad4-c850d5ddda44 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:59.235727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 458/899] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:59.237024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7543f-0aba-4b15-bad4-c850d5ddda44 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:59.241659 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797287d7-432c-412b-a9c6-9ae5cce332bd None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:59.277865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc34306-2c04-4eff-90d4-bf8f8e09e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:59.278931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc34306-2c04-4eff-90d4-bf8f8e09e20a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:59.279447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc34306-2c04-4eff-90d4-bf8f8e09e20a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:59.280059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc34306-2c04-4eff-90d4-bf8f8e09e20a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:59.281059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc34306-2c04-4eff-90d4-bf8f8e09e20a None admin] RBAC: Adding query filter params (interface=public, service_id=f3ce5ea50bd94ffbab44b716bdc1aa75, region_id=RegionOne) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:59.281609 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc34306-2c04-4eff-90d4-bf8f8e09e20a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:59.283251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc34306-2c04-4eff-90d4-bf8f8e09e20a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:59.289747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 442/900] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Jul 7 07:07:59 2022] GET /identity/v3/endpoints?service_id=f3ce5ea50bd94ffbab44b716bdc1aa75&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:07:59.296176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc34306-2c04-4eff-90d4-bf8f8e09e20a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:59.359660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7543f-0aba-4b15-bad4-c850d5ddda44 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:59.419168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb90950-b460-4860-80c4-9b3ff5f7971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:59.420258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb90950-b460-4860-80c4-9b3ff5f7971c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:59.420543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb90950-b460-4860-80c4-9b3ff5f7971c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:59.420823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb90950-b460-4860-80c4-9b3ff5f7971c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:59.431124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb90950-b460-4860-80c4-9b3ff5f7971c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:59.432920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb90950-b460-4860-80c4-9b3ff5f7971c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:59.444676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc34306-2c04-4eff-90d4-bf8f8e09e20a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-4fb90950-b460-4860-80c4-9b3ff5f7971c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:07:59.454152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:07:59.455120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:07:59.456038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:07:59.456038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:07:59.456038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:07:59.456038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:07:59.456038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:07:59.456038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:07:59.456038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:07:59.456038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:07:59.456038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 07:07:59.456038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:07:59.460840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 459/901] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Jul 7 07:07:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:07:59.461789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb90950-b460-4860-80c4-9b3ff5f7971c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:59.472153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:59.492706 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e62da-766e-4320-92bd-1c86ea8001f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:59.494287 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e62da-766e-4320-92bd-1c86ea8001f8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:59.494841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e62da-766e-4320-92bd-1c86ea8001f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:59.495316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e62da-766e-4320-92bd-1c86ea8001f8 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:59.496192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e62da-766e-4320-92bd-1c86ea8001f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:59.498074 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e62da-766e-4320-92bd-1c86ea8001f8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:59.500071 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:59.506884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 443/902] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Jul 7 07:07:59 2022] GET /identity/v3/services => generated 1268 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:07:59.581341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb90950-b460-4860-80c4-9b3ff5f7971c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:59.620115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb410b-e8a8-4b17-a0d4-c6351865b4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:59.620723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb410b-e8a8-4b17-a0d4-c6351865b4db None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:59.621007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb410b-e8a8-4b17-a0d4-c6351865b4db None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:59.621317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb410b-e8a8-4b17-a0d4-c6351865b4db None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:59.622181 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb410b-e8a8-4b17-a0d4-c6351865b4db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:07:59.622490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb410b-e8a8-4b17-a0d4-c6351865b4db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:59.623956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb410b-e8a8-4b17-a0d4-c6351865b4db None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:59.643990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 460/903] 10.222.0.62 () {56 vars in 1149 bytes} [Thu Jul 7 07:07:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:07:59.649963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e62da-766e-4320-92bd-1c86ea8001f8 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:07:59.755854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e62da-766e-4320-92bd-1c86ea8001f8 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:07:59.791533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9c1d1-2ddf-47b4-9514-4bedaa787843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:07:59.792197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9c1d1-2ddf-47b4-9514-4bedaa787843 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:07:59.792482 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9c1d1-2ddf-47b4-9514-4bedaa787843 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:07:59.792761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9c1d1-2ddf-47b4-9514-4bedaa787843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:07:59.847281 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:07:59.867699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9c1d1-2ddf-47b4-9514-4bedaa787843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:07:59.869177 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9c1d1-2ddf-47b4-9514-4bedaa787843 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:07:59.970229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 444/904] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:07:59 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:07:59.975909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb410b-e8a8-4b17-a0d4-c6351865b4db None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:00.072755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:00.086654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb410b-e8a8-4b17-a0d4-c6351865b4db None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:00.121586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be52be-8413-41cf-b58b-9d370c3f446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:00.122750 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be52be-8413-41cf-b58b-9d370c3f446b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:00.123231 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be52be-8413-41cf-b58b-9d370c3f446b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:00.123707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be52be-8413-41cf-b58b-9d370c3f446b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:00.134479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be52be-8413-41cf-b58b-9d370c3f446b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:00.136227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be52be-8413-41cf-b58b-9d370c3f446b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-a3be52be-8413-41cf-b58b-9d370c3f446b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:00.154210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:00.155119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:00.155993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:08:00.155993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:00.155993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:00.155993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:00.158338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 461/905] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:00.165262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9c1d1-2ddf-47b4-9514-4bedaa787843 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:00.265745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:00.274784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9c1d1-2ddf-47b4-9514-4bedaa787843 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:00.310558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa8ed6-4676-4fa1-9964-c27e5da8c3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:00.311330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8ed6-4676-4fa1-9964-c27e5da8c3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:00.311681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8ed6-4676-4fa1-9964-c27e5da8c3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:00.312026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8ed6-4676-4fa1-9964-c27e5da8c3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:00.312821 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa8ed6-4676-4fa1-9964-c27e5da8c3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:00.313196 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa8ed6-4676-4fa1-9964-c27e5da8c3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:00.314674 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa8ed6-4676-4fa1-9964-c27e5da8c3c3 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:00.319433 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4244fa-e0fe-411b-9dc8-1a0b0dcff48e None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:00.320034 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4244fa-e0fe-411b-9dc8-1a0b0dcff48e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:00.320514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4244fa-e0fe-411b-9dc8-1a0b0dcff48e None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:00.322350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 462/906] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:00.327966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea977917-d07a-45b7-b3c9-5539d1bac4a1 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:00.328323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 445/907] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:00.328641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea977917-d07a-45b7-b3c9-5539d1bac4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:00.329056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea977917-d07a-45b7-b3c9-5539d1bac4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:00.334000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa8ed6-4676-4fa1-9964-c27e5da8c3c3 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:00.347246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ea977917-d07a-45b7-b3c9-5539d1bac4a1 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:00.348794 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ea977917-d07a-45b7-b3c9-5539d1bac4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:00.437579 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 463/908] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:08:00.441686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa8ed6-4676-4fa1-9964-c27e5da8c3c3 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:00.456789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea977917-d07a-45b7-b3c9-5539d1bac4a1 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:00.477544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0d12-277e-495f-b12b-2eaeb5e262dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:00.478355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0d12-277e-495f-b12b-2eaeb5e262dc None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:00.478639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0d12-277e-495f-b12b-2eaeb5e262dc None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:00.478914 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0d12-277e-495f-b12b-2eaeb5e262dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:00.488383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd0d12-277e-495f-b12b-2eaeb5e262dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:00.490489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd0d12-277e-495f-b12b-2eaeb5e262dc None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-16cd0d12-277e-495f-b12b-2eaeb5e262dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:08:00.507099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:00.508520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:00.509499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:08:00.509499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:08:00.509499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:08:00.509499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:08:00.509499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:08:00.509499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:08:00.509499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:00.509499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:00.509499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 446/909] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:00.514401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0d12-277e-495f-b12b-2eaeb5e262dc None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:00.525636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:00.533787 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:00.566301 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea977917-d07a-45b7-b3c9-5539d1bac4a1 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:00.601190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288e321-2d62-4f11-a480-767bb5c13827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:00.602712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288e321-2d62-4f11-a480-767bb5c13827 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:00.603208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288e321-2d62-4f11-a480-767bb5c13827 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:00.603671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288e321-2d62-4f11-a480-767bb5c13827 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:00.604593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288e321-2d62-4f11-a480-767bb5c13827 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:00.606222 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288e321-2d62-4f11-a480-767bb5c13827 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:00.629391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0d12-277e-495f-b12b-2eaeb5e262dc None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:00.629921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 464/910] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:08:00 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:08:00.676023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b056041-6a29-46b2-84d0-27f280430268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:00.676696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b056041-6a29-46b2-84d0-27f280430268 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:00.676980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b056041-6a29-46b2-84d0-27f280430268 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:00.677283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b056041-6a29-46b2-84d0-27f280430268 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:00.678083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b056041-6a29-46b2-84d0-27f280430268 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:00.678391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b056041-6a29-46b2-84d0-27f280430268 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:00.679968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b056041-6a29-46b2-84d0-27f280430268 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:00.694395 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 447/911] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:00.700525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288e321-2d62-4f11-a480-767bb5c13827 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:00.763971 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc172fb-8258-4015-8459-41742c09542c None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:00.764327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc172fb-8258-4015-8459-41742c09542c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:00.764542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc172fb-8258-4015-8459-41742c09542c None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:00.766338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 448/912] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:00.777328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e4f4c-40c5-4514-81c4-9f007e25074f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:00.777328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e4f4c-40c5-4514-81c4-9f007e25074f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:00.777328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e4f4c-40c5-4514-81c4-9f007e25074f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:00.794919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-fe8e4f4c-40c5-4514-81c4-9f007e25074f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:00.796346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-fe8e4f4c-40c5-4514-81c4-9f007e25074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:00.831263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288e321-2d62-4f11-a480-767bb5c13827 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:00.857334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:00.868202 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:00.875633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 449/913] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:00.875868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b4d46-32ad-42e2-92e6-a5f914075b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:00.876541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b4d46-32ad-42e2-92e6-a5f914075b1c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:00.877921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b4d46-32ad-42e2-92e6-a5f914075b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:00.877921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b4d46-32ad-42e2-92e6-a5f914075b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:00.878854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b4d46-32ad-42e2-92e6-a5f914075b1c None admin] RBAC: Adding query filter params (role.id=2c64ff3f3a674e64956bc6527d556f3f, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=5dbfbf3cbf304d8c85dabb7ad26380e9) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:00.879205 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b4d46-32ad-42e2-92e6-a5f914075b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:00.880722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b4d46-32ad-42e2-92e6-a5f914075b1c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:00.893150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 465/914] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:08:00 2022] GET /identity/v3/role_assignments?user.id=5dbfbf3cbf304d8c85dabb7ad26380e9&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=2c64ff3f3a674e64956bc6527d556f3f => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:00.901527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e4f4c-40c5-4514-81c4-9f007e25074f None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:01.014112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e4f4c-40c5-4514-81c4-9f007e25074f None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:01.051540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311de274-a88e-4856-865a-5a06b11ee7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:01.052353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311de274-a88e-4856-865a-5a06b11ee7ce None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:01.052642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311de274-a88e-4856-865a-5a06b11ee7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:01.052918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311de274-a88e-4856-865a-5a06b11ee7ce None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:01.053612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311de274-a88e-4856-865a-5a06b11ee7ce None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:01.055071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311de274-a88e-4856-865a-5a06b11ee7ce None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-311de274-a88e-4856-865a-5a06b11ee7ce None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:01.067952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:01.068980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 07:08:01.069867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:01.073599 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 450/915] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:08:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:01.075688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b4d46-32ad-42e2-92e6-a5f914075b1c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:01.183325 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b4d46-32ad-42e2-92e6-a5f914075b1c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:01.219376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314af3b2-a502-4bc1-8b22-2c3e83af81b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:01.220052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af3b2-a502-4bc1-8b22-2c3e83af81b5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:01.220334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af3b2-a502-4bc1-8b22-2c3e83af81b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:01.220669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af3b2-a502-4bc1-8b22-2c3e83af81b5 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:01.221419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314af3b2-a502-4bc1-8b22-2c3e83af81b5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:01.221779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314af3b2-a502-4bc1-8b22-2c3e83af81b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:01.223274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314af3b2-a502-4bc1-8b22-2c3e83af81b5 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:01.231979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 466/916] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:08:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:01.234524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311de274-a88e-4856-865a-5a06b11ee7ce None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:01.292198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:01.342136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311de274-a88e-4856-865a-5a06b11ee7ce None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:01.378793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2473e2-0dfb-496f-b2bf-f25ed35ff949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:01.379473 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2473e2-0dfb-496f-b2bf-f25ed35ff949 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:01.379758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2473e2-0dfb-496f-b2bf-f25ed35ff949 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:01.380035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2473e2-0dfb-496f-b2bf-f25ed35ff949 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:01.380752 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2473e2-0dfb-496f-b2bf-f25ed35ff949 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:01.381061 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2473e2-0dfb-496f-b2bf-f25ed35ff949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:01.382594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2473e2-0dfb-496f-b2bf-f25ed35ff949 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:01.392731 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 451/917] 10.222.0.62 () {56 vars in 1114 bytes} [Thu Jul 7 07:08:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:01.394103 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314af3b2-a502-4bc1-8b22-2c3e83af81b5 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:01.456939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:01.503217 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314af3b2-a502-4bc1-8b22-2c3e83af81b5 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:01.536905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335f0d8-dda2-4748-a77d-76264f40780e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:01.537592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335f0d8-dda2-4748-a77d-76264f40780e None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:01.537872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335f0d8-dda2-4748-a77d-76264f40780e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:01.538146 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335f0d8-dda2-4748-a77d-76264f40780e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:01.538955 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335f0d8-dda2-4748-a77d-76264f40780e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:01.540335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335f0d8-dda2-4748-a77d-76264f40780e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:01.561130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 467/918] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Jul 7 07:08:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:08:01.601683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6070a6-771d-4ead-a3c5-c19ebb6a34a2 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:01.602210 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6070a6-771d-4ead-a3c5-c19ebb6a34a2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:01.602210 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6070a6-771d-4ead-a3c5-c19ebb6a34a2 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:01.603855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 452/919] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:01.609382 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35c977-7f44-4d00-99f2-db4a73a1df47 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:01.609896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35c977-7f44-4d00-99f2-db4a73a1df47 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:01.609975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35c977-7f44-4d00-99f2-db4a73a1df47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:01.628601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ff35c977-7f44-4d00-99f2-db4a73a1df47 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:01.629857 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ff35c977-7f44-4d00-99f2-db4a73a1df47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:01.712910 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 468/920] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:01.735383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6070a6-771d-4ead-a3c5-c19ebb6a34a2 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:01.848717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6070a6-771d-4ead-a3c5-c19ebb6a34a2 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:01.866287 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:01.885720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9d13d-4e81-4b8c-850d-b1943b2af7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:01.886543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9d13d-4e81-4b8c-850d-b1943b2af7db None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:01.886829 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9d13d-4e81-4b8c-850d-b1943b2af7db None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:01.887159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9d13d-4e81-4b8c-850d-b1943b2af7db None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:01.887815 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9d13d-4e81-4b8c-850d-b1943b2af7db None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:01.889201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9d13d-4e81-4b8c-850d-b1943b2af7db None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-f6e9d13d-4e81-4b8c-850d-b1943b2af7db None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:01.902270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:01.904401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 07:08:01.906387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:01.913241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 453/921] 10.222.0.62 () {56 vars in 1132 bytes} [Thu Jul 7 07:08:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:01.913485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35c977-7f44-4d00-99f2-db4a73a1df47 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:01.954580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:02.012629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35c977-7f44-4d00-99f2-db4a73a1df47 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:02.047104 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f49396-4cb8-4fb3-bf2f-deb6b7095929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:02.047775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49396-4cb8-4fb3-bf2f-deb6b7095929 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:02.048053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49396-4cb8-4fb3-bf2f-deb6b7095929 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:02.048327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49396-4cb8-4fb3-bf2f-deb6b7095929 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:02.049038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f49396-4cb8-4fb3-bf2f-deb6b7095929 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:02.049372 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f49396-4cb8-4fb3-bf2f-deb6b7095929 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:02.050763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f49396-4cb8-4fb3-bf2f-deb6b7095929 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:02.056879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 469/922] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Jul 7 07:08:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:02.063107 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9d13d-4e81-4b8c-850d-b1943b2af7db None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:02.171328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9d13d-4e81-4b8c-850d-b1943b2af7db None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:02.206328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1c483-575e-4cb8-84e3-c4b1d7420e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:02.207014 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1c483-575e-4cb8-84e3-c4b1d7420e26 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:02.207282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1c483-575e-4cb8-84e3-c4b1d7420e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:02.207563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1c483-575e-4cb8-84e3-c4b1d7420e26 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:02.208338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1c483-575e-4cb8-84e3-c4b1d7420e26 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:02.208678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1c483-575e-4cb8-84e3-c4b1d7420e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:02.210213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1c483-575e-4cb8-84e3-c4b1d7420e26 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:02.220365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 454/923] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Jul 7 07:08:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:02.221724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f49396-4cb8-4fb3-bf2f-deb6b7095929 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:02.325196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f49396-4cb8-4fb3-bf2f-deb6b7095929 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:02.327835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:02.362183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadb863-c37b-4228-9f41-603b8154a20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:02.362870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadb863-c37b-4228-9f41-603b8154a20e None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:02.363158 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadb863-c37b-4228-9f41-603b8154a20e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:02.363439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadb863-c37b-4228-9f41-603b8154a20e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:02.364200 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadb863-c37b-4228-9f41-603b8154a20e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:02.365706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadb863-c37b-4228-9f41-603b8154a20e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:02.397274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 470/924] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Jul 7 07:08:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:08:02.886066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6c522-61dc-4137-bd0b-cadcffb43715 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:02.887090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6c522-61dc-4137-bd0b-cadcffb43715 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:02.887607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6c522-61dc-4137-bd0b-cadcffb43715 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:02.889524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 455/925] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:02.895058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778975b-4e65-4149-ad46-5511f0410bea None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:02.895885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778975b-4e65-4149-ad46-5511f0410bea None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:02.896376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778975b-4e65-4149-ad46-5511f0410bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:02.914066 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-d778975b-4e65-4149-ad46-5511f0410bea None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:02.915630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d778975b-4e65-4149-ad46-5511f0410bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:02.992836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 471/926] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:03.015790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6c522-61dc-4137-bd0b-cadcffb43715 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:03.030224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0e7b8-c769-4194-a697-95517571100f None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.030530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0e7b8-c769-4194-a697-95517571100f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.030802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0e7b8-c769-4194-a697-95517571100f None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.032787 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 472/927] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:03.037885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e99f2-cc42-41c7-9e63-3ad7c7942ffc None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.038123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e99f2-cc42-41c7-9e63-3ad7c7942ffc None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.038393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e99f2-cc42-41c7-9e63-3ad7c7942ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.056310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-033e99f2-cc42-41c7-9e63-3ad7c7942ffc None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:03.057703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-033e99f2-cc42-41c7-9e63-3ad7c7942ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:03.070496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:03.137098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6c522-61dc-4137-bd0b-cadcffb43715 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:03.140587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 473/928] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:08:03.168670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e99f2-cc42-41c7-9e63-3ad7c7942ffc None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:03.175113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532a009-ba29-4785-b0f5-bc14006e008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:03.176213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532a009-ba29-4785-b0f5-bc14006e008b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.176735 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532a009-ba29-4785-b0f5-bc14006e008b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.177323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532a009-ba29-4785-b0f5-bc14006e008b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.178209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532a009-ba29-4785-b0f5-bc14006e008b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:03.180011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532a009-ba29-4785-b0f5-bc14006e008b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:03.187607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-7532a009-ba29-4785-b0f5-bc14006e008b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:03.194405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:03.195495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:08:03.196319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:03.199153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 456/929] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Jul 7 07:08:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:03.205326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532a009-ba29-4785-b0f5-bc14006e008b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:03.279381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e99f2-cc42-41c7-9e63-3ad7c7942ffc None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:03.311157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532a009-ba29-4785-b0f5-bc14006e008b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:03.313156 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f91c41-8eae-4e75-80de-9641492d93b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:03.314038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91c41-8eae-4e75-80de-9641492d93b5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.314321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91c41-8eae-4e75-80de-9641492d93b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.314596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91c41-8eae-4e75-80de-9641492d93b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.324066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:03.328895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f91c41-8eae-4e75-80de-9641492d93b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-70f91c41-8eae-4e75-80de-9641492d93b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:08:03.338136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:03.339135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:03.339977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:03.339977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:03.339977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:03.339977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:03.339977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:08:03.339977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:08:03.339977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:08:03.339977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:08:03.339977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:08:03.339977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:08:03.339977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 07:08:03.339977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:03.344502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 474/930] 10.222.0.62 () {56 vars in 1120 bytes} [Thu Jul 7 07:08:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:03.345805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f91c41-8eae-4e75-80de-9641492d93b5 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:03.356355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e5516-8cc6-4c38-b340-3469eac991ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:03.357403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e5516-8cc6-4c38-b340-3469eac991ee None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.357907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e5516-8cc6-4c38-b340-3469eac991ee None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.358406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e5516-8cc6-4c38-b340-3469eac991ee None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.359325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e5516-8cc6-4c38-b340-3469eac991ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:03.359829 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e5516-8cc6-4c38-b340-3469eac991ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:03.361572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e5516-8cc6-4c38-b340-3469eac991ee None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:03.371901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 457/931] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Jul 7 07:08:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:03.373128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e5516-8cc6-4c38-b340-3469eac991ee None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:03.445746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:03.453819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f91c41-8eae-4e75-80de-9641492d93b5 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:03.486941 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e5516-8cc6-4c38-b340-3469eac991ee None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:03.494214 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3759d8d-b9d7-4047-af5c-a9f9a173893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:03.494897 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3759d8d-b9d7-4047-af5c-a9f9a173893e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.495181 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3759d8d-b9d7-4047-af5c-a9f9a173893e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.495458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3759d8d-b9d7-4047-af5c-a9f9a173893e None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.496214 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3759d8d-b9d7-4047-af5c-a9f9a173893e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:03.496522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3759d8d-b9d7-4047-af5c-a9f9a173893e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:03.498070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3759d8d-b9d7-4047-af5c-a9f9a173893e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:03.514964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 475/932] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Jul 7 07:08:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:03.516625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3759d8d-b9d7-4047-af5c-a9f9a173893e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:03.530975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d89c5a-633a-4ed4-a55b-1d9229e440d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:03.532005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d89c5a-633a-4ed4-a55b-1d9229e440d7 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.532514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d89c5a-633a-4ed4-a55b-1d9229e440d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.533001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d89c5a-633a-4ed4-a55b-1d9229e440d7 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.533940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d89c5a-633a-4ed4-a55b-1d9229e440d7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:03.534446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d89c5a-633a-4ed4-a55b-1d9229e440d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:03.536025 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d89c5a-633a-4ed4-a55b-1d9229e440d7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:03.545362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 458/933] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Jul 7 07:08:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:03.548081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d89c5a-633a-4ed4-a55b-1d9229e440d7 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:03.584401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:03.625453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3759d8d-b9d7-4047-af5c-a9f9a173893e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:03.652387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d89c5a-633a-4ed4-a55b-1d9229e440d7 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:03.662150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd90b4-4c28-4c54-88ce-dffd7f8cd4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:03.663286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd90b4-4c28-4c54-88ce-dffd7f8cd4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.663790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd90b4-4c28-4c54-88ce-dffd7f8cd4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.664252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd90b4-4c28-4c54-88ce-dffd7f8cd4f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.672412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:03.676759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd90b4-4c28-4c54-88ce-dffd7f8cd4f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:03.678763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd90b4-4c28-4c54-88ce-dffd7f8cd4f7 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-2abd90b4-4c28-4c54-88ce-dffd7f8cd4f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:03.697745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:03.698853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:03.699942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:08:03.699942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:03.699942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:03.699942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:03.701496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472b037-238c-47e4-87b7-729c2e11a228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:03.702376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b037-238c-47e4-87b7-729c2e11a228 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.702819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b037-238c-47e4-87b7-729c2e11a228 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.703270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b037-238c-47e4-87b7-729c2e11a228 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.704231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472b037-238c-47e4-87b7-729c2e11a228 None admin] RBAC: Adding query filter params (interface=public, service_id=bc7decf6eab742deaf10d213fc665695, region_id=RegionOne) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:03.704715 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472b037-238c-47e4-87b7-729c2e11a228 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:03.705966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 476/934] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:03.706458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472b037-238c-47e4-87b7-729c2e11a228 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:03.707213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd90b4-4c28-4c54-88ce-dffd7f8cd4f7 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:03.717274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 459/935] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Jul 7 07:08:03 2022] GET /identity/v3/endpoints?service_id=bc7decf6eab742deaf10d213fc665695&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:03.718765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6060a9-29bf-46cb-aec4-34bdd395759b None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.719060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6060a9-29bf-46cb-aec4-34bdd395759b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.719327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6060a9-29bf-46cb-aec4-34bdd395759b None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.720812 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 460/936] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:03.721406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6060a9-29bf-46cb-aec4-34bdd395759b None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:03.810950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd90b4-4c28-4c54-88ce-dffd7f8cd4f7 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:03.830231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:03.834929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6060a9-29bf-46cb-aec4-34bdd395759b None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:03.845501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcbbfb-a4b3-4b49-aee1-fd996ac82d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:03.846313 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcbbfb-a4b3-4b49-aee1-fd996ac82d7e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.846600 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcbbfb-a4b3-4b49-aee1-fd996ac82d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.846878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcbbfb-a4b3-4b49-aee1-fd996ac82d7e None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.847690 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcbbfb-a4b3-4b49-aee1-fd996ac82d7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:03.848003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcbbfb-a4b3-4b49-aee1-fd996ac82d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:03.849447 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcbbfb-a4b3-4b49-aee1-fd996ac82d7e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:03.863027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 477/937] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:03.864645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30430b2d-4b3d-409c-b751-9e2684f15a42 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.864996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30430b2d-4b3d-409c-b751-9e2684f15a42 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.865368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30430b2d-4b3d-409c-b751-9e2684f15a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.877922 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b96793-b836-463e-a651-92d97af12392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:03.878696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b96793-b836-463e-a651-92d97af12392 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:03.878984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b96793-b836-463e-a651-92d97af12392 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:03.879380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b96793-b836-463e-a651-92d97af12392 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:03.879946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b96793-b836-463e-a651-92d97af12392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:03.881344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b96793-b836-463e-a651-92d97af12392 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:03.882094 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-30430b2d-4b3d-409c-b751-9e2684f15a42 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:03.883344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-30430b2d-4b3d-409c-b751-9e2684f15a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:03.888437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 461/938] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Jul 7 07:08:03 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:08:03.889935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b96793-b836-463e-a651-92d97af12392 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:03.949498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:03.977274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 478/939] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:04.000486 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30430b2d-4b3d-409c-b751-9e2684f15a42 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:04.032065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b96793-b836-463e-a651-92d97af12392 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:04.073632 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fc6ff-4785-42a8-8ab1-ba58a6c64cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:04.074460 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fc6ff-4785-42a8-8ab1-ba58a6c64cec None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:04.074742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fc6ff-4785-42a8-8ab1-ba58a6c64cec None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:04.075021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fc6ff-4785-42a8-8ab1-ba58a6c64cec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:04.086144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fc6ff-4785-42a8-8ab1-ba58a6c64cec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:04.088297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fc6ff-4785-42a8-8ab1-ba58a6c64cec None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-d87fc6ff-4785-42a8-8ab1-ba58a6c64cec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:08:04.106756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:04.107750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:04.108687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:04.108687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:04.108687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:08:04.108687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:08:04.108687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:08:04.108687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:08:04.108687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:08:04.108687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:08:04.108687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 07:08:04.108687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:04.108687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 462/940] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Jul 7 07:08:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:04.114064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fc6ff-4785-42a8-8ab1-ba58a6c64cec None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:04.139546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30430b2d-4b3d-409c-b751-9e2684f15a42 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:04.145721 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:04.181457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3894256-0630-4c00-a370-d6cde9a33d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:04.182154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3894256-0630-4c00-a370-d6cde9a33d7a None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:04.182441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3894256-0630-4c00-a370-d6cde9a33d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:04.182718 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3894256-0630-4c00-a370-d6cde9a33d7a None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:04.183459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3894256-0630-4c00-a370-d6cde9a33d7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:04.184901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3894256-0630-4c00-a370-d6cde9a33d7a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:04.186416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: WARNING keystone.server.flask.common [None req-b3894256-0630-4c00-a370-d6cde9a33d7a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 07 07:08:04.208025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.sql.core [None req-b3894256-0630-4c00-a370-d6cde9a33d7a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 07 07:08:04.208025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 07 07:08:04.208025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [parameters: {'id': 'e5dd0585e24f4ce29d6926dbdae5717c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 07 07:08:04.208025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80277) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-b3894256-0630-4c00-a370-d6cde9a33d7a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e5dd0585e24f4ce29d6926dbdae5717c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e5dd0585e24f4ce29d6926dbdae5717c. Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result = self._query(query) Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application conn.query(q) Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 07 07:08:04.217912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result.read() Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 07 07:08:04.218807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application next(self.gen) Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application yield resource Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application next(self.gen) Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.session.rollback() Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.force_reraise() Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise self.value Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application session.commit() Jul 07 07:08:04.219737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._prepare_impl() Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.session.flush() Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._flush(objects) Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application compat.raise_( Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application flush_context.execute() Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 07 07:08:04.220601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rec.execute(self) Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 07 07:08:04.221504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result = self._query(query) Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application conn.query(q) Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result.read() Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 07 07:08:04.222283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [parameters: {'id': 'e5dd0585e24f4ce29d6926dbdae5717c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:04.223116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:04.223870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:04.224754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:04.224754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 07 07:08:04.224754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 07 07:08:04.224754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:04.224754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:04.224754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 07 07:08:04.224754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 07 07:08:04.224754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e5dd0585e24f4ce29d6926dbdae5717c. Jul 07 07:08:04.224754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:04.224754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 479/941] 10.222.0.62 () {60 vars in 1140 bytes} [Thu Jul 7 07:08:03 2022] POST /identity/v3/projects => generated 262 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:04.226847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3894256-0630-4c00-a370-d6cde9a33d7a None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:04.248694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fc6ff-4785-42a8-8ab1-ba58a6c64cec None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:04.266493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:04.293639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d742c9-f0e4-4788-ad6b-1d3026666b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:04.295897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d742c9-f0e4-4788-ad6b-1d3026666b0d None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:04.296199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d742c9-f0e4-4788-ad6b-1d3026666b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:04.296795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d742c9-f0e4-4788-ad6b-1d3026666b0d None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:04.298575 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d742c9-f0e4-4788-ad6b-1d3026666b0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:04.298894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d742c9-f0e4-4788-ad6b-1d3026666b0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:04.300355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d742c9-f0e4-4788-ad6b-1d3026666b0d None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:04.320524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 463/942] 10.222.0.62 () {56 vars in 1149 bytes} [Thu Jul 7 07:08:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:04.326414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d742c9-f0e4-4788-ad6b-1d3026666b0d None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:04.356720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3894256-0630-4c00-a370-d6cde9a33d7a None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:04.400297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e7971-b0d7-4d29-b4f5-ef2cd64a8ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:04.402141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e7971-b0d7-4d29-b4f5-ef2cd64a8ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:04.402426 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e7971-b0d7-4d29-b4f5-ef2cd64a8ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:04.402703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e7971-b0d7-4d29-b4f5-ef2cd64a8ff4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:04.415197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e7971-b0d7-4d29-b4f5-ef2cd64a8ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:04.416891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e7971-b0d7-4d29-b4f5-ef2cd64a8ff4 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:04.418711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-4d1e7971-b0d7-4d29-b4f5-ef2cd64a8ff4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:08:04.435459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:04.436387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:04.437296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:08:04.437296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:08:04.437296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:08:04.437296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:08:04.437296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:08:04.437296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:08:04.437296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:04.437296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:04.440981 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d742c9-f0e4-4788-ad6b-1d3026666b0d None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:04.441295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 480/943] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:04.443407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926cc7-3112-4db9-a628-ad69422d2e68 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:04.443749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926cc7-3112-4db9-a628-ad69422d2e68 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:04.444030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926cc7-3112-4db9-a628-ad69422d2e68 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:04.448576 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 481/944] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:04.449445 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00926cc7-3112-4db9-a628-ad69422d2e68 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:04.480239 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd4685-e9b5-4183-9677-b73660591901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:04.480956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd4685-e9b5-4183-9677-b73660591901 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:04.481256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd4685-e9b5-4183-9677-b73660591901 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:04.481533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd4685-e9b5-4183-9677-b73660591901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:04.491857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd4685-e9b5-4183-9677-b73660591901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:04.493317 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd4685-e9b5-4183-9677-b73660591901 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-4ffd4685-e9b5-4183-9677-b73660591901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:04.511669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:04.512637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:04.513561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:08:04.513561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:04.513561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:04.513561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:04.517622 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 464/945] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:04.518893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed635c-aa76-47ee-80fa-e452c1b02e5c None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:04.519190 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed635c-aa76-47ee-80fa-e452c1b02e5c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:04.519468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed635c-aa76-47ee-80fa-e452c1b02e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:04.537505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-19ed635c-aa76-47ee-80fa-e452c1b02e5c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:04.538837 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-19ed635c-aa76-47ee-80fa-e452c1b02e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:04.556442 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:04.564989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00926cc7-3112-4db9-a628-ad69422d2e68 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:04.604164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb30d4-c63e-4f28-8475-540ce5d34653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:04.605042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb30d4-c63e-4f28-8475-540ce5d34653 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:04.605577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb30d4-c63e-4f28-8475-540ce5d34653 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:04.605685 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb30d4-c63e-4f28-8475-540ce5d34653 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:04.606398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb30d4-c63e-4f28-8475-540ce5d34653 None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:04.606707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb30d4-c63e-4f28-8475-540ce5d34653 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:04.608196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb30d4-c63e-4f28-8475-540ce5d34653 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:04.613116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 465/946] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:04.620235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed635c-aa76-47ee-80fa-e452c1b02e5c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:04.627482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 482/947] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:08:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:04.640177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb30d4-c63e-4f28-8475-540ce5d34653 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:04.702411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:04.744957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed635c-aa76-47ee-80fa-e452c1b02e5c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:04.771432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb30d4-c63e-4f28-8475-540ce5d34653 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:04.783209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7061c3f-a69b-4737-921f-24f6a3dd01eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:04.784264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7061c3f-a69b-4737-921f-24f6a3dd01eb None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:04.784264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7061c3f-a69b-4737-921f-24f6a3dd01eb None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:04.784629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7061c3f-a69b-4737-921f-24f6a3dd01eb None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:04.785471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7061c3f-a69b-4737-921f-24f6a3dd01eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:04.785848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7061c3f-a69b-4737-921f-24f6a3dd01eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:04.787333 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7061c3f-a69b-4737-921f-24f6a3dd01eb None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:04.800860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 466/948] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:04.807359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7061c3f-a69b-4737-921f-24f6a3dd01eb None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:04.825467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d35960-cc4d-4ede-96aa-bee0e42d83c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:04.826551 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d35960-cc4d-4ede-96aa-bee0e42d83c8 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:04.827359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d35960-cc4d-4ede-96aa-bee0e42d83c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:04.827834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d35960-cc4d-4ede-96aa-bee0e42d83c8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:04.828725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d35960-cc4d-4ede-96aa-bee0e42d83c8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:04.830392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d35960-cc4d-4ede-96aa-bee0e42d83c8 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-89d35960-cc4d-4ede-96aa-bee0e42d83c8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:04.846084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:04.847159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 07:08:04.848000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:04.848720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 483/949] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:08:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:04.856199 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d35960-cc4d-4ede-96aa-bee0e42d83c8 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:04.894477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:04.944848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7061c3f-a69b-4737-921f-24f6a3dd01eb None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:04.974754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:04.985813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d35960-cc4d-4ede-96aa-bee0e42d83c8 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:04.990943 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f556b-bc66-4c16-a434-3b15dcd2aeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:04.992176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f556b-bc66-4c16-a434-3b15dcd2aeba None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:04.992688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f556b-bc66-4c16-a434-3b15dcd2aeba None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:04.993160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f556b-bc66-4c16-a434-3b15dcd2aeba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:05.003448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f556b-bc66-4c16-a434-3b15dcd2aeba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:05.005744 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f556b-bc66-4c16-a434-3b15dcd2aeba None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:05.023327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a90aa-5236-4777-a716-daf9b1b6625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:05.024118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a90aa-5236-4777-a716-daf9b1b6625d None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:05.024464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a90aa-5236-4777-a716-daf9b1b6625d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:05.024807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a90aa-5236-4777-a716-daf9b1b6625d None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:05.025655 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a90aa-5236-4777-a716-daf9b1b6625d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-c03f556b-bc66-4c16-a434-3b15dcd2aeba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:08:05.025886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:05.026708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:05.027580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:08:05.027580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:08:05.027580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:08:05.027580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:08:05.027580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:08:05.027580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:08:05.027580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:05.027580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:05.028003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a90aa-5236-4777-a716-daf9b1b6625d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:05.028003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a90aa-5236-4777-a716-daf9b1b6625d None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:05.030940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 467/950] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:05.036846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f556b-bc66-4c16-a434-3b15dcd2aeba None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:05.038341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 484/951] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:08:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:05.045713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a90aa-5236-4777-a716-daf9b1b6625d None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:05.155340 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f556b-bc66-4c16-a434-3b15dcd2aeba None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:05.171321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:05.196600 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a90aa-5236-4777-a716-daf9b1b6625d None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:05.197143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21516f14-764b-4014-988f-aa2ee42fb039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:05.198199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21516f14-764b-4014-988f-aa2ee42fb039 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:05.198683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21516f14-764b-4014-988f-aa2ee42fb039 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:05.199203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21516f14-764b-4014-988f-aa2ee42fb039 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:05.200323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21516f14-764b-4014-988f-aa2ee42fb039 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:05.200871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21516f14-764b-4014-988f-aa2ee42fb039 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:05.202571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21516f14-764b-4014-988f-aa2ee42fb039 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:05.221747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 468/952] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:05.223572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21516f14-764b-4014-988f-aa2ee42fb039 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:05.234983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af14198-d37b-4495-94de-d34a92d93a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:05.235660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af14198-d37b-4495-94de-d34a92d93a8c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:05.235945 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af14198-d37b-4495-94de-d34a92d93a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:05.236223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af14198-d37b-4495-94de-d34a92d93a8c None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:05.236934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af14198-d37b-4495-94de-d34a92d93a8c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:05.237265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af14198-d37b-4495-94de-d34a92d93a8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:05.239083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af14198-d37b-4495-94de-d34a92d93a8c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:05.245684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 485/953] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:08:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:05.284564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:05.345529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21516f14-764b-4014-988f-aa2ee42fb039 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:05.382893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e8771-c051-4ba5-8278-b75fca37057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:05.383811 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e8771-c051-4ba5-8278-b75fca37057e None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:05.384099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e8771-c051-4ba5-8278-b75fca37057e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:05.384379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e8771-c051-4ba5-8278-b75fca37057e None admin] PATH_INFO: `/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/5dbfbf3cbf304d8c85dabb7ad26380e9/roles/2c64ff3f3a674e64956bc6527d556f3f` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:05.386727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e8771-c051-4ba5-8278-b75fca37057e None admin] RBAC: Authorizing `identity:create_grant(project_id=2d7163b6caf648d89fd2cd48f27b1a23, user_id=5dbfbf3cbf304d8c85dabb7ad26380e9, role_id=2c64ff3f3a674e64956bc6527d556f3f)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:05.390451 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e8771-c051-4ba5-8278-b75fca37057e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:05.406923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 469/954] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:08:05 2022] PUT /identity/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/5dbfbf3cbf304d8c85dabb7ad26380e9/roles/2c64ff3f3a674e64956bc6527d556f3f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:08:05.976665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de200-74bd-4630-8d4f-ab16215877e0 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:05.977036 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de200-74bd-4630-8d4f-ab16215877e0 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:05.977235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de200-74bd-4630-8d4f-ab16215877e0 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:05.979002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 486/955] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:05.984360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0b1a8-a0cd-4d7a-9595-c9b0162e6fd0 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:05.984823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0b1a8-a0cd-4d7a-9595-c9b0162e6fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:05.984994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0b1a8-a0cd-4d7a-9595-c9b0162e6fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:06.001979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-fdc0b1a8-a0cd-4d7a-9595-c9b0162e6fd0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:06.003186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-fdc0b1a8-a0cd-4d7a-9595-c9b0162e6fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:06.070240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 470/956] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:06.092661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088de200-74bd-4630-8d4f-ab16215877e0 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:06.199549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088de200-74bd-4630-8d4f-ab16215877e0 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:06.240323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3202e-d8dc-4365-88a2-4dba27b4e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:06.241077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3202e-d8dc-4365-88a2-4dba27b4e921 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:06.241395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3202e-d8dc-4365-88a2-4dba27b4e921 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:06.241743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3202e-d8dc-4365-88a2-4dba27b4e921 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:06.242430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3202e-d8dc-4365-88a2-4dba27b4e921 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:06.243838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3202e-d8dc-4365-88a2-4dba27b4e921 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-aea3202e-d8dc-4365-88a2-4dba27b4e921 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:06.257058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:06.258252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:06.259132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 487/957] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Jul 7 07:08:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:06.264907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0b1a8-a0cd-4d7a-9595-c9b0162e6fd0 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:06.298039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:06.369958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0b1a8-a0cd-4d7a-9595-c9b0162e6fd0 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:06.406204 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afa97f-ba39-4170-a0fe-f3766a683673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:06.407257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afa97f-ba39-4170-a0fe-f3766a683673 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:06.407257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afa97f-ba39-4170-a0fe-f3766a683673 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:06.407434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afa97f-ba39-4170-a0fe-f3766a683673 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:06.410702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afa97f-ba39-4170-a0fe-f3766a683673 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:06.410702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afa97f-ba39-4170-a0fe-f3766a683673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:06.410702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afa97f-ba39-4170-a0fe-f3766a683673 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:06.415486 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 471/958] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Jul 7 07:08:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:06.421576 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3202e-d8dc-4365-88a2-4dba27b4e921 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:06.438714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:06.528324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3202e-d8dc-4365-88a2-4dba27b4e921 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:06.561515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb3f67-1412-4ac7-96f0-4dcc11a7d72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:06.562185 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3f67-1412-4ac7-96f0-4dcc11a7d72a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:06.562465 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3f67-1412-4ac7-96f0-4dcc11a7d72a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:06.562736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3f67-1412-4ac7-96f0-4dcc11a7d72a None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:06.563439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb3f67-1412-4ac7-96f0-4dcc11a7d72a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:06.563739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb3f67-1412-4ac7-96f0-4dcc11a7d72a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:06.565107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb3f67-1412-4ac7-96f0-4dcc11a7d72a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:06.570847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 488/959] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Jul 7 07:08:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:06.576494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afa97f-ba39-4170-a0fe-f3766a683673 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:06.677589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:06.682225 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afa97f-ba39-4170-a0fe-f3766a683673 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:06.718480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808324c1-7298-42b9-bd88-720ce5285694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:06.719158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808324c1-7298-42b9-bd88-720ce5285694 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:06.719442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808324c1-7298-42b9-bd88-720ce5285694 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:06.719705 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808324c1-7298-42b9-bd88-720ce5285694 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:06.720471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808324c1-7298-42b9-bd88-720ce5285694 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:06.721882 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808324c1-7298-42b9-bd88-720ce5285694 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:06.742774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 472/960] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Jul 7 07:08:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:08:06.824109 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62454e97-5f1a-4965-a041-68e93f0e6ba6 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:06.824475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62454e97-5f1a-4965-a041-68e93f0e6ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:06.824671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62454e97-5f1a-4965-a041-68e93f0e6ba6 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:06.826517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 489/961] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:06.832408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baef8b4-a000-4648-bc2f-3d68a17d88ef None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:06.832704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baef8b4-a000-4648-bc2f-3d68a17d88ef None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:06.832969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baef8b4-a000-4648-bc2f-3d68a17d88ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:06.851307 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1baef8b4-a000-4648-bc2f-3d68a17d88ef None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:06.852588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1baef8b4-a000-4648-bc2f-3d68a17d88ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:06.930774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 473/962] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:06.956831 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62454e97-5f1a-4965-a041-68e93f0e6ba6 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:07.043215 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:07.068967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62454e97-5f1a-4965-a041-68e93f0e6ba6 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:07.105623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c63d0-796a-433c-9455-68296c8e78f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:07.106265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c63d0-796a-433c-9455-68296c8e78f1 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:07.106504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c63d0-796a-433c-9455-68296c8e78f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:07.106783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c63d0-796a-433c-9455-68296c8e78f1 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:07.107508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c63d0-796a-433c-9455-68296c8e78f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:07.108972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c63d0-796a-433c-9455-68296c8e78f1 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:07.123175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.sql.core [None req-e77c63d0-796a-433c-9455-68296c8e78f1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 07 07:08:07.123175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 07 07:08:07.123175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [parameters: {'user_id': '46729c87ed714a75b0290d0b94186a6d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 07 07:08:07.123175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80277) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-e77c63d0-796a-433c-9455-68296c8e78f1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result = self._query(query) Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application conn.query(q) Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result.read() Jul 07 07:08:07.130839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 07 07:08:07.131713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application next(self.gen) Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application yield resource Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application next(self.gen) Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.session.rollback() Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.force_reraise() Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise self.value Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application session.commit() Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 07 07:08:07.133332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._prepare_impl() Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.session.flush() Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._flush(objects) Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application compat.raise_( Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application flush_context.execute() Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rec.execute(self) Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 07 07:08:07.134565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 07 07:08:07.135669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result = self._query(query) Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application conn.query(q) Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application result.read() Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 07 07:08:07.140024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [parameters: {'user_id': '46729c87ed714a75b0290d0b94186a6d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:07.141932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 07 07:08:07.143060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 07 07:08:07.144754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 07 07:08:07.144754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 07 07:08:07.144754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 07 07:08:07.144754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 07 07:08:07.144754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 07 07:08:07.144754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:07.144754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 490/963] 10.222.0.62 () {60 vars in 1131 bytes} [Thu Jul 7 07:08:06 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:07.145590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baef8b4-a000-4648-bc2f-3d68a17d88ef None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:07.222509 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:07.249289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baef8b4-a000-4648-bc2f-3d68a17d88ef None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:07.284671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32196241-7e2f-4b75-91bf-e08ec6f4e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:07.285596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196241-7e2f-4b75-91bf-e08ec6f4e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:07.285892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196241-7e2f-4b75-91bf-e08ec6f4e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:07.286945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196241-7e2f-4b75-91bf-e08ec6f4e0f9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:07.293939 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32196241-7e2f-4b75-91bf-e08ec6f4e0f9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:07.295812 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32196241-7e2f-4b75-91bf-e08ec6f4e0f9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-32196241-7e2f-4b75-91bf-e08ec6f4e0f9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:08:07.310913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:07.311865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:07.312793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:07.312793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:07.312793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:08:07.312793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:08:07.312793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:08:07.312793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:08:07.312793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:08:07.312793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:08:07.312793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 07:08:07.312793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:07.315186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 474/964] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:08:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:07.321265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c63d0-796a-433c-9455-68296c8e78f1 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:07.426675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c63d0-796a-433c-9455-68296c8e78f1 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:07.435949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450ef0-ec38-40d1-8f70-97b8b38f0c48 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:07.436553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450ef0-ec38-40d1-8f70-97b8b38f0c48 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:07.437107 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450ef0-ec38-40d1-8f70-97b8b38f0c48 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:07.439180 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 475/965] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:07.445200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329deb88-3204-4322-af49-80dfff364914 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:07.445889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329deb88-3204-4322-af49-80dfff364914 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:07.446357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329deb88-3204-4322-af49-80dfff364914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:07.464355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97f4e3-be55-40d8-a45f-d142589153a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:07.465035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97f4e3-be55-40d8-a45f-d142589153a1 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:07.465350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97f4e3-be55-40d8-a45f-d142589153a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:07.465625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97f4e3-be55-40d8-a45f-d142589153a1 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:07.466208 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-329deb88-3204-4322-af49-80dfff364914 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:07.466430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97f4e3-be55-40d8-a45f-d142589153a1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:07.466733 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97f4e3-be55-40d8-a45f-d142589153a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:07.467990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-329deb88-3204-4322-af49-80dfff364914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:07.468473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97f4e3-be55-40d8-a45f-d142589153a1 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:07.491546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:07.520869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 491/966] 10.222.0.62 () {56 vars in 1101 bytes} [Thu Jul 7 07:08:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:07.559265 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 476/967] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:07.582128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cf23f-874c-4fdf-a237-bac0931aa0c2 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:07.582498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cf23f-874c-4fdf-a237-bac0931aa0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:07.582957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cf23f-874c-4fdf-a237-bac0931aa0c2 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:07.588638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329deb88-3204-4322-af49-80dfff364914 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:07.588954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 492/968] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:07.590783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e3e13-696e-4350-b88c-6d5f14e9d771 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:07.591075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e3e13-696e-4350-b88c-6d5f14e9d771 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:07.591366 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e3e13-696e-4350-b88c-6d5f14e9d771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:07.611166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-333e3e13-696e-4350-b88c-6d5f14e9d771 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:07.613289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-333e3e13-696e-4350-b88c-6d5f14e9d771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:07.696396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:07.701304 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 493/969] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:07.723683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e3e13-696e-4350-b88c-6d5f14e9d771 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:07.733678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329deb88-3204-4322-af49-80dfff364914 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:07.778874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7ef96-30cb-4f42-9732-7d06f8a36da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:07.779538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7ef96-30cb-4f42-9732-7d06f8a36da7 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:07.779824 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7ef96-30cb-4f42-9732-7d06f8a36da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:07.780102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7ef96-30cb-4f42-9732-7d06f8a36da7 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:07.780850 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7ef96-30cb-4f42-9732-7d06f8a36da7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:07.782272 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7ef96-30cb-4f42-9732-7d06f8a36da7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:07.803743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 477/970] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:08:07 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:08:07.870203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e3e13-696e-4350-b88c-6d5f14e9d771 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:07.901662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:07.925082 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a7462-4220-40aa-b36c-fa016e3146e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:07.925974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a7462-4220-40aa-b36c-fa016e3146e3 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:07.926256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a7462-4220-40aa-b36c-fa016e3146e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:07.926528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a7462-4220-40aa-b36c-fa016e3146e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:07.940541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a7462-4220-40aa-b36c-fa016e3146e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-c97a7462-4220-40aa-b36c-fa016e3146e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:08:07.950000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:07.951180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:07.957976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 494/971] 10.222.0.62 () {56 vars in 1120 bytes} [Thu Jul 7 07:08:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:07.960549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7ef96-30cb-4f42-9732-7d06f8a36da7 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:08.072555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7ef96-30cb-4f42-9732-7d06f8a36da7 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:08.103105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:08.111071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b20725-332a-41bd-a2e6-711eb96c880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:08.111763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b20725-332a-41bd-a2e6-711eb96c880a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:08.112043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b20725-332a-41bd-a2e6-711eb96c880a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:08.112313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b20725-332a-41bd-a2e6-711eb96c880a None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:08.113083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b20725-332a-41bd-a2e6-711eb96c880a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:08.113430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b20725-332a-41bd-a2e6-711eb96c880a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:08.114834 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b20725-332a-41bd-a2e6-711eb96c880a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:08.128400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 478/972] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Jul 7 07:08:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:08.130116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a7462-4220-40aa-b36c-fa016e3146e3 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:08.238354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a7462-4220-40aa-b36c-fa016e3146e3 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:08.273659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08102f09-fdd3-47ba-88cf-7b39b842d390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:08.274460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08102f09-fdd3-47ba-88cf-7b39b842d390 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:08.274738 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08102f09-fdd3-47ba-88cf-7b39b842d390 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:08.275009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08102f09-fdd3-47ba-88cf-7b39b842d390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:08.285925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08102f09-fdd3-47ba-88cf-7b39b842d390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:08.287390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08102f09-fdd3-47ba-88cf-7b39b842d390 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-08102f09-fdd3-47ba-88cf-7b39b842d390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:08.305009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:08.306119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:08.312078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:08:08.312078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:08.312078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:08.312078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:08.312078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 495/973] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:08.314412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b20725-332a-41bd-a2e6-711eb96c880a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:08.447909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b20725-332a-41bd-a2e6-711eb96c880a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:08.484130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0ef54-3887-4d0e-87e3-818fd78b842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:08.484802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0ef54-3887-4d0e-87e3-818fd78b842e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:08.485077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0ef54-3887-4d0e-87e3-818fd78b842e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:08.485388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0ef54-3887-4d0e-87e3-818fd78b842e None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:08.486151 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0ef54-3887-4d0e-87e3-818fd78b842e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:08.486416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0ef54-3887-4d0e-87e3-818fd78b842e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:08.487798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0ef54-3887-4d0e-87e3-818fd78b842e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:08.501039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 479/974] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:08.506618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08102f09-fdd3-47ba-88cf-7b39b842d390 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:08.542988 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:08.614363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08102f09-fdd3-47ba-88cf-7b39b842d390 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:08.651536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd92c2-3efa-4e86-80ec-6b5bd0754e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:08.652350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd92c2-3efa-4e86-80ec-6b5bd0754e7d None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:08.652647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd92c2-3efa-4e86-80ec-6b5bd0754e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:08.652919 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd92c2-3efa-4e86-80ec-6b5bd0754e7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:08.660632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd92c2-3efa-4e86-80ec-6b5bd0754e7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:08.662136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd92c2-3efa-4e86-80ec-6b5bd0754e7d None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-04fd92c2-3efa-4e86-80ec-6b5bd0754e7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:08:08.679191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:08.680567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:08.681532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:08.681532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:08.681532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:08:08.681532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:08:08.681532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:08:08.681532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:08:08.681532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:08:08.681532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:08:08.681532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 07:08:08.681532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:08.684336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 496/975] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Jul 7 07:08:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:08.685779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0ef54-3887-4d0e-87e3-818fd78b842e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:08.745397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:08.799363 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0ef54-3887-4d0e-87e3-818fd78b842e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:08.834856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6efe90-8954-4494-94d7-af8d3fb2a0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:08.835603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6efe90-8954-4494-94d7-af8d3fb2a0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:08.835946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6efe90-8954-4494-94d7-af8d3fb2a0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:08.836171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6efe90-8954-4494-94d7-af8d3fb2a0c4 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:08.836972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6efe90-8954-4494-94d7-af8d3fb2a0c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:08.837300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6efe90-8954-4494-94d7-af8d3fb2a0c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:08.838728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6efe90-8954-4494-94d7-af8d3fb2a0c4 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:08.861470 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 480/976] 10.222.0.62 () {56 vars in 1149 bytes} [Thu Jul 7 07:08:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:08.863177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd92c2-3efa-4e86-80ec-6b5bd0754e7d None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:08.884389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f381a96-9849-450a-adea-327e8a596ef0 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:08.884914 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f381a96-9849-450a-adea-327e8a596ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:08.885021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f381a96-9849-450a-adea-327e8a596ef0 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:08.886536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 481/977] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:08.891318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106dab-38c2-4bf3-972a-ad70822150ac None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:08.891604 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106dab-38c2-4bf3-972a-ad70822150ac None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:08.891882 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106dab-38c2-4bf3-972a-ad70822150ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:08.909706 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-cd106dab-38c2-4bf3-972a-ad70822150ac None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:08.911234 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cd106dab-38c2-4bf3-972a-ad70822150ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:08.977847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:08.990030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd92c2-3efa-4e86-80ec-6b5bd0754e7d None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:08.997668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 482/978] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:09.013204 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106dab-38c2-4bf3-972a-ad70822150ac None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:09.045983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759ca2e-0eef-471a-9cab-02cecddd9433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:09.046609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ca2e-0eef-471a-9cab-02cecddd9433 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:09.046891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ca2e-0eef-471a-9cab-02cecddd9433 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:09.047441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ca2e-0eef-471a-9cab-02cecddd9433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:09.058151 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:09.118934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106dab-38c2-4bf3-972a-ad70822150ac None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:09.121305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759ca2e-0eef-471a-9cab-02cecddd9433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:09.123006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759ca2e-0eef-471a-9cab-02cecddd9433 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:09.156906 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2ca18-7060-41d2-b7f3-f4e1e705835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:09.157778 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2ca18-7060-41d2-b7f3-f4e1e705835d None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:09.158061 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2ca18-7060-41d2-b7f3-f4e1e705835d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:09.158337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2ca18-7060-41d2-b7f3-f4e1e705835d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:09.158989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2ca18-7060-41d2-b7f3-f4e1e705835d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:09.160352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2ca18-7060-41d2-b7f3-f4e1e705835d None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-dda2ca18-7060-41d2-b7f3-f4e1e705835d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:09.172494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:09.173539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:08:09.174372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:09.178860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 483/979] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Jul 7 07:08:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:09.179545 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2ca18-7060-41d2-b7f3-f4e1e705835d None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:09.229701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:09.242896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 497/980] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:08:08 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:08:09.244302 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759ca2e-0eef-471a-9cab-02cecddd9433 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:09.298331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2ca18-7060-41d2-b7f3-f4e1e705835d None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:09.301500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:09.339379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2e852-e49b-4f94-934e-905d6a91d5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:09.340017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2e852-e49b-4f94-934e-905d6a91d5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:09.340254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2e852-e49b-4f94-934e-905d6a91d5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:09.340516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2e852-e49b-4f94-934e-905d6a91d5a9 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:09.341735 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2e852-e49b-4f94-934e-905d6a91d5a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:09.342038 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2e852-e49b-4f94-934e-905d6a91d5a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:09.343428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2e852-e49b-4f94-934e-905d6a91d5a9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:09.349324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 484/981] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Jul 7 07:08:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:09.355576 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2e852-e49b-4f94-934e-905d6a91d5a9 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:09.359379 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759ca2e-0eef-471a-9cab-02cecddd9433 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:09.401050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34099247-8f4c-4eb7-8071-644f41b0628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:09.404605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099247-8f4c-4eb7-8071-644f41b0628e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:09.404605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099247-8f4c-4eb7-8071-644f41b0628e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:09.404605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099247-8f4c-4eb7-8071-644f41b0628e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:09.413505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34099247-8f4c-4eb7-8071-644f41b0628e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:09.414959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34099247-8f4c-4eb7-8071-644f41b0628e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-34099247-8f4c-4eb7-8071-644f41b0628e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:09.432650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:09.433792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:09.434761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:08:09.434761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:09.434761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:09.434761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:09.434761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 498/982] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:09.439613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34099247-8f4c-4eb7-8071-644f41b0628e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:09.480216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2e852-e49b-4f94-934e-905d6a91d5a9 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:09.492617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:09.516830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e34833-7130-42a9-bee4-bc1d99cf71f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:09.517551 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e34833-7130-42a9-bee4-bc1d99cf71f2 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:09.517868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e34833-7130-42a9-bee4-bc1d99cf71f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:09.518814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e34833-7130-42a9-bee4-bc1d99cf71f2 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:09.518814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e34833-7130-42a9-bee4-bc1d99cf71f2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:09.519120 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e34833-7130-42a9-bee4-bc1d99cf71f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:09.520508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e34833-7130-42a9-bee4-bc1d99cf71f2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:09.525995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 485/983] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Jul 7 07:08:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:09.531853 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e34833-7130-42a9-bee4-bc1d99cf71f2 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:09.551628 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34099247-8f4c-4eb7-8071-644f41b0628e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:09.565717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:09.589242 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133c677-bae8-4405-bc12-ebf105598bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:09.589973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c677-bae8-4405-bc12-ebf105598bbc None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:09.590207 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c677-bae8-4405-bc12-ebf105598bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:09.590484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c677-bae8-4405-bc12-ebf105598bbc None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:09.591219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133c677-bae8-4405-bc12-ebf105598bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:09.591549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133c677-bae8-4405-bc12-ebf105598bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:09.593007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133c677-bae8-4405-bc12-ebf105598bbc None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:09.605240 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 499/984] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:09.611245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133c677-bae8-4405-bc12-ebf105598bbc None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:09.642383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e34833-7130-42a9-bee4-bc1d99cf71f2 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:09.680927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f696b4d-2e7f-47c5-b024-b109627633dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:09.681672 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f696b4d-2e7f-47c5-b024-b109627633dd None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:09.681959 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f696b4d-2e7f-47c5-b024-b109627633dd None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:09.682234 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f696b4d-2e7f-47c5-b024-b109627633dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:09.683045 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f696b4d-2e7f-47c5-b024-b109627633dd None admin] RBAC: Adding query filter params (interface=admin, service_id=bc7decf6eab742deaf10d213fc665695, region_id=RegionOne) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:09.683373 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f696b4d-2e7f-47c5-b024-b109627633dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:09.684754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f696b4d-2e7f-47c5-b024-b109627633dd None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:09.695680 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 486/985] 10.222.0.62 () {56 vars in 1249 bytes} [Thu Jul 7 07:08:09 2022] GET /identity/v3/endpoints?service_id=bc7decf6eab742deaf10d213fc665695&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:09.696956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f696b4d-2e7f-47c5-b024-b109627633dd None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:09.725403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133c677-bae8-4405-bc12-ebf105598bbc None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:09.734013 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:09.762436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336fd67-dbc9-4f78-9e42-60c99ccf6328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:09.763249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336fd67-dbc9-4f78-9e42-60c99ccf6328 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:09.763532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336fd67-dbc9-4f78-9e42-60c99ccf6328 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:09.763811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336fd67-dbc9-4f78-9e42-60c99ccf6328 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:09.772215 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336fd67-dbc9-4f78-9e42-60c99ccf6328 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:09.773735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336fd67-dbc9-4f78-9e42-60c99ccf6328 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-0336fd67-dbc9-4f78-9e42-60c99ccf6328 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:08:09.789078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:09.790197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:09.791074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:08:09.791074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:08:09.791074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:08:09.791074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:08:09.791074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:08:09.791074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:08:09.791074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:09.791074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:09.791074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 500/986] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:09.796180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336fd67-dbc9-4f78-9e42-60c99ccf6328 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:09.801619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:09.809409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f696b4d-2e7f-47c5-b024-b109627633dd None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:09.846143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f94dc-6a0b-425a-a2c4-c1dc95684721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:09.846743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f94dc-6a0b-425a-a2c4-c1dc95684721 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:09.847034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f94dc-6a0b-425a-a2c4-c1dc95684721 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:09.847313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f94dc-6a0b-425a-a2c4-c1dc95684721 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:09.848032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f94dc-6a0b-425a-a2c4-c1dc95684721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:09.849448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f94dc-6a0b-425a-a2c4-c1dc95684721 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:09.859601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 487/987] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Jul 7 07:08:09 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:08:09.908821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336fd67-dbc9-4f78-9e42-60c99ccf6328 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:09.930614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3a007-6b81-4f4c-a4f5-6565d8236b1c None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:09.930919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3a007-6b81-4f4c-a4f5-6565d8236b1c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:09.931171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3a007-6b81-4f4c-a4f5-6565d8236b1c None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:09.932605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 488/988] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:09.939171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd4ba-eb1c-4df7-9f8c-1faa9f1046d2 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:09.939479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd4ba-eb1c-4df7-9f8c-1faa9f1046d2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:09.939734 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd4ba-eb1c-4df7-9f8c-1faa9f1046d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:09.953641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c861e-a2b9-4e3c-96bf-c5d58f7c974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:09.954510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c861e-a2b9-4e3c-96bf-c5d58f7c974c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:09.954726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c861e-a2b9-4e3c-96bf-c5d58f7c974c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:09.955006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c861e-a2b9-4e3c-96bf-c5d58f7c974c None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:09.955808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c861e-a2b9-4e3c-96bf-c5d58f7c974c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:09.956121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c861e-a2b9-4e3c-96bf-c5d58f7c974c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:09.957620 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c861e-a2b9-4e3c-96bf-c5d58f7c974c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:09.960163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-be6cd4ba-eb1c-4df7-9f8c-1faa9f1046d2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:09.961686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-be6cd4ba-eb1c-4df7-9f8c-1faa9f1046d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:09.971190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 501/989] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:09.977940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c861e-a2b9-4e3c-96bf-c5d58f7c974c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:10.010752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:10.044437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 489/990] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:10.068789 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd4ba-eb1c-4df7-9f8c-1faa9f1046d2 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:10.100689 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c861e-a2b9-4e3c-96bf-c5d58f7c974c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:10.137749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c06a0a-5c4c-47fa-8984-b459fe04f96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:10.138803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c06a0a-5c4c-47fa-8984-b459fe04f96c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:10.139479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c06a0a-5c4c-47fa-8984-b459fe04f96c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:10.139909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c06a0a-5c4c-47fa-8984-b459fe04f96c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:10.141699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c06a0a-5c4c-47fa-8984-b459fe04f96c None admin] RBAC: Adding query filter params (role.id=2c64ff3f3a674e64956bc6527d556f3f, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=5dbfbf3cbf304d8c85dabb7ad26380e9) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:10.142239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c06a0a-5c4c-47fa-8984-b459fe04f96c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:10.143889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c06a0a-5c4c-47fa-8984-b459fe04f96c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:10.152566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 502/991] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:08:09 2022] GET /identity/v3/role_assignments?user.id=5dbfbf3cbf304d8c85dabb7ad26380e9&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=2c64ff3f3a674e64956bc6527d556f3f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:10.162250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:10.174763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd4ba-eb1c-4df7-9f8c-1faa9f1046d2 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:10.216006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d615ff1-38d5-4bfe-be8b-c4743b6ea78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:10.216841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d615ff1-38d5-4bfe-be8b-c4743b6ea78c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:10.217167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d615ff1-38d5-4bfe-be8b-c4743b6ea78c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:10.217419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d615ff1-38d5-4bfe-be8b-c4743b6ea78c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:10.218126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d615ff1-38d5-4bfe-be8b-c4743b6ea78c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:10.219538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d615ff1-38d5-4bfe-be8b-c4743b6ea78c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-4d615ff1-38d5-4bfe-be8b-c4743b6ea78c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:10.232968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:10.234345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:10.235577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 490/992] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:08:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:10.242660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c06a0a-5c4c-47fa-8984-b459fe04f96c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:10.349277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:10.360436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c06a0a-5c4c-47fa-8984-b459fe04f96c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:10.406364 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa883be-394f-4f0a-9806-68030543ae4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:10.407450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa883be-394f-4f0a-9806-68030543ae4a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:10.407450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa883be-394f-4f0a-9806-68030543ae4a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:10.407586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa883be-394f-4f0a-9806-68030543ae4a None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:10.408295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa883be-394f-4f0a-9806-68030543ae4a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:10.408603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa883be-394f-4f0a-9806-68030543ae4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:10.410024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa883be-394f-4f0a-9806-68030543ae4a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:10.415579 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 503/993] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:08:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:10.421507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d615ff1-38d5-4bfe-be8b-c4743b6ea78c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:10.529500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d615ff1-38d5-4bfe-be8b-c4743b6ea78c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:10.564483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20bf7b-0d5a-49eb-acab-136410f3fd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:10.565184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20bf7b-0d5a-49eb-acab-136410f3fd30 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:10.565491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20bf7b-0d5a-49eb-acab-136410f3fd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:10.565781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20bf7b-0d5a-49eb-acab-136410f3fd30 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:10.566496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20bf7b-0d5a-49eb-acab-136410f3fd30 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:10.566864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20bf7b-0d5a-49eb-acab-136410f3fd30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:10.568687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20bf7b-0d5a-49eb-acab-136410f3fd30 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:10.574243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 491/994] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:08:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:10.580057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa883be-394f-4f0a-9806-68030543ae4a None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:10.683809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa883be-394f-4f0a-9806-68030543ae4a None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:10.718771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6a7bd-35f5-4d64-90a3-f1ec0c1cdcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:10.719438 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6a7bd-35f5-4d64-90a3-f1ec0c1cdcbf None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:10.719723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6a7bd-35f5-4d64-90a3-f1ec0c1cdcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:10.720000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6a7bd-35f5-4d64-90a3-f1ec0c1cdcbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:10.720794 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6a7bd-35f5-4d64-90a3-f1ec0c1cdcbf None admin] RBAC: Adding query filter params (interface=public, service_id=be8f6e2167924524800a4c4b3080bcce, region_id=RegionOne) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:10.721106 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6a7bd-35f5-4d64-90a3-f1ec0c1cdcbf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:10.722527 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6a7bd-35f5-4d64-90a3-f1ec0c1cdcbf None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:10.728113 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 504/995] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Jul 7 07:08:10 2022] GET /identity/v3/endpoints?service_id=be8f6e2167924524800a4c4b3080bcce&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:10.733552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20bf7b-0d5a-49eb-acab-136410f3fd30 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:10.754757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:10.845633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20bf7b-0d5a-49eb-acab-136410f3fd30 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:10.880507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630c119-fc77-4d7a-aca8-bbd4025d9ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:10.881248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c119-fc77-4d7a-aca8-bbd4025d9ffa None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:10.881528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c119-fc77-4d7a-aca8-bbd4025d9ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:10.881804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c119-fc77-4d7a-aca8-bbd4025d9ffa None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:10.882544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630c119-fc77-4d7a-aca8-bbd4025d9ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:10.883937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630c119-fc77-4d7a-aca8-bbd4025d9ffa None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:10.891247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 492/996] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Jul 7 07:08:10 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:08:11.883879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc931d09-7fee-43ad-83c8-bfc6ce0df03c None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:11.884431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc931d09-7fee-43ad-83c8-bfc6ce0df03c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:11.884431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc931d09-7fee-43ad-83c8-bfc6ce0df03c None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:11.886022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 505/997] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:11.891222 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f6c8a-8ef0-41c5-ac69-2654ab3ab808 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:11.891643 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f6c8a-8ef0-41c5-ac69-2654ab3ab808 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:11.891819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f6c8a-8ef0-41c5-ac69-2654ab3ab808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:11.908801 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-cb6f6c8a-8ef0-41c5-ac69-2654ab3ab808 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:11.910005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cb6f6c8a-8ef0-41c5-ac69-2654ab3ab808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:11.981796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 493/998] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:12.004116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc931d09-7fee-43ad-83c8-bfc6ce0df03c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:12.024331 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:12.115887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc931d09-7fee-43ad-83c8-bfc6ce0df03c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:12.150697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d184c2-d6c8-406c-892a-899734fc8376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:12.151423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d184c2-d6c8-406c-892a-899734fc8376 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:12.151705 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d184c2-d6c8-406c-892a-899734fc8376 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:12.151979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d184c2-d6c8-406c-892a-899734fc8376 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:12.152731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d184c2-d6c8-406c-892a-899734fc8376 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:12.154120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d184c2-d6c8-406c-892a-899734fc8376 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-50d184c2-d6c8-406c-892a-899734fc8376 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:12.166638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:12.167633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:12.173602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 506/999] 10.222.0.62 () {56 vars in 1126 bytes} [Thu Jul 7 07:08:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:12.174404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f6c8a-8ef0-41c5-ac69-2654ab3ab808 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:12.189081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:12.205489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5428b19-42ed-41a3-b429-676bc0681ee9 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:12.206160 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5428b19-42ed-41a3-b429-676bc0681ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:12.206455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5428b19-42ed-41a3-b429-676bc0681ee9 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:12.208044 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 507/1000] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:12.213424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3eed-686d-407d-a90c-2903baf4717a None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:12.214419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3eed-686d-407d-a90c-2903baf4717a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:12.214419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3eed-686d-407d-a90c-2903baf4717a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:12.231596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-608a3eed-686d-407d-a90c-2903baf4717a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:12.232780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-608a3eed-686d-407d-a90c-2903baf4717a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:12.282305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f6c8a-8ef0-41c5-ac69-2654ab3ab808 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:12.308633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 508/1001] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:08:12.322930 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fa413-1b1e-4bbd-be6d-a2cf6800fb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:12.323929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fa413-1b1e-4bbd-be6d-a2cf6800fb81 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:12.324415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fa413-1b1e-4bbd-be6d-a2cf6800fb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:12.324862 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fa413-1b1e-4bbd-be6d-a2cf6800fb81 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:12.325851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fa413-1b1e-4bbd-be6d-a2cf6800fb81 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:12.326350 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fa413-1b1e-4bbd-be6d-a2cf6800fb81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:12.327896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fa413-1b1e-4bbd-be6d-a2cf6800fb81 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:12.331222 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3eed-686d-407d-a90c-2903baf4717a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:12.334343 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 494/1002] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Jul 7 07:08:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:12.340283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fa413-1b1e-4bbd-be6d-a2cf6800fb81 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:12.346935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:12.432649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:12.445478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3eed-686d-407d-a90c-2903baf4717a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:12.457958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fa413-1b1e-4bbd-be6d-a2cf6800fb81 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:12.482149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a577f4-3a7e-4fd2-9245-2c48f4f47949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:12.483048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a577f4-3a7e-4fd2-9245-2c48f4f47949 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:12.483334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a577f4-3a7e-4fd2-9245-2c48f4f47949 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:12.483602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a577f4-3a7e-4fd2-9245-2c48f4f47949 None admin] PATH_INFO: `/v3/services/image` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:12.484253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a577f4-3a7e-4fd2-9245-2c48f4f47949 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:12.485861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a577f4-3a7e-4fd2-9245-2c48f4f47949 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:12.498866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc316bb-424c-4d6a-a227-b4404c41da7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:12.499534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc316bb-424c-4d6a-a227-b4404c41da7e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:12.499818 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc316bb-424c-4d6a-a227-b4404c41da7e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:12.500097 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc316bb-424c-4d6a-a227-b4404c41da7e None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:12.500807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc316bb-424c-4d6a-a227-b4404c41da7e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:12.501116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc316bb-424c-4d6a-a227-b4404c41da7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-c5a577f4-3a7e-4fd2-9245-2c48f4f47949 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:12.502428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:12.503407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 07:08:12.504250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:12.504993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc316bb-424c-4d6a-a227-b4404c41da7e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:12.505075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 509/1003] 10.222.0.62 () {56 vars in 1105 bytes} [Thu Jul 7 07:08:12 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:12.509734 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a577f4-3a7e-4fd2-9245-2c48f4f47949 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:12.511035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 495/1004] 10.222.0.62 () {56 vars in 1122 bytes} [Thu Jul 7 07:08:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:12.516468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc316bb-424c-4d6a-a227-b4404c41da7e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:12.601033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:12.626663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a577f4-3a7e-4fd2-9245-2c48f4f47949 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:12.628123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc316bb-424c-4d6a-a227-b4404c41da7e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:12.662114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77063fc2-1e61-4fc9-90fc-67acc307a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:12.662812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77063fc2-1e61-4fc9-90fc-67acc307a20a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:12.663199 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77063fc2-1e61-4fc9-90fc-67acc307a20a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:12.663540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77063fc2-1e61-4fc9-90fc-67acc307a20a None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:12.663666 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc365a-4540-4277-97f1-52e16fa38851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:12.664240 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77063fc2-1e61-4fc9-90fc-67acc307a20a None admin] RBAC: Adding query filter params (name=image) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:12.664340 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc365a-4540-4277-97f1-52e16fa38851 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:12.664538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc365a-4540-4277-97f1-52e16fa38851 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:12.664632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77063fc2-1e61-4fc9-90fc-67acc307a20a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:12.664813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc365a-4540-4277-97f1-52e16fa38851 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:12.665580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc365a-4540-4277-97f1-52e16fa38851 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:12.665959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77063fc2-1e61-4fc9-90fc-67acc307a20a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:12.666945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc365a-4540-4277-97f1-52e16fa38851 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:12.671384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 510/1005] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:12.677206 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77063fc2-1e61-4fc9-90fc-67acc307a20a None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:12.679659 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:12.697692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 496/1006] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Jul 7 07:08:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:08:12.800624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77063fc2-1e61-4fc9-90fc-67acc307a20a None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:12.845412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd0528-6214-444c-8606-9f1c2c558c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:12.845412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd0528-6214-444c-8606-9f1c2c558c73 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:12.845728 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd0528-6214-444c-8606-9f1c2c558c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:12.845939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd0528-6214-444c-8606-9f1c2c558c73 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:12.846549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd0528-6214-444c-8606-9f1c2c558c73 None admin] RBAC: Adding query filter params (type=image) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:12.847141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd0528-6214-444c-8606-9f1c2c558c73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:12.848515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd0528-6214-444c-8606-9f1c2c558c73 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:12.850680 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:12.854150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 511/1007] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:12.933837 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5026a-9035-4da4-8212-465f7979f430 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:12.934347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5026a-9035-4da4-8212-465f7979f430 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:12.934542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5026a-9035-4da4-8212-465f7979f430 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:12.936011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 497/1008] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:12.942498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e09bba-d50d-4ae8-a9ba-40b0628681f7 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:12.943052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e09bba-d50d-4ae8-a9ba-40b0628681f7 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:12.943052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e09bba-d50d-4ae8-a9ba-40b0628681f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:12.963086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-65e09bba-d50d-4ae8-a9ba-40b0628681f7 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:12.964317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-65e09bba-d50d-4ae8-a9ba-40b0628681f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:13.038986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 512/1009] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:13.061935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5026a-9035-4da4-8212-465f7979f430 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:13.171040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5026a-9035-4da4-8212-465f7979f430 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:13.208481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3329d1-9bde-4bb1-bf3c-e1033be4f1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:13.209135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3329d1-9bde-4bb1-bf3c-e1033be4f1bc None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:13.209456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3329d1-9bde-4bb1-bf3c-e1033be4f1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:13.209761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3329d1-9bde-4bb1-bf3c-e1033be4f1bc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:13.210512 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3329d1-9bde-4bb1-bf3c-e1033be4f1bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:13.212006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3329d1-9bde-4bb1-bf3c-e1033be4f1bc None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-3b3329d1-9bde-4bb1-bf3c-e1033be4f1bc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:13.224605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:13.225634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:13.231651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 498/1010] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:08:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:13.234153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e09bba-d50d-4ae8-a9ba-40b0628681f7 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:13.344003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e09bba-d50d-4ae8-a9ba-40b0628681f7 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:13.374110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:13.380986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f32c4-b3ac-41f8-85c1-a293845fed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:13.381754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f32c4-b3ac-41f8-85c1-a293845fed66 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:13.382093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f32c4-b3ac-41f8-85c1-a293845fed66 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:13.382372 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f32c4-b3ac-41f8-85c1-a293845fed66 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:13.383083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f32c4-b3ac-41f8-85c1-a293845fed66 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:13.383385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f32c4-b3ac-41f8-85c1-a293845fed66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:13.384761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f32c4-b3ac-41f8-85c1-a293845fed66 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:13.395137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 513/1011] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:08:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:13.400858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3329d1-9bde-4bb1-bf3c-e1033be4f1bc None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:13.470664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:13.512839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3329d1-9bde-4bb1-bf3c-e1033be4f1bc None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:13.547266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc75ec-2db6-4279-bec3-5101f7dae691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:13.547933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc75ec-2db6-4279-bec3-5101f7dae691 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:13.548216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc75ec-2db6-4279-bec3-5101f7dae691 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:13.548492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc75ec-2db6-4279-bec3-5101f7dae691 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:13.549196 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc75ec-2db6-4279-bec3-5101f7dae691 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:13.549554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc75ec-2db6-4279-bec3-5101f7dae691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:13.550942 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc75ec-2db6-4279-bec3-5101f7dae691 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:13.556511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 499/1012] 10.222.0.62 () {56 vars in 1112 bytes} [Thu Jul 7 07:08:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:13.562250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f32c4-b3ac-41f8-85c1-a293845fed66 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:13.663547 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f32c4-b3ac-41f8-85c1-a293845fed66 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:13.697320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d2337-a924-4399-b072-a1edb87b82be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:13.697973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d2337-a924-4399-b072-a1edb87b82be None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:13.698255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d2337-a924-4399-b072-a1edb87b82be None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:13.698531 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d2337-a924-4399-b072-a1edb87b82be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:13.699280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d2337-a924-4399-b072-a1edb87b82be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:13.700653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d2337-a924-4399-b072-a1edb87b82be None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:13.725108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 514/1013] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Jul 7 07:08:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:08:14.735546 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb14a0f-e0f9-4be5-9646-7a79bcc6baff None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:14.736058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb14a0f-e0f9-4be5-9646-7a79bcc6baff None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:14.736058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb14a0f-e0f9-4be5-9646-7a79bcc6baff None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:14.737711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 500/1014] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:14.742909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa033-1b54-40ae-b41f-191d00d31ab5 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:14.743330 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa033-1b54-40ae-b41f-191d00d31ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:14.743500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa033-1b54-40ae-b41f-191d00d31ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:14.761582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e63fa033-1b54-40ae-b41f-191d00d31ab5 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:14.762790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e63fa033-1b54-40ae-b41f-191d00d31ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:14.810364 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:14.839814 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 515/1015] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:14 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:14.863403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb14a0f-e0f9-4be5-9646-7a79bcc6baff None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:14.932860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc03bf9-821d-4438-84ce-db05d6a5aff1 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:14.933139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc03bf9-821d-4438-84ce-db05d6a5aff1 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:14.933455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc03bf9-821d-4438-84ce-db05d6a5aff1 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:14.935183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 516/1016] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:14.939780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716283c2-934b-4c1f-8db9-0e27a1e0af39 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:14.940100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716283c2-934b-4c1f-8db9-0e27a1e0af39 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:14.940354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716283c2-934b-4c1f-8db9-0e27a1e0af39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:14.958490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-716283c2-934b-4c1f-8db9-0e27a1e0af39 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:14.959693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-716283c2-934b-4c1f-8db9-0e27a1e0af39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:14.987598 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb14a0f-e0f9-4be5-9646-7a79bcc6baff None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:15.014372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:15.023383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e7881-dbc0-41f7-8eee-edd44bde01f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:15.024187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e7881-dbc0-41f7-8eee-edd44bde01f4 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:15.024469 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e7881-dbc0-41f7-8eee-edd44bde01f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:15.024746 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e7881-dbc0-41f7-8eee-edd44bde01f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:15.025936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e7881-dbc0-41f7-8eee-edd44bde01f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:15.027372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e7881-dbc0-41f7-8eee-edd44bde01f4 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:15.031713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 517/1017] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:14 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:08:15.037487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 501/1018] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:15.037640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716283c2-934b-4c1f-8db9-0e27a1e0af39 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:15.056181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e7881-dbc0-41f7-8eee-edd44bde01f4 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:15.143213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716283c2-934b-4c1f-8db9-0e27a1e0af39 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:15.151814 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:15.178404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e7881-dbc0-41f7-8eee-edd44bde01f4 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:15.179475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c589f-f84c-41f9-8e40-2d684245e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:15.180144 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c589f-f84c-41f9-8e40-2d684245e3a9 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:15.180430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c589f-f84c-41f9-8e40-2d684245e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:15.180706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c589f-f84c-41f9-8e40-2d684245e3a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:15.181448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c589f-f84c-41f9-8e40-2d684245e3a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:15.182898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c589f-f84c-41f9-8e40-2d684245e3a9 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:15.212962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 518/1019] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:08:15 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:08:15.225031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243d857-e4d7-405c-8500-101eff000686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:15.225925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243d857-e4d7-405c-8500-101eff000686 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:15.226271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243d857-e4d7-405c-8500-101eff000686 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:15.226615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243d857-e4d7-405c-8500-101eff000686 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:15.227506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243d857-e4d7-405c-8500-101eff000686 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:15.229061 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243d857-e4d7-405c-8500-101eff000686 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:15.246743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 502/1020] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:08:15 2022] POST /identity/v3/services => generated 242 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:08:15.832326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78044723-5abd-4fdd-97d3-de1f14e16f4b None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:15.832892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78044723-5abd-4fdd-97d3-de1f14e16f4b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:15.832892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78044723-5abd-4fdd-97d3-de1f14e16f4b None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:15.834543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 519/1021] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:15.839721 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e8aed-eaa2-42a3-85d8-7d7a1a808432 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:15.840162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e8aed-eaa2-42a3-85d8-7d7a1a808432 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:15.840240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e8aed-eaa2-42a3-85d8-7d7a1a808432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:15.857429 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-8d4e8aed-eaa2-42a3-85d8-7d7a1a808432 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:15.858625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-8d4e8aed-eaa2-42a3-85d8-7d7a1a808432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:15.912119 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:15.937142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 503/1022] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:15.961251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78044723-5abd-4fdd-97d3-de1f14e16f4b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:16.070641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78044723-5abd-4fdd-97d3-de1f14e16f4b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:16.104589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330f94f-3dae-43fd-9606-edce706c5e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:16.105359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330f94f-3dae-43fd-9606-edce706c5e3c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:16.105638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330f94f-3dae-43fd-9606-edce706c5e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:16.105908 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330f94f-3dae-43fd-9606-edce706c5e3c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:16.116712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330f94f-3dae-43fd-9606-edce706c5e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-3330f94f-3dae-43fd-9606-edce706c5e3c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:08:16.124935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:16.125934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:16.126965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 520/1023] 10.222.0.62 () {56 vars in 1120 bytes} [Thu Jul 7 07:08:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:16.132274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e8aed-eaa2-42a3-85d8-7d7a1a808432 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:16.234349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e8aed-eaa2-42a3-85d8-7d7a1a808432 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:16.270018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc4dfb-f30d-49e3-a39d-77ddc0e921cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:16.270695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc4dfb-f30d-49e3-a39d-77ddc0e921cd None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:16.270981 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc4dfb-f30d-49e3-a39d-77ddc0e921cd None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:16.271256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc4dfb-f30d-49e3-a39d-77ddc0e921cd None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:16.272018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc4dfb-f30d-49e3-a39d-77ddc0e921cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:16.272318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc4dfb-f30d-49e3-a39d-77ddc0e921cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:16.273812 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc4dfb-f30d-49e3-a39d-77ddc0e921cd None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:16.282331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 504/1024] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Jul 7 07:08:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:16.287942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330f94f-3dae-43fd-9606-edce706c5e3c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:16.307405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:16.411381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330f94f-3dae-43fd-9606-edce706c5e3c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:16.453002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45f1cc-f35b-4a39-86ee-71376b8a06ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:16.453862 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45f1cc-f35b-4a39-86ee-71376b8a06ee None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:16.454147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45f1cc-f35b-4a39-86ee-71376b8a06ee None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:16.454425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45f1cc-f35b-4a39-86ee-71376b8a06ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:16.466391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45f1cc-f35b-4a39-86ee-71376b8a06ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:16.467892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45f1cc-f35b-4a39-86ee-71376b8a06ee None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-4c45f1cc-f35b-4a39-86ee-71376b8a06ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:16.486635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:16.487582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:16.488459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:08:16.488459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:16.488459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:16.488459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:16.489624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 521/1025] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:16.493691 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc4dfb-f30d-49e3-a39d-77ddc0e921cd None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:16.542389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:16.600706 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc4dfb-f30d-49e3-a39d-77ddc0e921cd None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:16.634195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97f2ac-0659-48ef-abf1-264ed6ffead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:16.634865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97f2ac-0659-48ef-abf1-264ed6ffead8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:16.635144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97f2ac-0659-48ef-abf1-264ed6ffead8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:16.635420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97f2ac-0659-48ef-abf1-264ed6ffead8 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:16.636147 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97f2ac-0659-48ef-abf1-264ed6ffead8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:16.636453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97f2ac-0659-48ef-abf1-264ed6ffead8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:16.637899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97f2ac-0659-48ef-abf1-264ed6ffead8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:16.650257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 505/1026] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:16.655835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45f1cc-f35b-4a39-86ee-71376b8a06ee None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:16.729355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:16.764140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45f1cc-f35b-4a39-86ee-71376b8a06ee None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:16.798025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac941bb-5a1f-42b2-97f5-67cf5c510e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:16.798823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac941bb-5a1f-42b2-97f5-67cf5c510e78 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:16.799103 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac941bb-5a1f-42b2-97f5-67cf5c510e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:16.799373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac941bb-5a1f-42b2-97f5-67cf5c510e78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:16.806986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac941bb-5a1f-42b2-97f5-67cf5c510e78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:16.808457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac941bb-5a1f-42b2-97f5-67cf5c510e78 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-6ac941bb-5a1f-42b2-97f5-67cf5c510e78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:08:16.824203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:16.831889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:16.833508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:16.833508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:16.833508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:08:16.833508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:08:16.833508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:08:16.833508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:08:16.833508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:08:16.833508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:08:16.833508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:08:16.833508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:16.833508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 522/1027] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Jul 7 07:08:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:16.835437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97f2ac-0659-48ef-abf1-264ed6ffead8 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:16.945454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97f2ac-0659-48ef-abf1-264ed6ffead8 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:16.948827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:16.983769 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026e883-9436-4492-8294-cb339397744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:16.984354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026e883-9436-4492-8294-cb339397744f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:16.984631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026e883-9436-4492-8294-cb339397744f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:16.984902 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026e883-9436-4492-8294-cb339397744f None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:16.985768 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026e883-9436-4492-8294-cb339397744f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:16.986086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026e883-9436-4492-8294-cb339397744f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:16.987529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026e883-9436-4492-8294-cb339397744f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:17.006511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 506/1028] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Jul 7 07:08:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:17.012329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac941bb-5a1f-42b2-97f5-67cf5c510e78 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:17.137790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac941bb-5a1f-42b2-97f5-67cf5c510e78 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:17.170448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:17.177901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c130b-5844-49bb-8c6e-45e8fe9b2dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:17.178567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c130b-5844-49bb-8c6e-45e8fe9b2dba None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:17.178886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c130b-5844-49bb-8c6e-45e8fe9b2dba None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:17.179168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c130b-5844-49bb-8c6e-45e8fe9b2dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:17.265753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c130b-5844-49bb-8c6e-45e8fe9b2dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:17.267439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c130b-5844-49bb-8c6e-45e8fe9b2dba None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:17.307567 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c33996-0020-40b7-963e-ad368500e14d None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:17.307920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c33996-0020-40b7-963e-ad368500e14d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:17.308118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c33996-0020-40b7-963e-ad368500e14d None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:17.309900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 507/1029] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:17.315530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589dbec-3c7c-4550-bcec-53b96556957f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:17.315831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589dbec-3c7c-4550-bcec-53b96556957f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:17.316160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589dbec-3c7c-4550-bcec-53b96556957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:17.334012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-3589dbec-3c7c-4550-bcec-53b96556957f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:17.335257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3589dbec-3c7c-4550-bcec-53b96556957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:17.383343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 523/1030] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:08:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:08:17.384815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f299-3b91-4583-86db-d23e8702bbb4 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:17.385112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f299-3b91-4583-86db-d23e8702bbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:17.385428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f299-3b91-4583-86db-d23e8702bbb4 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:17.386751 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 524/1031] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:17.389198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88f299-3b91-4583-86db-d23e8702bbb4 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:17.417587 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 508/1032] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:08:17.418901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3ee32-88f0-455d-b476-b708c6873589 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:17.419446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3ee32-88f0-455d-b476-b708c6873589 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:17.419446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3ee32-88f0-455d-b476-b708c6873589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:17.429255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:17.437944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-9da3ee32-88f0-455d-b476-b708c6873589 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:17.438843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-9da3ee32-88f0-455d-b476-b708c6873589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:17.507095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88f299-3b91-4583-86db-d23e8702bbb4 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:17.509782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 509/1033] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:17.510694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3ee32-88f0-455d-b476-b708c6873589 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:17.535232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:17.567954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f06214-22fb-44ab-acb0-68c63c7f6806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:17.569121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f06214-22fb-44ab-acb0-68c63c7f6806 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:17.569814 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f06214-22fb-44ab-acb0-68c63c7f6806 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:17.570273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f06214-22fb-44ab-acb0-68c63c7f6806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:17.586135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f06214-22fb-44ab-acb0-68c63c7f6806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:17.588604 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f06214-22fb-44ab-acb0-68c63c7f6806 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-b0f06214-22fb-44ab-acb0-68c63c7f6806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:17.616493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:17.617518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:17.618423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:08:17.618423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:17.618423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:17.618423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:17.618423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 525/1034] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:17.619730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f06214-22fb-44ab-acb0-68c63c7f6806 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:17.649663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3ee32-88f0-455d-b476-b708c6873589 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:17.685282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d1531-2913-4914-8835-b98debdc6f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:17.686157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d1531-2913-4914-8835-b98debdc6f67 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:17.686390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d1531-2913-4914-8835-b98debdc6f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:17.686670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d1531-2913-4914-8835-b98debdc6f67 None admin] PATH_INFO: `/v3/services/image` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:17.687330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d1531-2913-4914-8835-b98debdc6f67 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:17.688713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d1531-2913-4914-8835-b98debdc6f67 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-d06d1531-2913-4914-8835-b98debdc6f67 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:17.700913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:17.702122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:17.702947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 510/1035] 10.222.0.62 () {56 vars in 1105 bytes} [Thu Jul 7 07:08:17 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:17.704175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d1531-2913-4914-8835-b98debdc6f67 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:17.708888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:17.732537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f06214-22fb-44ab-acb0-68c63c7f6806 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:17.775833 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324d239-e277-43fa-aed4-e9b97ef78d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:17.776721 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324d239-e277-43fa-aed4-e9b97ef78d57 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:17.777008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324d239-e277-43fa-aed4-e9b97ef78d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:17.777335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324d239-e277-43fa-aed4-e9b97ef78d57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:17.778718 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324d239-e277-43fa-aed4-e9b97ef78d57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:17.780223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324d239-e277-43fa-aed4-e9b97ef78d57 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:17.782044 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 526/1036] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:17.782856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324d239-e277-43fa-aed4-e9b97ef78d57 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:17.808781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:17.826228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d1531-2913-4914-8835-b98debdc6f67 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:17.866292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76f77d-fa4b-43b6-b122-e7dd0481f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:17.867039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76f77d-fa4b-43b6-b122-e7dd0481f239 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:17.867324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76f77d-fa4b-43b6-b122-e7dd0481f239 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:17.867598 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76f77d-fa4b-43b6-b122-e7dd0481f239 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:17.868334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76f77d-fa4b-43b6-b122-e7dd0481f239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:17.868644 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76f77d-fa4b-43b6-b122-e7dd0481f239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:17.872697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76f77d-fa4b-43b6-b122-e7dd0481f239 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:17.885996 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 511/1037] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:17.886861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76f77d-fa4b-43b6-b122-e7dd0481f239 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:17.906635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324d239-e277-43fa-aed4-e9b97ef78d57 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:17.958848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81101889-4b41-4193-bb88-a72e5db14914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:17.959529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81101889-4b41-4193-bb88-a72e5db14914 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:17.959808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81101889-4b41-4193-bb88-a72e5db14914 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:17.960128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81101889-4b41-4193-bb88-a72e5db14914 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:17.960842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81101889-4b41-4193-bb88-a72e5db14914 None admin] RBAC: Adding query filter params (name=image) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:17.961147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81101889-4b41-4193-bb88-a72e5db14914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:17.962634 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81101889-4b41-4193-bb88-a72e5db14914 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:17.968193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 527/1038] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:17.969066 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81101889-4b41-4193-bb88-a72e5db14914 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:17.988708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:18.022379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76f77d-fa4b-43b6-b122-e7dd0481f239 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:18.059077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6943c9e-b704-4e75-83ca-3c1230c0eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:18.060174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6943c9e-b704-4e75-83ca-3c1230c0eef4 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:18.060174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6943c9e-b704-4e75-83ca-3c1230c0eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:18.060456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6943c9e-b704-4e75-83ca-3c1230c0eef4 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:18.060936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6943c9e-b704-4e75-83ca-3c1230c0eef4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:18.062485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6943c9e-b704-4e75-83ca-3c1230c0eef4 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:18.089864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 512/1039] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:08:17 2022] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:08:18.091763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6943c9e-b704-4e75-83ca-3c1230c0eef4 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:18.094149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81101889-4b41-4193-bb88-a72e5db14914 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:18.096573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:18.146702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37cf12-d84a-467b-8843-febaca94c2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:18.148886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37cf12-d84a-467b-8843-febaca94c2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:18.149753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37cf12-d84a-467b-8843-febaca94c2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:18.150261 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37cf12-d84a-467b-8843-febaca94c2c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:18.165088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37cf12-d84a-467b-8843-febaca94c2c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:18.167707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37cf12-d84a-467b-8843-febaca94c2c4 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-4f37cf12-d84a-467b-8843-febaca94c2c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:08:18.184281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:18.186085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:18.187917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:08:18.187917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:08:18.187917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:08:18.187917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:08:18.187917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:08:18.187917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:08:18.187917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:18.187917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:18.187917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 528/1040] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:18.193570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37cf12-d84a-467b-8843-febaca94c2c4 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:18.271392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6943c9e-b704-4e75-83ca-3c1230c0eef4 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:18.292664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:18.321110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4eb48-2506-4752-97f6-52f93058f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:18.321743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4eb48-2506-4752-97f6-52f93058f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:18.322031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4eb48-2506-4752-97f6-52f93058f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:18.322305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4eb48-2506-4752-97f6-52f93058f5d7 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:18.323051 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4eb48-2506-4752-97f6-52f93058f5d7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:18.323358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4eb48-2506-4752-97f6-52f93058f5d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:18.324781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4eb48-2506-4752-97f6-52f93058f5d7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:18.325285 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37cf12-d84a-467b-8843-febaca94c2c4 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:18.331867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 513/1041] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:18.341361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4eb48-2506-4752-97f6-52f93058f5d7 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:18.375026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1380e-e524-401c-91ed-bc57da170960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:18.375712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1380e-e524-401c-91ed-bc57da170960 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:18.376003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1380e-e524-401c-91ed-bc57da170960 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:18.376265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1380e-e524-401c-91ed-bc57da170960 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:18.377171 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1380e-e524-401c-91ed-bc57da170960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:18.377517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1380e-e524-401c-91ed-bc57da170960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:18.379079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1380e-e524-401c-91ed-bc57da170960 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:18.396676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 529/1042] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:18.402411 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1380e-e524-401c-91ed-bc57da170960 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:18.419928 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:18.460369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4eb48-2506-4752-97f6-52f93058f5d7 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:18.498655 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19441961-3623-4358-89ce-b87cc01ae32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:18.499438 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19441961-3623-4358-89ce-b87cc01ae32f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:18.499735 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19441961-3623-4358-89ce-b87cc01ae32f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:18.499992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19441961-3623-4358-89ce-b87cc01ae32f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:18.500813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19441961-3623-4358-89ce-b87cc01ae32f None admin] RBAC: Adding query filter params (interface=public, service_id=f57d46131afa4fb1b977dc75b2040e2b, region_id=RegionOne) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:18.501103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19441961-3623-4358-89ce-b87cc01ae32f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:18.502627 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19441961-3623-4358-89ce-b87cc01ae32f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:18.509279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 514/1043] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Jul 7 07:08:18 2022] GET /identity/v3/endpoints?service_id=f57d46131afa4fb1b977dc75b2040e2b&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:18.514654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19441961-3623-4358-89ce-b87cc01ae32f None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:18.514842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1380e-e524-401c-91ed-bc57da170960 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:18.553656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa79090-baa2-4ea8-9c3e-00a6f25fde6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:18.554358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79090-baa2-4ea8-9c3e-00a6f25fde6e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:18.554638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79090-baa2-4ea8-9c3e-00a6f25fde6e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:18.554908 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79090-baa2-4ea8-9c3e-00a6f25fde6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:18.555746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa79090-baa2-4ea8-9c3e-00a6f25fde6e None admin] RBAC: Adding query filter params (role.id=2c64ff3f3a674e64956bc6527d556f3f, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=42acdb53c342401da6b32be6b9f3d030) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:18.556055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa79090-baa2-4ea8-9c3e-00a6f25fde6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:18.557539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa79090-baa2-4ea8-9c3e-00a6f25fde6e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:18.559519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:18.577343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 530/1044] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:08:18 2022] GET /identity/v3/role_assignments?user.id=42acdb53c342401da6b32be6b9f3d030&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=2c64ff3f3a674e64956bc6527d556f3f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:18.648405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19441961-3623-4358-89ce-b87cc01ae32f None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:18.681792 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:18.691376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e4b37-7edf-436c-857f-831fa606086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:18.692441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4b37-7edf-436c-857f-831fa606086e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:18.692719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4b37-7edf-436c-857f-831fa606086e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:18.692988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4b37-7edf-436c-857f-831fa606086e None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:18.693844 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e4b37-7edf-436c-857f-831fa606086e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:18.695355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e4b37-7edf-436c-857f-831fa606086e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:18.709291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 515/1045] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Jul 7 07:08:18 2022] GET /identity/v3/services => generated 1957 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:08:20.238027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781327b-e07a-4e2f-8a84-4a19dc4125b9 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:20.238606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781327b-e07a-4e2f-8a84-4a19dc4125b9 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:20.238688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781327b-e07a-4e2f-8a84-4a19dc4125b9 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:20.240844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 531/1046] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:20.247073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b63b63-d067-49fa-b151-fc6c3b48abb5 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:20.247978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b63b63-d067-49fa-b151-fc6c3b48abb5 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:20.247978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b63b63-d067-49fa-b151-fc6c3b48abb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:20.266762 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-17b63b63-d067-49fa-b151-fc6c3b48abb5 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:20.268051 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-17b63b63-d067-49fa-b151-fc6c3b48abb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:20.347160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 516/1047] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:20.371552 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781327b-e07a-4e2f-8a84-4a19dc4125b9 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:20.501297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781327b-e07a-4e2f-8a84-4a19dc4125b9 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:20.543125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2e8ae-d7cb-47c2-95e9-2ecf651b25bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:20.544729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2e8ae-d7cb-47c2-95e9-2ecf651b25bc None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:20.545244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2e8ae-d7cb-47c2-95e9-2ecf651b25bc None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:20.545796 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2e8ae-d7cb-47c2-95e9-2ecf651b25bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:20.561284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2e8ae-d7cb-47c2-95e9-2ecf651b25bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-d8d2e8ae-d7cb-47c2-95e9-2ecf651b25bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:08:20.571404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:20.572459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:20.573324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:20.573324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:20.573324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:20.573324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:20.573324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:08:20.573324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:08:20.573324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:08:20.573324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:08:20.573324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:08:20.573324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:08:20.573324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:08:20.573324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:20.577405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 532/1048] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:08:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:20.585384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2e8ae-d7cb-47c2-95e9-2ecf651b25bc None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:20.587023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535bd0d-762c-48b1-8c36-8aa0ea385246 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:20.587313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535bd0d-762c-48b1-8c36-8aa0ea385246 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:20.587650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535bd0d-762c-48b1-8c36-8aa0ea385246 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:20.589418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 517/1049] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:20.595126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3bc4e-9134-4d3b-bb33-f6d3ad636c6e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:20.595445 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3bc4e-9134-4d3b-bb33-f6d3ad636c6e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:20.595700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3bc4e-9134-4d3b-bb33-f6d3ad636c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:20.615422 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-5ce3bc4e-9134-4d3b-bb33-f6d3ad636c6e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:20.616830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5ce3bc4e-9134-4d3b-bb33-f6d3ad636c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:20.671452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:20.719987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2e8ae-d7cb-47c2-95e9-2ecf651b25bc None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:20.733995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 518/1050] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:08:20.754210 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdbb71-4efe-437a-8b3c-a202448beaea None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:20.754724 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdbb71-4efe-437a-8b3c-a202448beaea None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:20.755008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdbb71-4efe-437a-8b3c-a202448beaea None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:20.756662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 519/1051] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:20.758276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdbb71-4efe-437a-8b3c-a202448beaea None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:20.766487 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33781e2-b568-443b-8d77-d89c7981c061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:20.767182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33781e2-b568-443b-8d77-d89c7981c061 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:20.767465 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33781e2-b568-443b-8d77-d89c7981c061 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:20.767739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33781e2-b568-443b-8d77-d89c7981c061 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:20.768508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33781e2-b568-443b-8d77-d89c7981c061 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:20.768842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33781e2-b568-443b-8d77-d89c7981c061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:20.770249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33781e2-b568-443b-8d77-d89c7981c061 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:20.780343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 533/1052] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:20.781689 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d2fd9-9d40-4314-ad50-2c9377176534 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:20.782059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d2fd9-9d40-4314-ad50-2c9377176534 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:20.782343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d2fd9-9d40-4314-ad50-2c9377176534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:20.799188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-7a7d2fd9-9d40-4314-ad50-2c9377176534 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:20.800416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7a7d2fd9-9d40-4314-ad50-2c9377176534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:20.827126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:20.869578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 534/1053] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:20.870432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d2fd9-9d40-4314-ad50-2c9377176534 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:20.872947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdbb71-4efe-437a-8b3c-a202448beaea None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:20.911439 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6f33e-629f-4d80-9a9e-b8c6120d90fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:20.912270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6f33e-629f-4d80-9a9e-b8c6120d90fd None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:20.912548 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6f33e-629f-4d80-9a9e-b8c6120d90fd None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:20.912821 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6f33e-629f-4d80-9a9e-b8c6120d90fd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:20.925960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6f33e-629f-4d80-9a9e-b8c6120d90fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-afe6f33e-629f-4d80-9a9e-b8c6120d90fd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:08:20.934202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:20.935152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:20.935999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 520/1054] 10.222.0.62 () {56 vars in 1120 bytes} [Thu Jul 7 07:08:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:20.936698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6f33e-629f-4d80-9a9e-b8c6120d90fd None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:20.948714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:21.002843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d2fd9-9d40-4314-ad50-2c9377176534 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:21.038608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6cce1-08d2-4d75-a91f-f7da1fdbf92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:21.039503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6cce1-08d2-4d75-a91f-f7da1fdbf92e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:21.039782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6cce1-08d2-4d75-a91f-f7da1fdbf92e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:21.040054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6cce1-08d2-4d75-a91f-f7da1fdbf92e None admin] PATH_INFO: `/v3/users/4bcd5d35515541d28e7904d23b666762` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:21.054150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6cce1-08d2-4d75-a91f-f7da1fdbf92e None admin] RBAC: Authorizing `identity:get_user(user_id=4bcd5d35515541d28e7904d23b666762)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:21.055617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6cce1-08d2-4d75-a91f-f7da1fdbf92e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:21.056699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6f33e-629f-4d80-9a9e-b8c6120d90fd None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:21.057942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 535/1055] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:08:20 2022] GET /identity/v3/users/4bcd5d35515541d28e7904d23b666762 => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:21.058796 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6cce1-08d2-4d75-a91f-f7da1fdbf92e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:21.075060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:21.096315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93e168-f414-44d2-8349-59691ed98d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:21.097120 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93e168-f414-44d2-8349-59691ed98d1f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:21.097413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93e168-f414-44d2-8349-59691ed98d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:21.097690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93e168-f414-44d2-8349-59691ed98d1f None admin] PATH_INFO: `/v3/services/image` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:21.098350 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93e168-f414-44d2-8349-59691ed98d1f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:21.099875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93e168-f414-44d2-8349-59691ed98d1f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-bc93e168-f414-44d2-8349-59691ed98d1f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:21.112156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:21.113361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 07:08:21.114191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:21.118686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 521/1056] 10.222.0.62 () {56 vars in 1105 bytes} [Thu Jul 7 07:08:20 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:21.119634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93e168-f414-44d2-8349-59691ed98d1f None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:21.166495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6cce1-08d2-4d75-a91f-f7da1fdbf92e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:21.176635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:21.208097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41163a6e-20d1-4e7a-b5f5-fb5ac34530e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:21.208790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41163a6e-20d1-4e7a-b5f5-fb5ac34530e9 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:21.209073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41163a6e-20d1-4e7a-b5f5-fb5ac34530e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:21.209391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41163a6e-20d1-4e7a-b5f5-fb5ac34530e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:21.210227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41163a6e-20d1-4e7a-b5f5-fb5ac34530e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:21.210542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41163a6e-20d1-4e7a-b5f5-fb5ac34530e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:21.211932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41163a6e-20d1-4e7a-b5f5-fb5ac34530e9 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:21.220496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 536/1057] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Jul 7 07:08:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:21.221327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41163a6e-20d1-4e7a-b5f5-fb5ac34530e9 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:21.227571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93e168-f414-44d2-8349-59691ed98d1f None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:21.267856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b88924-4d5c-47a9-b08c-7477c94b7bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:21.268650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b88924-4d5c-47a9-b08c-7477c94b7bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:21.268790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b88924-4d5c-47a9-b08c-7477c94b7bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:21.269095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b88924-4d5c-47a9-b08c-7477c94b7bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:21.319434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:21.343750 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41163a6e-20d1-4e7a-b5f5-fb5ac34530e9 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:21.345115 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b88924-4d5c-47a9-b08c-7477c94b7bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:21.346636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b88924-4d5c-47a9-b08c-7477c94b7bc7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:21.380210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499671-f449-47ce-9dc8-416746fbf747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:21.380880 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499671-f449-47ce-9dc8-416746fbf747 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:21.381158 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499671-f449-47ce-9dc8-416746fbf747 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:21.381465 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499671-f449-47ce-9dc8-416746fbf747 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:21.382167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee499671-f449-47ce-9dc8-416746fbf747 None admin] RBAC: Adding query filter params (name=image) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:21.382476 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee499671-f449-47ce-9dc8-416746fbf747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:21.383857 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee499671-f449-47ce-9dc8-416746fbf747 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:21.389312 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 537/1058] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:21.389679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499671-f449-47ce-9dc8-416746fbf747 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:21.427225 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:21.452876 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 522/1059] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:08:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:08:21.453794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b88924-4d5c-47a9-b08c-7477c94b7bc7 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:21.493185 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499671-f449-47ce-9dc8-416746fbf747 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:21.526061 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e589f1-7de7-4598-8d90-7e853c347b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:21.526865 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e589f1-7de7-4598-8d90-7e853c347b8e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:21.527157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e589f1-7de7-4598-8d90-7e853c347b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:21.527436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e589f1-7de7-4598-8d90-7e853c347b8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:21.532691 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:21.538359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e589f1-7de7-4598-8d90-7e853c347b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:21.539827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e589f1-7de7-4598-8d90-7e853c347b8e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:21.554935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b88924-4d5c-47a9-b08c-7477c94b7bc7 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-a9e589f1-7de7-4598-8d90-7e853c347b8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:21.556514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:21.557398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:21.558369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:08:21.558369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:21.558369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:21.558369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:21.558369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 538/1060] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:21.558637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e589f1-7de7-4598-8d90-7e853c347b8e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:21.593954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69231ed5-1d20-4f49-bce4-fc47f9abee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:21.594566 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69231ed5-1d20-4f49-bce4-fc47f9abee80 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:21.594848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69231ed5-1d20-4f49-bce4-fc47f9abee80 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:21.595125 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69231ed5-1d20-4f49-bce4-fc47f9abee80 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:21.595835 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69231ed5-1d20-4f49-bce4-fc47f9abee80 None admin] RBAC: Adding query filter params (type=image) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:21.596141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69231ed5-1d20-4f49-bce4-fc47f9abee80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:21.597542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69231ed5-1d20-4f49-bce4-fc47f9abee80 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:21.603102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 523/1061] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:21.604017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69231ed5-1d20-4f49-bce4-fc47f9abee80 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:21.647048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:21.662270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e589f1-7de7-4598-8d90-7e853c347b8e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:21.696050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f06369-3324-4271-a555-f84c16380b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:21.696928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f06369-3324-4271-a555-f84c16380b41 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:21.697204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f06369-3324-4271-a555-f84c16380b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:21.697519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f06369-3324-4271-a555-f84c16380b41 None admin] PATH_INFO: `/v3/projects/f128fd7325234b3cb827fa90df7b8a31` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:21.698859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f06369-3324-4271-a555-f84c16380b41 None admin] RBAC: Authorizing `identity:get_project(project_id=f128fd7325234b3cb827fa90df7b8a31)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:21.700297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f06369-3324-4271-a555-f84c16380b41 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:21.702308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 539/1062] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:08:21 2022] GET /identity/v3/projects/f128fd7325234b3cb827fa90df7b8a31 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:21.702931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f06369-3324-4271-a555-f84c16380b41 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:21.703467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69231ed5-1d20-4f49-bce4-fc47f9abee80 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:21.744195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ab903-486d-4376-9aea-e6fad2491aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:21.744863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ab903-486d-4376-9aea-e6fad2491aed None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:21.745145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ab903-486d-4376-9aea-e6fad2491aed None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:21.745450 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ab903-486d-4376-9aea-e6fad2491aed None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:21.746166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ab903-486d-4376-9aea-e6fad2491aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:21.746469 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ab903-486d-4376-9aea-e6fad2491aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:21.748115 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ab903-486d-4376-9aea-e6fad2491aed None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:21.761194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 524/1063] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:21.762218 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ab903-486d-4376-9aea-e6fad2491aed None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:21.765244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:21.811764 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f06369-3324-4271-a555-f84c16380b41 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:21.851070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c105eb-cab1-48e9-87d9-302c250a7a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:21.851670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c105eb-cab1-48e9-87d9-302c250a7a52 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:21.852383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c105eb-cab1-48e9-87d9-302c250a7a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:21.852383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c105eb-cab1-48e9-87d9-302c250a7a52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:21.852988 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c105eb-cab1-48e9-87d9-302c250a7a52 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:21.854482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c105eb-cab1-48e9-87d9-302c250a7a52 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:21.878548 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 540/1064] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Jul 7 07:08:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:08:21.879466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c105eb-cab1-48e9-87d9-302c250a7a52 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:21.883039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ab903-486d-4376-9aea-e6fad2491aed None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:21.896358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:21.956487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6216d3-a6f7-43b6-ab1b-7e950bca806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:21.957596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6216d3-a6f7-43b6-ab1b-7e950bca806f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:21.957882 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6216d3-a6f7-43b6-ab1b-7e950bca806f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:21.958162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6216d3-a6f7-43b6-ab1b-7e950bca806f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:21.959039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6216d3-a6f7-43b6-ab1b-7e950bca806f None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=f128fd7325234b3cb827fa90df7b8a31, user.id=4bcd5d35515541d28e7904d23b666762) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:21.959355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6216d3-a6f7-43b6-ab1b-7e950bca806f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:21.962083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6216d3-a6f7-43b6-ab1b-7e950bca806f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:21.971054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 525/1065] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:08:21 2022] GET /identity/v3/role_assignments?user.id=4bcd5d35515541d28e7904d23b666762&scope.project.id=f128fd7325234b3cb827fa90df7b8a31&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:22.032947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c105eb-cab1-48e9-87d9-302c250a7a52 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:22.086402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f3d6d-229b-4e34-8b48-e76240247578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:22.087973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f3d6d-229b-4e34-8b48-e76240247578 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:22.088619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f3d6d-229b-4e34-8b48-e76240247578 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:22.089255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f3d6d-229b-4e34-8b48-e76240247578 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:22.105162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f3d6d-229b-4e34-8b48-e76240247578 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:22.108134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f3d6d-229b-4e34-8b48-e76240247578 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-701f3d6d-229b-4e34-8b48-e76240247578 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:08:22.137962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:22.139030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:22.139989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:22.139989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:22.139989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:08:22.139989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:08:22.139989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:08:22.139989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:08:22.139989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:08:22.139989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:08:22.139989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:08:22.139989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:22.140532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 541/1066] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Jul 7 07:08:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:22.146462 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6216d3-a6f7-43b6-ab1b-7e950bca806f None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:22.222336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:22.273919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6216d3-a6f7-43b6-ab1b-7e950bca806f None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:22.318917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f95bb-51b5-49de-a96b-4306b2c3d714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:22.319810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f95bb-51b5-49de-a96b-4306b2c3d714 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:22.320217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f95bb-51b5-49de-a96b-4306b2c3d714 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:22.320584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f95bb-51b5-49de-a96b-4306b2c3d714 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:22.321615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f95bb-51b5-49de-a96b-4306b2c3d714 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:22.322067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f95bb-51b5-49de-a96b-4306b2c3d714 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:22.323617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f95bb-51b5-49de-a96b-4306b2c3d714 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:22.343125 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 526/1067] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Jul 7 07:08:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:22.348915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f3d6d-229b-4e34-8b48-e76240247578 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:22.435219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:22.474197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f3d6d-229b-4e34-8b48-e76240247578 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:22.517122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef8927-510e-496a-b202-36fb26ef0cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:22.517961 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef8927-510e-496a-b202-36fb26ef0cff None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:22.518239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef8927-510e-496a-b202-36fb26ef0cff None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:22.518506 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef8927-510e-496a-b202-36fb26ef0cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:22.530823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef8927-510e-496a-b202-36fb26ef0cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:22.532283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef8927-510e-496a-b202-36fb26ef0cff None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-94ef8927-510e-496a-b202-36fb26ef0cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:22.550456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:22.551637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:22.555616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:08:22.555616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:22.555616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:22.555616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:22.556714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 542/1068] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:22.557671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f95bb-51b5-49de-a96b-4306b2c3d714 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:22.672739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f95bb-51b5-49de-a96b-4306b2c3d714 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:22.696235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:22.713324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c69476-12d8-4d7f-8e60-9a20ade78038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:22.714012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c69476-12d8-4d7f-8e60-9a20ade78038 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:22.714294 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c69476-12d8-4d7f-8e60-9a20ade78038 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:22.714553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c69476-12d8-4d7f-8e60-9a20ade78038 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:22.715273 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c69476-12d8-4d7f-8e60-9a20ade78038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:22.715572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c69476-12d8-4d7f-8e60-9a20ade78038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:22.716958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c69476-12d8-4d7f-8e60-9a20ade78038 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:22.735048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 527/1069] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:22.736419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef8927-510e-496a-b202-36fb26ef0cff None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:22.849239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef8927-510e-496a-b202-36fb26ef0cff None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:22.875833 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:22.892840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77b3e3-47f8-415e-b82f-a52008de863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:22.893721 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77b3e3-47f8-415e-b82f-a52008de863f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:22.894004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77b3e3-47f8-415e-b82f-a52008de863f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:22.894279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77b3e3-47f8-415e-b82f-a52008de863f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:22.901825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77b3e3-47f8-415e-b82f-a52008de863f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:22.903314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77b3e3-47f8-415e-b82f-a52008de863f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-0e77b3e3-47f8-415e-b82f-a52008de863f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:08:22.918367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:22.919349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:22.920239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:08:22.920239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:08:22.920239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:08:22.920239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:08:22.920239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:08:22.920239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:08:22.920239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:22.920239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:22.921430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 543/1070] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:08:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:22.925720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c69476-12d8-4d7f-8e60-9a20ade78038 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:23.068773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c69476-12d8-4d7f-8e60-9a20ade78038 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:23.126148 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2ca91-a937-4fcf-9a83-1bc15f904804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:23.127045 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2ca91-a937-4fcf-9a83-1bc15f904804 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:23.127333 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2ca91-a937-4fcf-9a83-1bc15f904804 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:23.127699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2ca91-a937-4fcf-9a83-1bc15f904804 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:23.128895 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2ca91-a937-4fcf-9a83-1bc15f904804 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:23.129238 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2ca91-a937-4fcf-9a83-1bc15f904804 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:23.130769 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2ca91-a937-4fcf-9a83-1bc15f904804 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:23.150090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 528/1071] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:08:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:23.152291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77b3e3-47f8-415e-b82f-a52008de863f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:23.262414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77b3e3-47f8-415e-b82f-a52008de863f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:23.299638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadf085-05fe-4d12-869e-4084ed386d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:23.301293 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadf085-05fe-4d12-869e-4084ed386d78 None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:23.301808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadf085-05fe-4d12-869e-4084ed386d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:23.302276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadf085-05fe-4d12-869e-4084ed386d78 None admin] PATH_INFO: `/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/42acdb53c342401da6b32be6b9f3d030/roles/2c64ff3f3a674e64956bc6527d556f3f` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:23.305979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadf085-05fe-4d12-869e-4084ed386d78 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d7163b6caf648d89fd2cd48f27b1a23, user_id=42acdb53c342401da6b32be6b9f3d030, role_id=2c64ff3f3a674e64956bc6527d556f3f)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:23.308593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadf085-05fe-4d12-869e-4084ed386d78 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:23.333255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 544/1072] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:08:23 2022] PUT /identity/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/42acdb53c342401da6b32be6b9f3d030/roles/2c64ff3f3a674e64956bc6527d556f3f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:08:24.016306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacf357-a002-4db8-ab73-58d86120c4fb None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:24.017112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacf357-a002-4db8-ab73-58d86120c4fb None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:24.017112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacf357-a002-4db8-ab73-58d86120c4fb None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:24.018710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 529/1073] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:24.024405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd2a61-3dc2-4c42-ad36-584d8975fded None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:24.024960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd2a61-3dc2-4c42-ad36-584d8975fded None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:24.024960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd2a61-3dc2-4c42-ad36-584d8975fded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:24.032701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae491f0-01ed-4e5b-8e42-6939c677c129 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:24.033041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae491f0-01ed-4e5b-8e42-6939c677c129 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:24.033299 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae491f0-01ed-4e5b-8e42-6939c677c129 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:24.034966 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 530/1074] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:24.040773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa88378-8a37-469a-a11e-3707c7d7552e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:24.041076 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa88378-8a37-469a-a11e-3707c7d7552e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:24.041372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa88378-8a37-469a-a11e-3707c7d7552e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:24.043345 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-5dbd2a61-3dc2-4c42-ad36-584d8975fded None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:24.044571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-5dbd2a61-3dc2-4c42-ad36-584d8975fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:24.060137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-7aa88378-8a37-469a-a11e-3707c7d7552e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:24.061406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7aa88378-8a37-469a-a11e-3707c7d7552e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:24.097131 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:24.117521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:24.140648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 545/1075] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:24.164172 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd2a61-3dc2-4c42-ad36-584d8975fded None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:24.188416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 531/1076] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:24.212236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa88378-8a37-469a-a11e-3707c7d7552e None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:24.319329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd2a61-3dc2-4c42-ad36-584d8975fded None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:24.378986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a50bd-49f2-452a-99cb-8c5908929dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:24.379874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a50bd-49f2-452a-99cb-8c5908929dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:24.379987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a50bd-49f2-452a-99cb-8c5908929dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:24.380210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a50bd-49f2-452a-99cb-8c5908929dd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:24.385172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa88378-8a37-469a-a11e-3707c7d7552e None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:24.439856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43571334-592c-488a-868e-b5b1179b4496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:24.440683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571334-592c-488a-868e-b5b1179b4496 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:24.440966 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571334-592c-488a-868e-b5b1179b4496 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:24.441314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571334-592c-488a-868e-b5b1179b4496 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:24.447972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:24.457820 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43571334-592c-488a-868e-b5b1179b4496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-43571334-592c-488a-868e-b5b1179b4496 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:08:24.466745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:24.467904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:24.468888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:24.468888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:24.468888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:24.468888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:24.468888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:08:24.468888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:08:24.468888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:08:24.468888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:08:24.468888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:08:24.468888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:08:24.468888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:08:24.468888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:24.471475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 532/1077] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:08:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:24.481580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43571334-592c-488a-868e-b5b1179b4496 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:24.493089 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a50bd-49f2-452a-99cb-8c5908929dd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:24.494716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a50bd-49f2-452a-99cb-8c5908929dd0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:24.540352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:24.639089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43571334-592c-488a-868e-b5b1179b4496 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:24.648362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 546/1078] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:08:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 07 07:08:24.649797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a50bd-49f2-452a-99cb-8c5908929dd0 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:24.692464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b799d1c-07b0-4d3f-b0cf-ccbd93c8a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:24.693713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b799d1c-07b0-4d3f-b0cf-ccbd93c8a75a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:24.694257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b799d1c-07b0-4d3f-b0cf-ccbd93c8a75a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:24.694760 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b799d1c-07b0-4d3f-b0cf-ccbd93c8a75a None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:24.696281 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b799d1c-07b0-4d3f-b0cf-ccbd93c8a75a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:24.696833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b799d1c-07b0-4d3f-b0cf-ccbd93c8a75a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:24.700011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b799d1c-07b0-4d3f-b0cf-ccbd93c8a75a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:24.717542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 533/1079] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:08:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:24.726858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b799d1c-07b0-4d3f-b0cf-ccbd93c8a75a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:24.773261 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:24.821530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a50bd-49f2-452a-99cb-8c5908929dd0 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:24.858518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f9631-ee86-427d-9283-cab98edc0d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:24.859339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f9631-ee86-427d-9283-cab98edc0d72 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:24.859620 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f9631-ee86-427d-9283-cab98edc0d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:24.859889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f9631-ee86-427d-9283-cab98edc0d72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:24.872163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f9631-ee86-427d-9283-cab98edc0d72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:24.874059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f9631-ee86-427d-9283-cab98edc0d72 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-6f9f9631-ee86-427d-9283-cab98edc0d72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:24.893425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:24.894402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:24.895279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:08:24.895279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:24.895279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:24.895279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:24.897641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 547/1080] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:08:24.900434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f9631-ee86-427d-9283-cab98edc0d72 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:24.910212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:24.928526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b799d1c-07b0-4d3f-b0cf-ccbd93c8a75a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:24.977449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46808e-f1ae-47fa-9842-65ab9063511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:24.978374 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46808e-f1ae-47fa-9842-65ab9063511f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:24.978656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46808e-f1ae-47fa-9842-65ab9063511f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:24.978931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46808e-f1ae-47fa-9842-65ab9063511f None admin] PATH_INFO: `/v3/users/4bcd5d35515541d28e7904d23b666762` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:24.980183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46808e-f1ae-47fa-9842-65ab9063511f None admin] RBAC: Authorizing `identity:get_user(user_id=4bcd5d35515541d28e7904d23b666762)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:24.981686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46808e-f1ae-47fa-9842-65ab9063511f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:24.988391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 534/1081] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:08:24 2022] GET /identity/v3/users/4bcd5d35515541d28e7904d23b666762 => generated 285 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:24.989347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46808e-f1ae-47fa-9842-65ab9063511f None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:25.019826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f9631-ee86-427d-9283-cab98edc0d72 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:25.050092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:25.065320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef334729-3d0a-4aed-b133-1019901ed010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:25.066011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef334729-3d0a-4aed-b133-1019901ed010 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:25.066301 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef334729-3d0a-4aed-b133-1019901ed010 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:25.066580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef334729-3d0a-4aed-b133-1019901ed010 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:25.067713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef334729-3d0a-4aed-b133-1019901ed010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:25.068038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef334729-3d0a-4aed-b133-1019901ed010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:25.069513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef334729-3d0a-4aed-b133-1019901ed010 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:25.084027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 548/1082] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:25.108625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46808e-f1ae-47fa-9842-65ab9063511f None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:25.154719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303413c6-5301-485a-a5e4-e02dab691655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:25.155917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303413c6-5301-485a-a5e4-e02dab691655 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:25.156351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303413c6-5301-485a-a5e4-e02dab691655 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:25.156769 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303413c6-5301-485a-a5e4-e02dab691655 None admin] PATH_INFO: `/v3/projects/f128fd7325234b3cb827fa90df7b8a31` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:25.158307 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303413c6-5301-485a-a5e4-e02dab691655 None admin] RBAC: Authorizing `identity:get_project(project_id=f128fd7325234b3cb827fa90df7b8a31)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:25.159970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303413c6-5301-485a-a5e4-e02dab691655 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:25.162066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 535/1083] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:08:24 2022] GET /identity/v3/projects/f128fd7325234b3cb827fa90df7b8a31 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:25.168567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef334729-3d0a-4aed-b133-1019901ed010 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:25.291832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef334729-3d0a-4aed-b133-1019901ed010 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:25.358490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef75599-255c-4b98-a027-b7526fbab560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:25.359844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef75599-255c-4b98-a027-b7526fbab560 None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:25.360119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef75599-255c-4b98-a027-b7526fbab560 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:25.360395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef75599-255c-4b98-a027-b7526fbab560 None admin] PATH_INFO: `/v3/projects/f128fd7325234b3cb827fa90df7b8a31/users/4bcd5d35515541d28e7904d23b666762/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:25.363203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef75599-255c-4b98-a027-b7526fbab560 None admin] RBAC: Authorizing `identity:create_grant(project_id=f128fd7325234b3cb827fa90df7b8a31, user_id=4bcd5d35515541d28e7904d23b666762, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:25.365510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef75599-255c-4b98-a027-b7526fbab560 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:25.385961 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 549/1084] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:08:25 2022] PUT /identity/v3/projects/f128fd7325234b3cb827fa90df7b8a31/users/4bcd5d35515541d28e7904d23b666762/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:08:25.462900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aa4c8-85d1-4c6b-94d8-e562e4227912 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:25.463228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aa4c8-85d1-4c6b-94d8-e562e4227912 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:25.463512 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aa4c8-85d1-4c6b-94d8-e562e4227912 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:25.465030 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 536/1085] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:25.471361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb60ac-d1b6-4422-b9a4-0e4a83158a43 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:25.471656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb60ac-d1b6-4422-b9a4-0e4a83158a43 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:25.471925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb60ac-d1b6-4422-b9a4-0e4a83158a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:25.491415 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-cafb60ac-d1b6-4422-b9a4-0e4a83158a43 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:25.492662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-cafb60ac-d1b6-4422-b9a4-0e4a83158a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:25.556003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:25.587884 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 550/1086] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:25.613048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aa4c8-85d1-4c6b-94d8-e562e4227912 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:25.646012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:25.726627 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aa4c8-85d1-4c6b-94d8-e562e4227912 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:25.764348 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533df19-2fad-4dbb-9154-5ed3f58ab4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:25.765250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533df19-2fad-4dbb-9154-5ed3f58ab4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:25.765544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533df19-2fad-4dbb-9154-5ed3f58ab4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:25.765820 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533df19-2fad-4dbb-9154-5ed3f58ab4e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:25.779051 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533df19-2fad-4dbb-9154-5ed3f58ab4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-5533df19-2fad-4dbb-9154-5ed3f58ab4e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:08:25.787539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:25.788795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:25.789710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 537/1087] 10.222.0.62 () {56 vars in 1120 bytes} [Thu Jul 7 07:08:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:25.795188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb60ac-d1b6-4422-b9a4-0e4a83158a43 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:25.914574 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb60ac-d1b6-4422-b9a4-0e4a83158a43 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:25.952417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12da44e-280d-411a-9715-00ffcb148e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:25.953094 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12da44e-280d-411a-9715-00ffcb148e48 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:25.953416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12da44e-280d-411a-9715-00ffcb148e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:25.953692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12da44e-280d-411a-9715-00ffcb148e48 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:25.954458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12da44e-280d-411a-9715-00ffcb148e48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:25.954762 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12da44e-280d-411a-9715-00ffcb148e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:25.956162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12da44e-280d-411a-9715-00ffcb148e48 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:25.965452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 551/1088] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Jul 7 07:08:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:25.971624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533df19-2fad-4dbb-9154-5ed3f58ab4e5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:26.068909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:26.089674 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533df19-2fad-4dbb-9154-5ed3f58ab4e5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:26.130555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cd126-9b51-46ab-897c-b6e46150e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:26.131370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cd126-9b51-46ab-897c-b6e46150e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:26.131726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cd126-9b51-46ab-897c-b6e46150e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:26.132002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cd126-9b51-46ab-897c-b6e46150e2c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:26.143297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56cd126-9b51-46ab-897c-b6e46150e2c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:26.144764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56cd126-9b51-46ab-897c-b6e46150e2c0 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-e56cd126-9b51-46ab-897c-b6e46150e2c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:26.163986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:26.165268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:26.166352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:08:26.166352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:26.166352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:26.166352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:26.166352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 538/1089] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:26.171296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12da44e-280d-411a-9715-00ffcb148e48 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:26.208242 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:26.276802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12da44e-280d-411a-9715-00ffcb148e48 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:26.312817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7389d49-7f45-4c90-ab1e-9b62025a497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:26.313511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7389d49-7f45-4c90-ab1e-9b62025a497c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:26.313776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7389d49-7f45-4c90-ab1e-9b62025a497c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:26.314047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7389d49-7f45-4c90-ab1e-9b62025a497c None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:26.314800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7389d49-7f45-4c90-ab1e-9b62025a497c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:26.315102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7389d49-7f45-4c90-ab1e-9b62025a497c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:26.316479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7389d49-7f45-4c90-ab1e-9b62025a497c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:26.330992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 552/1090] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:26.336813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cd126-9b51-46ab-897c-b6e46150e2c0 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:26.440863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cd126-9b51-46ab-897c-b6e46150e2c0 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:26.476235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8947eb-917f-4ffc-b364-14eedb1f8530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:26.477078 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8947eb-917f-4ffc-b364-14eedb1f8530 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:26.477390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8947eb-917f-4ffc-b364-14eedb1f8530 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:26.477662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8947eb-917f-4ffc-b364-14eedb1f8530 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:26.485563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8947eb-917f-4ffc-b364-14eedb1f8530 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:26.487085 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8947eb-917f-4ffc-b364-14eedb1f8530 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:26.489860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-8c8947eb-917f-4ffc-b364-14eedb1f8530 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:08:26.504646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:26.510810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:26.512015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:26.512015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:26.512015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:08:26.512015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:08:26.512015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:08:26.512015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:08:26.512015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:08:26.512015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:08:26.512015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 07:08:26.512015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:26.512015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 539/1091] 10.222.0.62 () {56 vars in 1093 bytes} [Thu Jul 7 07:08:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:26.512733 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7389d49-7f45-4c90-ab1e-9b62025a497c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:26.621199 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:26.629243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7389d49-7f45-4c90-ab1e-9b62025a497c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:26.667349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d36066-da84-4bce-b077-42d86374111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:26.668029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d36066-da84-4bce-b077-42d86374111e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:26.668308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d36066-da84-4bce-b077-42d86374111e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:26.668582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d36066-da84-4bce-b077-42d86374111e None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:26.669477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d36066-da84-4bce-b077-42d86374111e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:26.669781 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d36066-da84-4bce-b077-42d86374111e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:26.671256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d36066-da84-4bce-b077-42d86374111e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:26.690687 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 553/1092] 10.222.0.62 () {56 vars in 1133 bytes} [Thu Jul 7 07:08:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:26.696948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8947eb-917f-4ffc-b364-14eedb1f8530 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:26.802065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8947eb-917f-4ffc-b364-14eedb1f8530 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:26.841360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ebebc-300d-4d31-9450-59c2ff3a7bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:26.842036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ebebc-300d-4d31-9450-59c2ff3a7bdb None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:26.842304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ebebc-300d-4d31-9450-59c2ff3a7bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:26.842586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ebebc-300d-4d31-9450-59c2ff3a7bdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:26.914466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:26.917679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ebebc-300d-4d31-9450-59c2ff3a7bdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:26.919676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ebebc-300d-4d31-9450-59c2ff3a7bdb None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:27.027148 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 540/1093] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:08:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:08:27.033121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d36066-da84-4bce-b077-42d86374111e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:27.143049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d36066-da84-4bce-b077-42d86374111e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:27.179004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae3238-e70f-4d29-85cf-5939e00e3621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:27.179710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae3238-e70f-4d29-85cf-5939e00e3621 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:27.180003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae3238-e70f-4d29-85cf-5939e00e3621 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:27.180279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae3238-e70f-4d29-85cf-5939e00e3621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:27.191177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae3238-e70f-4d29-85cf-5939e00e3621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:27.193012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae3238-e70f-4d29-85cf-5939e00e3621 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-37ae3238-e70f-4d29-85cf-5939e00e3621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:27.211454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:27.212555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:27.214107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:08:27.214107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:27.214107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:08:27.214107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:27.214107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 554/1094] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:27.218613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ebebc-300d-4d31-9450-59c2ff3a7bdb None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:27.320023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:27.323737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ebebc-300d-4d31-9450-59c2ff3a7bdb None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:27.363080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766ef33-0f71-49bf-af4b-905682de8f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:27.363764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766ef33-0f71-49bf-af4b-905682de8f43 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:27.364056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766ef33-0f71-49bf-af4b-905682de8f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:27.364310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766ef33-0f71-49bf-af4b-905682de8f43 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:27.365041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766ef33-0f71-49bf-af4b-905682de8f43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:27.365392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766ef33-0f71-49bf-af4b-905682de8f43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:27.366885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766ef33-0f71-49bf-af4b-905682de8f43 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:27.379066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 541/1095] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:27.384577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae3238-e70f-4d29-85cf-5939e00e3621 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:27.393874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:27.491842 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040907ac-3591-41f5-b981-fadac8782bd3 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:27.492041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040907ac-3591-41f5-b981-fadac8782bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:27.492311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040907ac-3591-41f5-b981-fadac8782bd3 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:27.493824 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 542/1096] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:27.500456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae3238-e70f-4d29-85cf-5939e00e3621 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:27.501830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803fe8e-005f-4181-8de7-6074452293b3 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:27.502311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803fe8e-005f-4181-8de7-6074452293b3 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:27.502776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803fe8e-005f-4181-8de7-6074452293b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:27.521536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-3803fe8e-005f-4181-8de7-6074452293b3 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:27.522824 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3803fe8e-005f-4181-8de7-6074452293b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:27.538734 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee30c3a-7596-4145-8119-c477e7ad20d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:27.539532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee30c3a-7596-4145-8119-c477e7ad20d0 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:27.539827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee30c3a-7596-4145-8119-c477e7ad20d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:27.540105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee30c3a-7596-4145-8119-c477e7ad20d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:27.547290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee30c3a-7596-4145-8119-c477e7ad20d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:27.548763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee30c3a-7596-4145-8119-c477e7ad20d0 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-cee30c3a-7596-4145-8119-c477e7ad20d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:08:27.563309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:27.564346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:27.565273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:08:27.565273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:08:27.565273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:08:27.565273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:08:27.565273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:08:27.565273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:08:27.565273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:08:27.565273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:27.565273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 555/1097] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:08:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:27.572049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee30c3a-7596-4145-8119-c477e7ad20d0 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:27.606892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 543/1098] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:08:27.631339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803fe8e-005f-4181-8de7-6074452293b3 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:27.643962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:27.688251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee30c3a-7596-4145-8119-c477e7ad20d0 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:27.725410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae6092-6378-48a9-b30c-fe63e1d70b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:27.726106 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae6092-6378-48a9-b30c-fe63e1d70b26 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:27.726389 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae6092-6378-48a9-b30c-fe63e1d70b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:27.726668 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae6092-6378-48a9-b30c-fe63e1d70b26 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:27.727483 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae6092-6378-48a9-b30c-fe63e1d70b26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:27.727800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae6092-6378-48a9-b30c-fe63e1d70b26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:27.729318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae6092-6378-48a9-b30c-fe63e1d70b26 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:27.739170 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:27.743714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 556/1099] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:08:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:27.750382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803fe8e-005f-4181-8de7-6074452293b3 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:27.750566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae6092-6378-48a9-b30c-fe63e1d70b26 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:27.787277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f88b38-b121-4807-ac15-a837c01d9b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:27.788189 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f88b38-b121-4807-ac15-a837c01d9b69 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:27.788521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f88b38-b121-4807-ac15-a837c01d9b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:27.788766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f88b38-b121-4807-ac15-a837c01d9b69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:27.800624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f88b38-b121-4807-ac15-a837c01d9b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-16f88b38-b121-4807-ac15-a837c01d9b69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:08:27.808405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:27.809480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:27.810312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 544/1100] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:08:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:27.818262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f88b38-b121-4807-ac15-a837c01d9b69 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:27.861695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae6092-6378-48a9-b30c-fe63e1d70b26 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:27.890799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:27.901587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824810cb-8476-49d3-a1e8-f6f462115206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:27.902261 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824810cb-8476-49d3-a1e8-f6f462115206 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:27.902545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824810cb-8476-49d3-a1e8-f6f462115206 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:27.902823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824810cb-8476-49d3-a1e8-f6f462115206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:27.903669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824810cb-8476-49d3-a1e8-f6f462115206 None admin] RBAC: Adding query filter params (role.id=2c64ff3f3a674e64956bc6527d556f3f, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=42acdb53c342401da6b32be6b9f3d030) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:27.903978 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824810cb-8476-49d3-a1e8-f6f462115206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:27.905895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824810cb-8476-49d3-a1e8-f6f462115206 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:27.912568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 557/1101] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:08:27 2022] GET /identity/v3/role_assignments?user.id=42acdb53c342401da6b32be6b9f3d030&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=2c64ff3f3a674e64956bc6527d556f3f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:27.936024 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f88b38-b121-4807-ac15-a837c01d9b69 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:27.978279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f60aa-fe89-4bd3-b53b-2493a04ce9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:27.978979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f60aa-fe89-4bd3-b53b-2493a04ce9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:27.979261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f60aa-fe89-4bd3-b53b-2493a04ce9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:27.979535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f60aa-fe89-4bd3-b53b-2493a04ce9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:27.980303 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f60aa-fe89-4bd3-b53b-2493a04ce9d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:27.980607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f60aa-fe89-4bd3-b53b-2493a04ce9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:27.982075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f60aa-fe89-4bd3-b53b-2493a04ce9d0 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:27.992394 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 545/1102] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:08:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:27.998842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824810cb-8476-49d3-a1e8-f6f462115206 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:28.128651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824810cb-8476-49d3-a1e8-f6f462115206 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:28.180446 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb6988-cc4a-4138-8627-04f9cb9ab406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:28.181609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb6988-cc4a-4138-8627-04f9cb9ab406 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:28.181894 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb6988-cc4a-4138-8627-04f9cb9ab406 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:28.182217 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb6988-cc4a-4138-8627-04f9cb9ab406 None admin] PATH_INFO: `/v3/users/4bcd5d35515541d28e7904d23b666762` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:28.183710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb6988-cc4a-4138-8627-04f9cb9ab406 None admin] RBAC: Authorizing `identity:get_user(user_id=4bcd5d35515541d28e7904d23b666762)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:28.185293 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb6988-cc4a-4138-8627-04f9cb9ab406 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:28.187119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 558/1103] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:08:27 2022] GET /identity/v3/users/4bcd5d35515541d28e7904d23b666762 => generated 285 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:28.193719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f60aa-fe89-4bd3-b53b-2493a04ce9d0 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:28.214398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:28.318163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f60aa-fe89-4bd3-b53b-2493a04ce9d0 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:28.365170 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab125ed-887f-47c4-ac86-3109b960e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:28.365916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab125ed-887f-47c4-ac86-3109b960e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:28.366198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab125ed-887f-47c4-ac86-3109b960e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:28.366476 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab125ed-887f-47c4-ac86-3109b960e5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:28.445008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab125ed-887f-47c4-ac86-3109b960e5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:28.446565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab125ed-887f-47c4-ac86-3109b960e5a7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:28.463041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:28.573975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 546/1104] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:08:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:08:28.581275 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb6988-cc4a-4138-8627-04f9cb9ab406 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:28.666456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:28.721609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb6988-cc4a-4138-8627-04f9cb9ab406 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:28.763731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde6365-bbec-40c9-9bd3-cf2e0a1a9ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:28.764665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde6365-bbec-40c9-9bd3-cf2e0a1a9ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:28.764963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde6365-bbec-40c9-9bd3-cf2e0a1a9ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:28.765245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde6365-bbec-40c9-9bd3-cf2e0a1a9ce8 None admin] PATH_INFO: `/v3/projects/f128fd7325234b3cb827fa90df7b8a31` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:28.766494 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde6365-bbec-40c9-9bd3-cf2e0a1a9ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=f128fd7325234b3cb827fa90df7b8a31)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:28.767963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde6365-bbec-40c9-9bd3-cf2e0a1a9ce8 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:28.769804 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 559/1105] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:08:28 2022] GET /identity/v3/projects/f128fd7325234b3cb827fa90df7b8a31 => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:28.776465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab125ed-887f-47c4-ac86-3109b960e5a7 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:28.890883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab125ed-887f-47c4-ac86-3109b960e5a7 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:28.905990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:28.932167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b2a73-fd16-44df-a09d-2db93591fee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:28.932836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2a73-fd16-44df-a09d-2db93591fee2 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:28.933115 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2a73-fd16-44df-a09d-2db93591fee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:28.933415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2a73-fd16-44df-a09d-2db93591fee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:28.934251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b2a73-fd16-44df-a09d-2db93591fee2 None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=f128fd7325234b3cb827fa90df7b8a31, user.id=4bcd5d35515541d28e7904d23b666762) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:28.934563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b2a73-fd16-44df-a09d-2db93591fee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:28.936006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b2a73-fd16-44df-a09d-2db93591fee2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:28.942861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 547/1106] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:08:28 2022] GET /identity/v3/role_assignments?user.id=4bcd5d35515541d28e7904d23b666762&scope.project.id=f128fd7325234b3cb827fa90df7b8a31&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:31.194857 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc7f6d-812c-4926-9f8f-3ace0b46eeba None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:31.195611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc7f6d-812c-4926-9f8f-3ace0b46eeba None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:31.195611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc7f6d-812c-4926-9f8f-3ace0b46eeba None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:31.196876 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 560/1107] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:31.203133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067345d3-6f43-45cb-b04c-ded7ce0a7b30 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:31.203723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067345d3-6f43-45cb-b04c-ded7ce0a7b30 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:31.203723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067345d3-6f43-45cb-b04c-ded7ce0a7b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:31.224207 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-067345d3-6f43-45cb-b04c-ded7ce0a7b30 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:31.225726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-067345d3-6f43-45cb-b04c-ded7ce0a7b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:31.305405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 548/1108] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:31.332083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc7f6d-812c-4926-9f8f-3ace0b46eeba None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:31.452646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc7f6d-812c-4926-9f8f-3ace0b46eeba None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:31.483856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:31.494723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0839f-0579-47a5-9510-54fbdc112b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:31.495564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0839f-0579-47a5-9510-54fbdc112b0c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:31.495842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0839f-0579-47a5-9510-54fbdc112b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:31.496100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0839f-0579-47a5-9510-54fbdc112b0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:31.497458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0839f-0579-47a5-9510-54fbdc112b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:31.498963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0839f-0579-47a5-9510-54fbdc112b0c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:31.500730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 561/1109] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:31.506843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067345d3-6f43-45cb-b04c-ded7ce0a7b30 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:31.645790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067345d3-6f43-45cb-b04c-ded7ce0a7b30 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:31.654200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:31.686305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ee604-9491-4435-b942-7c498dd4b654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:31.687000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ee604-9491-4435-b942-7c498dd4b654 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:31.687288 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ee604-9491-4435-b942-7c498dd4b654 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:31.687566 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ee604-9491-4435-b942-7c498dd4b654 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:31.688298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ee604-9491-4435-b942-7c498dd4b654 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:31.689845 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ee604-9491-4435-b942-7c498dd4b654 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:31.712961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 549/1110] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:08:31 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:08:33.849597 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da64022-b665-4920-84c1-4695e30afb6e None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:33.850352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da64022-b665-4920-84c1-4695e30afb6e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:33.850352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da64022-b665-4920-84c1-4695e30afb6e None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:33.851859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 562/1111] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:33.857740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e5e91-4289-471f-86f9-4c660b005f48 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:33.857740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e5e91-4289-471f-86f9-4c660b005f48 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:33.857740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e5e91-4289-471f-86f9-4c660b005f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:33.876296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-471e5e91-4289-471f-86f9-4c660b005f48 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:33.877599 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-471e5e91-4289-471f-86f9-4c660b005f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:33.950739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 550/1112] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:33.975256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da64022-b665-4920-84c1-4695e30afb6e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:34.085051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da64022-b665-4920-84c1-4695e30afb6e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:34.123625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e55dd-12be-4dd0-ae69-fb3a878c2c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:34.124413 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e55dd-12be-4dd0-ae69-fb3a878c2c31 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:34.124689 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e55dd-12be-4dd0-ae69-fb3a878c2c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:34.124971 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e55dd-12be-4dd0-ae69-fb3a878c2c31 None admin] PATH_INFO: `/v3/roles/5c9f98a938a74f35857ce032dd9e06b1` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:34.126951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e55dd-12be-4dd0-ae69-fb3a878c2c31 None admin] RBAC: Authorizing `identity:get_role(role_id=5c9f98a938a74f35857ce032dd9e06b1)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:34.128371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e55dd-12be-4dd0-ae69-fb3a878c2c31 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:34.129876 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 563/1113] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:08:33 2022] GET /identity/v3/roles/5c9f98a938a74f35857ce032dd9e06b1 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:34.136100 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e5e91-4289-471f-86f9-4c660b005f48 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:34.241673 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:34.258441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e5e91-4289-471f-86f9-4c660b005f48 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:34.294796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd6d9-0417-4f62-ab23-203f3529bfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:34.295675 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd6d9-0417-4f62-ab23-203f3529bfdc None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:34.295954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd6d9-0417-4f62-ab23-203f3529bfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:34.296222 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd6d9-0417-4f62-ab23-203f3529bfdc None admin] PATH_INFO: `/v3/users/2aed97772ee14c6884bec77cb4bea148` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:34.311947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cd6d9-0417-4f62-ab23-203f3529bfdc None admin] RBAC: Authorizing `identity:get_user(user_id=2aed97772ee14c6884bec77cb4bea148)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:34.313553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cd6d9-0417-4f62-ab23-203f3529bfdc None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:34.315355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 551/1114] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:08:34 2022] GET /identity/v3/users/2aed97772ee14c6884bec77cb4bea148 => generated 286 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:34.324791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e55dd-12be-4dd0-ae69-fb3a878c2c31 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:34.395368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:34.437782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e55dd-12be-4dd0-ae69-fb3a878c2c31 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:34.475467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05659d7-50f1-4281-8520-d54829ceb55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:34.476126 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05659d7-50f1-4281-8520-d54829ceb55f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:34.476408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05659d7-50f1-4281-8520-d54829ceb55f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:34.476686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05659d7-50f1-4281-8520-d54829ceb55f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:34.546284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05659d7-50f1-4281-8520-d54829ceb55f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:34.547744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05659d7-50f1-4281-8520-d54829ceb55f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:34.610691 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:34.657349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 564/1115] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:08:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:08:34.663679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd6d9-0417-4f62-ab23-203f3529bfdc None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:34.769083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd6d9-0417-4f62-ab23-203f3529bfdc None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:34.807132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cfd70-3eb0-432f-8146-2ca35e2e8e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:34.808715 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cfd70-3eb0-432f-8146-2ca35e2e8e28 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:34.809013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cfd70-3eb0-432f-8146-2ca35e2e8e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:34.809345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cfd70-3eb0-432f-8146-2ca35e2e8e28 None admin] PATH_INFO: `/v3/projects/f128fd7325234b3cb827fa90df7b8a31` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:34.810584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cfd70-3eb0-432f-8146-2ca35e2e8e28 None admin] RBAC: Authorizing `identity:get_project(project_id=f128fd7325234b3cb827fa90df7b8a31)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:34.812048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cfd70-3eb0-432f-8146-2ca35e2e8e28 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:34.813881 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 552/1116] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:08:34 2022] GET /identity/v3/projects/f128fd7325234b3cb827fa90df7b8a31 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:34.820770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05659d7-50f1-4281-8520-d54829ceb55f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:34.932280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05659d7-50f1-4281-8520-d54829ceb55f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:34.974301 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c5965-dc51-450b-a3ef-9061df479475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:34.975353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c5965-dc51-450b-a3ef-9061df479475 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:34.976006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c5965-dc51-450b-a3ef-9061df479475 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:34.976006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c5965-dc51-450b-a3ef-9061df479475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:34.976948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c5965-dc51-450b-a3ef-9061df479475 None admin] RBAC: Adding query filter params (role.id=5c9f98a938a74f35857ce032dd9e06b1, scope.project.id=f128fd7325234b3cb827fa90df7b8a31, user.id=2aed97772ee14c6884bec77cb4bea148) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:34.977268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c5965-dc51-450b-a3ef-9061df479475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:34.978904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c5965-dc51-450b-a3ef-9061df479475 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:34.988090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 565/1117] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:08:34 2022] GET /identity/v3/role_assignments?user.id=2aed97772ee14c6884bec77cb4bea148&scope.project.id=f128fd7325234b3cb827fa90df7b8a31&role.id=5c9f98a938a74f35857ce032dd9e06b1 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:37.034536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f7d4e-53be-441a-bdd1-0f3da0c7b894 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:37.035100 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f7d4e-53be-441a-bdd1-0f3da0c7b894 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:37.035100 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f7d4e-53be-441a-bdd1-0f3da0c7b894 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:37.036511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 553/1118] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:37.043253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81698b03-0fdb-439e-ada1-da3ebe1e26cd None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:37.043956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81698b03-0fdb-439e-ada1-da3ebe1e26cd None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:37.044105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81698b03-0fdb-439e-ada1-da3ebe1e26cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:37.066236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-81698b03-0fdb-439e-ada1-da3ebe1e26cd None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:37.067839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-81698b03-0fdb-439e-ada1-da3ebe1e26cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:37.091252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:37.141626 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 566/1119] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:37.164490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f7d4e-53be-441a-bdd1-0f3da0c7b894 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:37.184658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:37.290169 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f7d4e-53be-441a-bdd1-0f3da0c7b894 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:37.336418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b06b23-8ef4-4bfa-9923-9793acc30818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:37.337334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b06b23-8ef4-4bfa-9923-9793acc30818 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:37.337621 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b06b23-8ef4-4bfa-9923-9793acc30818 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:37.337899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b06b23-8ef4-4bfa-9923-9793acc30818 None admin] PATH_INFO: `/v3/roles/5c9f98a938a74f35857ce032dd9e06b1` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:37.339397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b06b23-8ef4-4bfa-9923-9793acc30818 None admin] RBAC: Authorizing `identity:get_role(role_id=5c9f98a938a74f35857ce032dd9e06b1)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:37.340813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b06b23-8ef4-4bfa-9923-9793acc30818 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:37.342311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 554/1120] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:08:37 2022] GET /identity/v3/roles/5c9f98a938a74f35857ce032dd9e06b1 => generated 223 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:37.348554 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81698b03-0fdb-439e-ada1-da3ebe1e26cd None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:37.454294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81698b03-0fdb-439e-ada1-da3ebe1e26cd None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:37.493371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71156d-7367-456a-832b-7008ea6aca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:37.494685 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71156d-7367-456a-832b-7008ea6aca9c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:37.495064 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71156d-7367-456a-832b-7008ea6aca9c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:37.495435 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71156d-7367-456a-832b-7008ea6aca9c None admin] PATH_INFO: `/v3/users/2aed97772ee14c6884bec77cb4bea148` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:37.497640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71156d-7367-456a-832b-7008ea6aca9c None admin] RBAC: Authorizing `identity:get_user(user_id=2aed97772ee14c6884bec77cb4bea148)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:37.499794 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71156d-7367-456a-832b-7008ea6aca9c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:37.502430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 567/1121] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:08:37 2022] GET /identity/v3/users/2aed97772ee14c6884bec77cb4bea148 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:37.509465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b06b23-8ef4-4bfa-9923-9793acc30818 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:37.604600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:37.621376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b06b23-8ef4-4bfa-9923-9793acc30818 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:37.657478 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238ddb2-7465-4ecc-b0db-9cc3d1471c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:37.658358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238ddb2-7465-4ecc-b0db-9cc3d1471c20 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:37.658637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238ddb2-7465-4ecc-b0db-9cc3d1471c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:37.658913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238ddb2-7465-4ecc-b0db-9cc3d1471c20 None admin] PATH_INFO: `/v3/projects/f128fd7325234b3cb827fa90df7b8a31` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:37.660116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238ddb2-7465-4ecc-b0db-9cc3d1471c20 None admin] RBAC: Authorizing `identity:get_project(project_id=f128fd7325234b3cb827fa90df7b8a31)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:37.661599 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238ddb2-7465-4ecc-b0db-9cc3d1471c20 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:37.663422 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 555/1122] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:08:37 2022] GET /identity/v3/projects/f128fd7325234b3cb827fa90df7b8a31 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:37.669683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71156d-7367-456a-832b-7008ea6aca9c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:37.697300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:37.778560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71156d-7367-456a-832b-7008ea6aca9c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:37.823299 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386e745-5eac-4989-97a9-8f7e7ef185ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:37.824194 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386e745-5eac-4989-97a9-8f7e7ef185ca None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:37.824478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386e745-5eac-4989-97a9-8f7e7ef185ca None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:37.824757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386e745-5eac-4989-97a9-8f7e7ef185ca None admin] PATH_INFO: `/v3/projects/f128fd7325234b3cb827fa90df7b8a31/users/2aed97772ee14c6884bec77cb4bea148/roles/5c9f98a938a74f35857ce032dd9e06b1` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:37.827318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386e745-5eac-4989-97a9-8f7e7ef185ca None admin] RBAC: Authorizing `identity:create_grant(project_id=f128fd7325234b3cb827fa90df7b8a31, user_id=2aed97772ee14c6884bec77cb4bea148, role_id=5c9f98a938a74f35857ce032dd9e06b1)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:37.828767 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386e745-5eac-4989-97a9-8f7e7ef185ca None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:37.848611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 568/1123] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:08:37 2022] PUT /identity/v3/projects/f128fd7325234b3cb827fa90df7b8a31/users/2aed97772ee14c6884bec77cb4bea148/roles/5c9f98a938a74f35857ce032dd9e06b1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:08:39.847796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d0805-715e-4765-a785-1dddf778bb2a None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:39.848355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d0805-715e-4765-a785-1dddf778bb2a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:39.848355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d0805-715e-4765-a785-1dddf778bb2a None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:39.849940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 556/1124] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:39.859262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab000d-de02-47f4-823c-585f54c3257e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:39.859995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab000d-de02-47f4-823c-585f54c3257e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:39.860193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab000d-de02-47f4-823c-585f54c3257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:39.885888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-0aab000d-de02-47f4-823c-585f54c3257e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:39.887084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0aab000d-de02-47f4-823c-585f54c3257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:39.960155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 569/1125] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:39.984077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d0805-715e-4765-a785-1dddf778bb2a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:40.095208 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d0805-715e-4765-a785-1dddf778bb2a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:40.132450 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571386e-16b3-405a-85e1-705278c7abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:40.133210 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571386e-16b3-405a-85e1-705278c7abfa None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:40.133526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571386e-16b3-405a-85e1-705278c7abfa None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:40.133801 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571386e-16b3-405a-85e1-705278c7abfa None admin] PATH_INFO: `/v3/roles/5c9f98a938a74f35857ce032dd9e06b1` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:40.135272 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571386e-16b3-405a-85e1-705278c7abfa None admin] RBAC: Authorizing `identity:get_role(role_id=5c9f98a938a74f35857ce032dd9e06b1)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:40.136646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571386e-16b3-405a-85e1-705278c7abfa None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:40.138070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 557/1126] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:08:39 2022] GET /identity/v3/roles/5c9f98a938a74f35857ce032dd9e06b1 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:40.145240 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab000d-de02-47f4-823c-585f54c3257e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:40.165041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:40.255984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab000d-de02-47f4-823c-585f54c3257e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:40.293326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba166e1-5ae3-4410-a7bc-2b8d19dc69f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:40.294146 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba166e1-5ae3-4410-a7bc-2b8d19dc69f5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:40.294431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba166e1-5ae3-4410-a7bc-2b8d19dc69f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:40.294707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba166e1-5ae3-4410-a7bc-2b8d19dc69f5 None admin] PATH_INFO: `/v3/users/2aed97772ee14c6884bec77cb4bea148` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:40.296010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba166e1-5ae3-4410-a7bc-2b8d19dc69f5 None admin] RBAC: Authorizing `identity:get_user(user_id=2aed97772ee14c6884bec77cb4bea148)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:40.297490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba166e1-5ae3-4410-a7bc-2b8d19dc69f5 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:40.299192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 570/1127] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:08:40 2022] GET /identity/v3/users/2aed97772ee14c6884bec77cb4bea148 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:40.305715 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571386e-16b3-405a-85e1-705278c7abfa None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:40.332109 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:40.417008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571386e-16b3-405a-85e1-705278c7abfa None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:40.455146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587d204-6192-4671-8ff5-bc3b50a1703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:40.455810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587d204-6192-4671-8ff5-bc3b50a1703d None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:40.456099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587d204-6192-4671-8ff5-bc3b50a1703d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:40.456378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587d204-6192-4671-8ff5-bc3b50a1703d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:40.528332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587d204-6192-4671-8ff5-bc3b50a1703d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:40.529843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587d204-6192-4671-8ff5-bc3b50a1703d None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:40.553946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:40.635337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 558/1128] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:08:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:08:40.641787 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba166e1-5ae3-4410-a7bc-2b8d19dc69f5 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:40.735635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:40.758475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba166e1-5ae3-4410-a7bc-2b8d19dc69f5 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:40.801306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c1d34-428b-49d6-bd89-e6a105506e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:40.802188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c1d34-428b-49d6-bd89-e6a105506e60 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:40.802481 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c1d34-428b-49d6-bd89-e6a105506e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:40.802747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c1d34-428b-49d6-bd89-e6a105506e60 None admin] PATH_INFO: `/v3/projects/f128fd7325234b3cb827fa90df7b8a31` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:40.804010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c1d34-428b-49d6-bd89-e6a105506e60 None admin] RBAC: Authorizing `identity:get_project(project_id=f128fd7325234b3cb827fa90df7b8a31)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:40.805487 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c1d34-428b-49d6-bd89-e6a105506e60 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:40.807267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 571/1129] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:08:40 2022] GET /identity/v3/projects/f128fd7325234b3cb827fa90df7b8a31 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:40.814276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587d204-6192-4671-8ff5-bc3b50a1703d None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:40.926617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587d204-6192-4671-8ff5-bc3b50a1703d None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:40.954349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:40.967402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb2eb4-8bb0-4bd2-b42e-912169715de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:40.968067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb2eb4-8bb0-4bd2-b42e-912169715de4 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:40.968348 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb2eb4-8bb0-4bd2-b42e-912169715de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:40.968612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb2eb4-8bb0-4bd2-b42e-912169715de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:40.969464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb2eb4-8bb0-4bd2-b42e-912169715de4 None admin] RBAC: Adding query filter params (role.id=5c9f98a938a74f35857ce032dd9e06b1, scope.project.id=f128fd7325234b3cb827fa90df7b8a31, user.id=2aed97772ee14c6884bec77cb4bea148) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:40.969782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb2eb4-8bb0-4bd2-b42e-912169715de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:40.971232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb2eb4-8bb0-4bd2-b42e-912169715de4 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:40.977393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 559/1130] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:08:40 2022] GET /identity/v3/role_assignments?user.id=2aed97772ee14c6884bec77cb4bea148&scope.project.id=f128fd7325234b3cb827fa90df7b8a31&role.id=5c9f98a938a74f35857ce032dd9e06b1 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:43.025661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18314e58-054f-475e-a01a-5eafb518673e None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:43.026509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18314e58-054f-475e-a01a-5eafb518673e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:43.026509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18314e58-054f-475e-a01a-5eafb518673e None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:43.028734 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 572/1131] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:43.037581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20731a0-06e9-4bd8-b476-ac44553bb107 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:43.038236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20731a0-06e9-4bd8-b476-ac44553bb107 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:43.038437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20731a0-06e9-4bd8-b476-ac44553bb107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:43.061258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a20731a0-06e9-4bd8-b476-ac44553bb107 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:43.062487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a20731a0-06e9-4bd8-b476-ac44553bb107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:43.133851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 560/1132] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:43.158386 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18314e58-054f-475e-a01a-5eafb518673e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:43.276135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18314e58-054f-475e-a01a-5eafb518673e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:43.310822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a638ef-f20d-4b39-b30b-aaf601edcb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:43.311625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a638ef-f20d-4b39-b30b-aaf601edcb69 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:43.311911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a638ef-f20d-4b39-b30b-aaf601edcb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:43.312183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a638ef-f20d-4b39-b30b-aaf601edcb69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:43.313616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a638ef-f20d-4b39-b30b-aaf601edcb69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:43.315067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a638ef-f20d-4b39-b30b-aaf601edcb69 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:43.317091 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 573/1133] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:43.323458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20731a0-06e9-4bd8-b476-ac44553bb107 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:43.442000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20731a0-06e9-4bd8-b476-ac44553bb107 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:43.459377 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:43.479569 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5033966-1d0d-47a2-af76-b490f552b09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:43.480239 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5033966-1d0d-47a2-af76-b490f552b09f None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:43.480523 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5033966-1d0d-47a2-af76-b490f552b09f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:43.480802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5033966-1d0d-47a2-af76-b490f552b09f None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:43.481556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5033966-1d0d-47a2-af76-b490f552b09f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:43.483005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5033966-1d0d-47a2-af76-b490f552b09f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:43.512391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 561/1134] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:08:43 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:08:45.619935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bbb6d-1e5e-451e-8f59-950ec1573988 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:45.620498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bbb6d-1e5e-451e-8f59-950ec1573988 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:45.620591 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bbb6d-1e5e-451e-8f59-950ec1573988 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:45.622403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 574/1135] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:45.629504 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cd766-2b3d-4802-8ffc-75e5de660709 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:45.630086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cd766-2b3d-4802-8ffc-75e5de660709 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:45.630086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cd766-2b3d-4802-8ffc-75e5de660709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:45.648395 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-800cd766-2b3d-4802-8ffc-75e5de660709 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:45.649647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-800cd766-2b3d-4802-8ffc-75e5de660709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:45.722719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 562/1136] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:08:45.748075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bbb6d-1e5e-451e-8f59-950ec1573988 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:45.782240 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:45.912608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bbb6d-1e5e-451e-8f59-950ec1573988 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:45.959033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab93871-4026-44c7-a74e-4fd27b7a967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:45.959902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab93871-4026-44c7-a74e-4fd27b7a967e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:45.960269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab93871-4026-44c7-a74e-4fd27b7a967e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:45.960648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab93871-4026-44c7-a74e-4fd27b7a967e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:45.962128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab93871-4026-44c7-a74e-4fd27b7a967e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:45.963814 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab93871-4026-44c7-a74e-4fd27b7a967e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:45.965987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 575/1137] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:08:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:45.972201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cd766-2b3d-4802-8ffc-75e5de660709 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:46.076287 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:46.082228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cd766-2b3d-4802-8ffc-75e5de660709 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:46.122915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf6b72-48cb-47e5-9e2a-c63c40a191c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:46.124489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf6b72-48cb-47e5-9e2a-c63c40a191c9 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:46.124781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf6b72-48cb-47e5-9e2a-c63c40a191c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:46.127707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf6b72-48cb-47e5-9e2a-c63c40a191c9 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:46.128859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf6b72-48cb-47e5-9e2a-c63c40a191c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:46.130460 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf6b72-48cb-47e5-9e2a-c63c40a191c9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:46.154806 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 563/1138] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:08:45 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:08:48.258316 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02504010-2eda-43a8-a648-39be7d9eb460 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:48.258941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02504010-2eda-43a8-a648-39be7d9eb460 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:48.258941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02504010-2eda-43a8-a648-39be7d9eb460 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:48.260311 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 576/1139] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:48.267065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68f0af-d78a-47e1-b82b-570b8d4a36b2 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:48.267594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68f0af-d78a-47e1-b82b-570b8d4a36b2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:48.267594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68f0af-d78a-47e1-b82b-570b8d4a36b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:48.290181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-bf68f0af-d78a-47e1-b82b-570b8d4a36b2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:48.291399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-bf68f0af-d78a-47e1-b82b-570b8d4a36b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:48.361787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 564/1140] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:48.395309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02504010-2eda-43a8-a648-39be7d9eb460 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:48.486714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:48.504413 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02504010-2eda-43a8-a648-39be7d9eb460 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:48.540668 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0473e-29d5-45f7-8b8f-f9d15a596fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:48.541508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0473e-29d5-45f7-8b8f-f9d15a596fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:48.542324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0473e-29d5-45f7-8b8f-f9d15a596fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:48.542324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0473e-29d5-45f7-8b8f-f9d15a596fd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:48.553001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0473e-29d5-45f7-8b8f-f9d15a596fd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-deb0473e-29d5-45f7-8b8f-f9d15a596fd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:08:48.560702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:48.561994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:48.563159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:48.563159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:48.563159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:48.563159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:48.563159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:08:48.563159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:08:48.563159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:08:48.563159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:08:48.563159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:08:48.563159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:08:48.563159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:08:48.563159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:48.565488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 577/1141] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:08:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:48.569204 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68f0af-d78a-47e1-b82b-570b8d4a36b2 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:48.675087 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:48.697398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68f0af-d78a-47e1-b82b-570b8d4a36b2 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:48.734735 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051f6e8-6f4c-4768-8d8b-a3e125c45413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:48.735441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051f6e8-6f4c-4768-8d8b-a3e125c45413 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:48.735727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051f6e8-6f4c-4768-8d8b-a3e125c45413 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:48.736004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051f6e8-6f4c-4768-8d8b-a3e125c45413 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:48.736785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051f6e8-6f4c-4768-8d8b-a3e125c45413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:48.737092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051f6e8-6f4c-4768-8d8b-a3e125c45413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:48.738539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051f6e8-6f4c-4768-8d8b-a3e125c45413 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:48.748155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 565/1142] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:08:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:48.755099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0473e-29d5-45f7-8b8f-f9d15a596fd5 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:48.863551 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0473e-29d5-45f7-8b8f-f9d15a596fd5 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:48.900526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46ca1a-a4ed-4fa6-91e6-e3fd66940f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:48.901533 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46ca1a-a4ed-4fa6-91e6-e3fd66940f38 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:48.901816 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46ca1a-a4ed-4fa6-91e6-e3fd66940f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:48.902090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46ca1a-a4ed-4fa6-91e6-e3fd66940f38 None admin] PATH_INFO: `/v3/users/be701c9c88be466e83bfb422abc95141` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:48.916568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46ca1a-a4ed-4fa6-91e6-e3fd66940f38 None admin] RBAC: Authorizing `identity:get_user(user_id=be701c9c88be466e83bfb422abc95141)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:48.918066 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46ca1a-a4ed-4fa6-91e6-e3fd66940f38 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:48.919870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 578/1143] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:08:48 2022] GET /identity/v3/users/be701c9c88be466e83bfb422abc95141 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:48.927206 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051f6e8-6f4c-4768-8d8b-a3e125c45413 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:49.034490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051f6e8-6f4c-4768-8d8b-a3e125c45413 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:49.070407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753ea4b-ee46-489e-939d-5ecb6ec0f48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:49.071692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753ea4b-ee46-489e-939d-5ecb6ec0f48a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:49.071692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753ea4b-ee46-489e-939d-5ecb6ec0f48a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:49.071692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753ea4b-ee46-489e-939d-5ecb6ec0f48a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:49.088195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:49.150536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753ea4b-ee46-489e-939d-5ecb6ec0f48a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:49.151935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753ea4b-ee46-489e-939d-5ecb6ec0f48a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:49.254775 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 566/1144] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:08:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:08:49.263500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46ca1a-a4ed-4fa6-91e6-e3fd66940f38 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:49.267592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:49.388072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46ca1a-a4ed-4fa6-91e6-e3fd66940f38 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:49.426009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5136211-4534-4205-bb68-55dd4887a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:49.426893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5136211-4534-4205-bb68-55dd4887a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:49.427174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5136211-4534-4205-bb68-55dd4887a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:49.427493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5136211-4534-4205-bb68-55dd4887a5f6 None admin] PATH_INFO: `/v3/projects/e440b5407d7c4fea922cdf7b19a8adad` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:49.428729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5136211-4534-4205-bb68-55dd4887a5f6 None admin] RBAC: Authorizing `identity:get_project(project_id=e440b5407d7c4fea922cdf7b19a8adad)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:49.430241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5136211-4534-4205-bb68-55dd4887a5f6 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:49.432054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 579/1145] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:08:49 2022] GET /identity/v3/projects/e440b5407d7c4fea922cdf7b19a8adad => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:49.438509 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753ea4b-ee46-489e-939d-5ecb6ec0f48a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:49.492389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:49.549850 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753ea4b-ee46-489e-939d-5ecb6ec0f48a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:49.590704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db16f6-2cea-42b9-916e-9746d6cee571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:49.591361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db16f6-2cea-42b9-916e-9746d6cee571 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:49.591637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db16f6-2cea-42b9-916e-9746d6cee571 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:49.591909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db16f6-2cea-42b9-916e-9746d6cee571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:49.592742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db16f6-2cea-42b9-916e-9746d6cee571 None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=e440b5407d7c4fea922cdf7b19a8adad, user.id=be701c9c88be466e83bfb422abc95141) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:49.593045 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db16f6-2cea-42b9-916e-9746d6cee571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:49.594519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db16f6-2cea-42b9-916e-9746d6cee571 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:49.600779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 567/1146] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:08:49 2022] GET /identity/v3/role_assignments?user.id=be701c9c88be466e83bfb422abc95141&scope.project.id=e440b5407d7c4fea922cdf7b19a8adad&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:51.627363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270419c-37c8-4957-ab94-c2f23f7094f1 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:51.627945 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270419c-37c8-4957-ab94-c2f23f7094f1 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:51.627945 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270419c-37c8-4957-ab94-c2f23f7094f1 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:51.629364 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 580/1147] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:08:51.635710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cab3e-7b2e-4627-9dc6-fb99fad316fa None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:51.636409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cab3e-7b2e-4627-9dc6-fb99fad316fa None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:51.636585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cab3e-7b2e-4627-9dc6-fb99fad316fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:51.663563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-cb7cab3e-7b2e-4627-9dc6-fb99fad316fa None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:51.664694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cb7cab3e-7b2e-4627-9dc6-fb99fad316fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:51.735663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 568/1148] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:51.766128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270419c-37c8-4957-ab94-c2f23f7094f1 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:51.842115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:51.877463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270419c-37c8-4957-ab94-c2f23f7094f1 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:51.914942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee00df0-ffa2-4cc6-8255-029747389d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:51.915656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00df0-ffa2-4cc6-8255-029747389d3e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:51.915938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00df0-ffa2-4cc6-8255-029747389d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:51.916203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00df0-ffa2-4cc6-8255-029747389d3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:51.927625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee00df0-ffa2-4cc6-8255-029747389d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-0ee00df0-ffa2-4cc6-8255-029747389d3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:08:51.935164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:51.936179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:51.937152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:51.937152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:51.937152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:51.937152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:51.937152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:08:51.937152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:08:51.937152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:08:51.937152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:08:51.937152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:08:51.937152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:08:51.937152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:08:51.937152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:51.941703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 581/1149] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:08:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:51.943108 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cab3e-7b2e-4627-9dc6-fb99fad316fa None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:51.995846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:52.059088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cab3e-7b2e-4627-9dc6-fb99fad316fa None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:52.099371 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d1ade-2439-4100-8a8c-802a45e25992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:52.100036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d1ade-2439-4100-8a8c-802a45e25992 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:52.100323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d1ade-2439-4100-8a8c-802a45e25992 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:52.100602 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d1ade-2439-4100-8a8c-802a45e25992 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:52.101379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d1ade-2439-4100-8a8c-802a45e25992 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:52.101690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d1ade-2439-4100-8a8c-802a45e25992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:52.103072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d1ade-2439-4100-8a8c-802a45e25992 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:52.112147 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 569/1150] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:08:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:52.119075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee00df0-ffa2-4cc6-8255-029747389d3e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:52.233452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee00df0-ffa2-4cc6-8255-029747389d3e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:52.263219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:52.268581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba326ebc-a63d-4c1c-bcab-172ae8dd7c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:52.269534 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba326ebc-a63d-4c1c-bcab-172ae8dd7c04 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:52.269811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba326ebc-a63d-4c1c-bcab-172ae8dd7c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:52.270087 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba326ebc-a63d-4c1c-bcab-172ae8dd7c04 None admin] PATH_INFO: `/v3/users/be701c9c88be466e83bfb422abc95141` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:52.271338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba326ebc-a63d-4c1c-bcab-172ae8dd7c04 None admin] RBAC: Authorizing `identity:get_user(user_id=be701c9c88be466e83bfb422abc95141)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:52.272785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba326ebc-a63d-4c1c-bcab-172ae8dd7c04 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:52.274517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 582/1151] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:08:52 2022] GET /identity/v3/users/be701c9c88be466e83bfb422abc95141 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:52.280546 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d1ade-2439-4100-8a8c-802a45e25992 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:52.392732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d1ade-2439-4100-8a8c-802a45e25992 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:52.394480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:52.433454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266597a-57d7-4bbc-8b18-8af8aad3c135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:52.434339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266597a-57d7-4bbc-8b18-8af8aad3c135 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:52.434616 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266597a-57d7-4bbc-8b18-8af8aad3c135 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:52.434899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266597a-57d7-4bbc-8b18-8af8aad3c135 None admin] PATH_INFO: `/v3/projects/e440b5407d7c4fea922cdf7b19a8adad` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:52.436138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266597a-57d7-4bbc-8b18-8af8aad3c135 None admin] RBAC: Authorizing `identity:get_project(project_id=e440b5407d7c4fea922cdf7b19a8adad)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:52.437656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266597a-57d7-4bbc-8b18-8af8aad3c135 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:52.439422 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 570/1152] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:08:52 2022] GET /identity/v3/projects/e440b5407d7c4fea922cdf7b19a8adad => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:52.446982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba326ebc-a63d-4c1c-bcab-172ae8dd7c04 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:52.576565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba326ebc-a63d-4c1c-bcab-172ae8dd7c04 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:52.612251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bcb96-2758-4ade-affd-86421ae595d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:52.613157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bcb96-2758-4ade-affd-86421ae595d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:52.613467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bcb96-2758-4ade-affd-86421ae595d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:52.613745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bcb96-2758-4ade-affd-86421ae595d2 None admin] PATH_INFO: `/v3/projects/e440b5407d7c4fea922cdf7b19a8adad/users/be701c9c88be466e83bfb422abc95141/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:52.615784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bcb96-2758-4ade-affd-86421ae595d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e440b5407d7c4fea922cdf7b19a8adad, user_id=be701c9c88be466e83bfb422abc95141, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:52.617262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bcb96-2758-4ade-affd-86421ae595d2 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:52.632295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 583/1153] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:08:52 2022] PUT /identity/v3/projects/e440b5407d7c4fea922cdf7b19a8adad/users/be701c9c88be466e83bfb422abc95141/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:08:54.635346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a9bb8-da72-44da-812b-dc5d84e68849 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:54.635910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a9bb8-da72-44da-812b-dc5d84e68849 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:54.635910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a9bb8-da72-44da-812b-dc5d84e68849 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:54.637307 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 571/1154] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:54.643063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e288d-3ed5-48ee-94f0-afcb0dc719eb None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:54.643601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e288d-3ed5-48ee-94f0-afcb0dc719eb None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:54.643693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e288d-3ed5-48ee-94f0-afcb0dc719eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:54.661454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e44e288d-3ed5-48ee-94f0-afcb0dc719eb None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:54.662665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e44e288d-3ed5-48ee-94f0-afcb0dc719eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:54.720568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:54.734094 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 584/1155] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:54.758271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a9bb8-da72-44da-812b-dc5d84e68849 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:54.875129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a9bb8-da72-44da-812b-dc5d84e68849 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:54.912092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f0a09-d605-44db-a66d-6f9a406e1dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:54.913026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f0a09-d605-44db-a66d-6f9a406e1dbc None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:54.913360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f0a09-d605-44db-a66d-6f9a406e1dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:54.913637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f0a09-d605-44db-a66d-6f9a406e1dbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:54.927624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f0a09-d605-44db-a66d-6f9a406e1dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-2a5f0a09-d605-44db-a66d-6f9a406e1dbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:08:54.935420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:54.936601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:08:54.937467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 572/1156] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:08:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:54.944002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e288d-3ed5-48ee-94f0-afcb0dc719eb None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:55.048177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e288d-3ed5-48ee-94f0-afcb0dc719eb None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:55.089287 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9a7f1-6b3b-4444-9165-9f6d2ed1dae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:55.089977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9a7f1-6b3b-4444-9165-9f6d2ed1dae7 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:55.090248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9a7f1-6b3b-4444-9165-9f6d2ed1dae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:55.090522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9a7f1-6b3b-4444-9165-9f6d2ed1dae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:55.091564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9a7f1-6b3b-4444-9165-9f6d2ed1dae7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:55.091867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9a7f1-6b3b-4444-9165-9f6d2ed1dae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:55.093252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9a7f1-6b3b-4444-9165-9f6d2ed1dae7 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:55.103581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 585/1157] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:08:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:55.111893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f0a09-d605-44db-a66d-6f9a406e1dbc None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:55.148095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:55.232320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f0a09-d605-44db-a66d-6f9a406e1dbc None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:55.271707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d141-c91c-4fc7-90d1-365b8b0279de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:55.272552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d141-c91c-4fc7-90d1-365b8b0279de None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:55.272831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d141-c91c-4fc7-90d1-365b8b0279de None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:55.273103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d141-c91c-4fc7-90d1-365b8b0279de None admin] PATH_INFO: `/v3/users/be701c9c88be466e83bfb422abc95141` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:55.274332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06d141-c91c-4fc7-90d1-365b8b0279de None admin] RBAC: Authorizing `identity:get_user(user_id=be701c9c88be466e83bfb422abc95141)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:55.275768 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06d141-c91c-4fc7-90d1-365b8b0279de None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:55.277438 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 573/1158] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:08:55 2022] GET /identity/v3/users/be701c9c88be466e83bfb422abc95141 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:08:55.284085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9a7f1-6b3b-4444-9165-9f6d2ed1dae7 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:55.347499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:55.403546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9a7f1-6b3b-4444-9165-9f6d2ed1dae7 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:55.443742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ea872-e9b2-4425-8fb5-de18f0fe381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:55.444400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ea872-e9b2-4425-8fb5-de18f0fe381b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:55.444683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ea872-e9b2-4425-8fb5-de18f0fe381b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:55.444956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ea872-e9b2-4425-8fb5-de18f0fe381b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:55.517428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ea872-e9b2-4425-8fb5-de18f0fe381b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:55.518829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ea872-e9b2-4425-8fb5-de18f0fe381b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:55.572537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:55.623210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 586/1159] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:08:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 07 07:08:55.629586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d141-c91c-4fc7-90d1-365b8b0279de None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:55.732363 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:55.736532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d141-c91c-4fc7-90d1-365b8b0279de None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:55.774758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e12494-f477-4ae9-a350-e935e2179d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:55.775677 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e12494-f477-4ae9-a350-e935e2179d7f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:55.775959 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e12494-f477-4ae9-a350-e935e2179d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:55.776297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e12494-f477-4ae9-a350-e935e2179d7f None admin] PATH_INFO: `/v3/projects/e440b5407d7c4fea922cdf7b19a8adad` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:55.777678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e12494-f477-4ae9-a350-e935e2179d7f None admin] RBAC: Authorizing `identity:get_project(project_id=e440b5407d7c4fea922cdf7b19a8adad)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:55.779123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e12494-f477-4ae9-a350-e935e2179d7f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:55.780853 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 574/1160] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:08:55 2022] GET /identity/v3/projects/e440b5407d7c4fea922cdf7b19a8adad => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:55.789877 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ea872-e9b2-4425-8fb5-de18f0fe381b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:55.901767 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ea872-e9b2-4425-8fb5-de18f0fe381b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:55.940820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32901fa-56eb-4c83-8661-02fabf852bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:55.941783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32901fa-56eb-4c83-8661-02fabf852bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:55.942062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32901fa-56eb-4c83-8661-02fabf852bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:55.942366 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32901fa-56eb-4c83-8661-02fabf852bd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:55.943203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32901fa-56eb-4c83-8661-02fabf852bd9 None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=e440b5407d7c4fea922cdf7b19a8adad, user.id=be701c9c88be466e83bfb422abc95141) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:55.943540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32901fa-56eb-4c83-8661-02fabf852bd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:55.944990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32901fa-56eb-4c83-8661-02fabf852bd9 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:55.951417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 587/1161] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:08:55 2022] GET /identity/v3/role_assignments?user.id=be701c9c88be466e83bfb422abc95141&scope.project.id=e440b5407d7c4fea922cdf7b19a8adad&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:08:57.990426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf123b2-6cd3-4632-b49b-15609270fdd6 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:57.991024 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf123b2-6cd3-4632-b49b-15609270fdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:57.991024 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf123b2-6cd3-4632-b49b-15609270fdd6 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:57.992389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 575/1162] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:08:57.998597 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad39b78-6b7c-4eea-9f26-0ea343dc3715 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:57.999054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad39b78-6b7c-4eea-9f26-0ea343dc3715 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:57.999142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad39b78-6b7c-4eea-9f26-0ea343dc3715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:58.024148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-dad39b78-6b7c-4eea-9f26-0ea343dc3715 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:08:58.025403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-dad39b78-6b7c-4eea-9f26-0ea343dc3715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:08:58.037152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:58.097564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 588/1163] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:08:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:08:58.127258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf123b2-6cd3-4632-b49b-15609270fdd6 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:58.242332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf123b2-6cd3-4632-b49b-15609270fdd6 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:58.278199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c229-6414-4684-bbb6-df7dc7002240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:58.278848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c229-6414-4684-bbb6-df7dc7002240 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:58.279122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c229-6414-4684-bbb6-df7dc7002240 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:58.279390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c229-6414-4684-bbb6-df7dc7002240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:58.314083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:58.354804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63c229-6414-4684-bbb6-df7dc7002240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:58.356261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63c229-6414-4684-bbb6-df7dc7002240 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:58.468614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 576/1164] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:08:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:08:58.475280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad39b78-6b7c-4eea-9f26-0ea343dc3715 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:58.585063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad39b78-6b7c-4eea-9f26-0ea343dc3715 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:58.623369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5068a-e052-4556-982b-7d54791d16dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:58.624172 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5068a-e052-4556-982b-7d54791d16dd None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:58.624451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5068a-e052-4556-982b-7d54791d16dd None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:58.624726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5068a-e052-4556-982b-7d54791d16dd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:58.632208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5068a-e052-4556-982b-7d54791d16dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:58.633703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5068a-e052-4556-982b-7d54791d16dd None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-b3f5068a-e052-4556-982b-7d54791d16dd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:08:58.648869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:08:58.650227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:08:58.651093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 589/1165] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Jul 7 07:08:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:08:58.656420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c229-6414-4684-bbb6-df7dc7002240 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:08:58.729820 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:08:58.768209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c229-6414-4684-bbb6-df7dc7002240 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:08:58.803321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94171c3e-cdf3-43d1-8114-81efb407d8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:08:58.803964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171c3e-cdf3-43d1-8114-81efb407d8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:08:58.804263 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171c3e-cdf3-43d1-8114-81efb407d8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:08:58.804522 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171c3e-cdf3-43d1-8114-81efb407d8b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:08:58.805263 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94171c3e-cdf3-43d1-8114-81efb407d8b5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:08:58.805569 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94171c3e-cdf3-43d1-8114-81efb407d8b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:08:58.806938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94171c3e-cdf3-43d1-8114-81efb407d8b5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:08:58.814489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 577/1166] 10.222.0.62 () {56 vars in 1115 bytes} [Thu Jul 7 07:08:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:00.837175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4823c5-c6bf-4c77-9cd8-1597a32f48dc None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:00.838151 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4823c5-c6bf-4c77-9cd8-1597a32f48dc None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:00.838151 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4823c5-c6bf-4c77-9cd8-1597a32f48dc None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:00.841294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 590/1167] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:09:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:09:00.849075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeecc9-bb26-4e84-965f-aaff8302e379 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:00.849665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeecc9-bb26-4e84-965f-aaff8302e379 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:00.849918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeecc9-bb26-4e84-965f-aaff8302e379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:00.870640 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-2feeecc9-bb26-4e84-965f-aaff8302e379 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:09:00.871844 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-2feeecc9-bb26-4e84-965f-aaff8302e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:09:00.951148 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 578/1168] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:09:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:09:00.974416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4823c5-c6bf-4c77-9cd8-1597a32f48dc None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:00.984180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:01.080692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4823c5-c6bf-4c77-9cd8-1597a32f48dc None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:01.117331 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e76279-e3c2-4af1-a8b4-8163d3eca71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:01.117944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e76279-e3c2-4af1-a8b4-8163d3eca71d None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:01.118225 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e76279-e3c2-4af1-a8b4-8163d3eca71d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:01.118504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e76279-e3c2-4af1-a8b4-8163d3eca71d None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:01.119251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e76279-e3c2-4af1-a8b4-8163d3eca71d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:01.120628 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e76279-e3c2-4af1-a8b4-8163d3eca71d None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:01.138416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 591/1169] 10.222.0.62 () {60 vars in 1138 bytes} [Thu Jul 7 07:09:00 2022] POST /identity/v3/domains => generated 267 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:09:03.192274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1252fb-3722-44fe-8de9-170f1a546a6e None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:03.193157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1252fb-3722-44fe-8de9-170f1a546a6e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:03.193395 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1252fb-3722-44fe-8de9-170f1a546a6e None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:03.195543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 579/1170] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:09:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:09:03.204243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16deb7-98e9-436d-9df8-4fd227765ff6 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:03.204991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16deb7-98e9-436d-9df8-4fd227765ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:03.205121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16deb7-98e9-436d-9df8-4fd227765ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:03.223810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-2c16deb7-98e9-436d-9df8-4fd227765ff6 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:09:03.225025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2c16deb7-98e9-436d-9df8-4fd227765ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:09:03.288348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:03.297086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 592/1171] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:09:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:09:03.321645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1252fb-3722-44fe-8de9-170f1a546a6e None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:03.386237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:03.432469 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1252fb-3722-44fe-8de9-170f1a546a6e None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:03.466532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4dc35-4491-435b-8d65-2e3f46d4bf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:03.467324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4dc35-4491-435b-8d65-2e3f46d4bf50 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:03.467607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4dc35-4491-435b-8d65-2e3f46d4bf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:03.467882 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4dc35-4491-435b-8d65-2e3f46d4bf50 None admin] PATH_INFO: `/v3/domains/e72fcbc78c394f2992ec15f6cbe539c9` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:03.479004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4dc35-4491-435b-8d65-2e3f46d4bf50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e72fcbc78c394f2992ec15f6cbe539c9)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:03.480455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4dc35-4491-435b-8d65-2e3f46d4bf50 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:03.482169 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 580/1172] 10.222.0.62 () {56 vars in 1183 bytes} [Thu Jul 7 07:09:03 2022] GET /identity/v3/domains/e72fcbc78c394f2992ec15f6cbe539c9 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:03.491301 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16deb7-98e9-436d-9df8-4fd227765ff6 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:03.608042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16deb7-98e9-436d-9df8-4fd227765ff6 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:03.646323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3950049-06bf-41d2-98c9-3856928828ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:03.647013 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3950049-06bf-41d2-98c9-3856928828ac None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:03.647288 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3950049-06bf-41d2-98c9-3856928828ac None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:03.647559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3950049-06bf-41d2-98c9-3856928828ac None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:03.648260 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3950049-06bf-41d2-98c9-3856928828ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:03.649756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3950049-06bf-41d2-98c9-3856928828ac None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:03.678469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 593/1173] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:09:03 2022] POST /identity/v3/projects => generated 361 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:09:05.697378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214397c-183b-41ab-b762-ba199fa40b6a None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:05.697912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214397c-183b-41ab-b762-ba199fa40b6a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:05.697912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214397c-183b-41ab-b762-ba199fa40b6a None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:05.699133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 581/1174] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:09:05.705370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847f3c8-59a2-4dad-adf2-e2ec36802b1e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:05.706095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847f3c8-59a2-4dad-adf2-e2ec36802b1e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:05.706251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847f3c8-59a2-4dad-adf2-e2ec36802b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:05.726808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e847f3c8-59a2-4dad-adf2-e2ec36802b1e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:09:05.728009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e847f3c8-59a2-4dad-adf2-e2ec36802b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:09:05.779516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:05.806474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 594/1175] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:09:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:09:05.831552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214397c-183b-41ab-b762-ba199fa40b6a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:05.937987 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214397c-183b-41ab-b762-ba199fa40b6a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:05.958434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:05.976483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52f52d-a30e-4a43-b3d5-68f1dbf0a704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:05.977370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52f52d-a30e-4a43-b3d5-68f1dbf0a704 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:05.977651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52f52d-a30e-4a43-b3d5-68f1dbf0a704 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:05.977920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52f52d-a30e-4a43-b3d5-68f1dbf0a704 None admin] PATH_INFO: `/v3/domains/e72fcbc78c394f2992ec15f6cbe539c9` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:05.979135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52f52d-a30e-4a43-b3d5-68f1dbf0a704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e72fcbc78c394f2992ec15f6cbe539c9)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:05.980567 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52f52d-a30e-4a43-b3d5-68f1dbf0a704 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:05.982213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 582/1176] 10.222.0.62 () {56 vars in 1183 bytes} [Thu Jul 7 07:09:05 2022] GET /identity/v3/domains/e72fcbc78c394f2992ec15f6cbe539c9 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:05.988165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847f3c8-59a2-4dad-adf2-e2ec36802b1e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:06.094567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847f3c8-59a2-4dad-adf2-e2ec36802b1e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:06.132069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd696e9e-7fc2-4790-a818-28e2acfd9401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:06.132731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd696e9e-7fc2-4790-a818-28e2acfd9401 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:06.133010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd696e9e-7fc2-4790-a818-28e2acfd9401 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:06.133334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd696e9e-7fc2-4790-a818-28e2acfd9401 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:06.134037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd696e9e-7fc2-4790-a818-28e2acfd9401 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:06.135483 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd696e9e-7fc2-4790-a818-28e2acfd9401 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:06.157578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 595/1177] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:09:05 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:09:08.250471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480d50d-a666-49c3-a298-e010b5eea6ff None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:08.251379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480d50d-a666-49c3-a298-e010b5eea6ff None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:08.251379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480d50d-a666-49c3-a298-e010b5eea6ff None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:08.253645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 583/1178] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:09:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:09:08.260001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79ea9d-8163-4525-944a-72981b2acb2a None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:08.260394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79ea9d-8163-4525-944a-72981b2acb2a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:08.260561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79ea9d-8163-4525-944a-72981b2acb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:08.280068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ef79ea9d-8163-4525-944a-72981b2acb2a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:09:08.281354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ef79ea9d-8163-4525-944a-72981b2acb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:09:08.312605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:08.358225 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 596/1179] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:09:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:09:08.381948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480d50d-a666-49c3-a298-e010b5eea6ff None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:08.491478 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480d50d-a666-49c3-a298-e010b5eea6ff None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:08.527189 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d38903-627d-4b28-bfb8-4b6a9440329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:08.527906 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d38903-627d-4b28-bfb8-4b6a9440329c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:08.528186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d38903-627d-4b28-bfb8-4b6a9440329c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:08.528455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d38903-627d-4b28-bfb8-4b6a9440329c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:08.539688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d38903-627d-4b28-bfb8-4b6a9440329c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-a0d38903-627d-4b28-bfb8-4b6a9440329c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:09:08.547596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:09:08.548732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:09:08.549880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 584/1180] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:09:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:09:08.555486 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79ea9d-8163-4525-944a-72981b2acb2a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:08.655565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79ea9d-8163-4525-944a-72981b2acb2a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:08.691968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cfc9a-64db-4def-9516-3623490dee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:08.692644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cfc9a-64db-4def-9516-3623490dee9b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:08.692924 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cfc9a-64db-4def-9516-3623490dee9b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:08.693198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cfc9a-64db-4def-9516-3623490dee9b None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:08.693983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cfc9a-64db-4def-9516-3623490dee9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:09:08.694295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cfc9a-64db-4def-9516-3623490dee9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:08.695699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cfc9a-64db-4def-9516-3623490dee9b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:08.704856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 597/1181] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:09:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:08.711137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d38903-627d-4b28-bfb8-4b6a9440329c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:08.763771 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:08.820025 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d38903-627d-4b28-bfb8-4b6a9440329c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:08.858904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ec267-da1d-43dd-b9d7-b222f87043c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:08.859797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ec267-da1d-43dd-b9d7-b222f87043c7 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:08.860077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ec267-da1d-43dd-b9d7-b222f87043c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:08.860356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ec267-da1d-43dd-b9d7-b222f87043c7 None admin] PATH_INFO: `/v3/users/85813fc4c6df4d74ba4989467cf2c728` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:08.875368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ec267-da1d-43dd-b9d7-b222f87043c7 None admin] RBAC: Authorizing `identity:get_user(user_id=85813fc4c6df4d74ba4989467cf2c728)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:08.876855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ec267-da1d-43dd-b9d7-b222f87043c7 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:08.878678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 585/1182] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:09:08 2022] GET /identity/v3/users/85813fc4c6df4d74ba4989467cf2c728 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:08.885129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cfc9a-64db-4def-9516-3623490dee9b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:08.919394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:09.002950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cfc9a-64db-4def-9516-3623490dee9b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:09.038214 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3ed04-0b5b-4a98-9110-3b20b5107d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:09.038904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3ed04-0b5b-4a98-9110-3b20b5107d83 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:09.039183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3ed04-0b5b-4a98-9110-3b20b5107d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:09.039457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3ed04-0b5b-4a98-9110-3b20b5107d83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:09.112545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3ed04-0b5b-4a98-9110-3b20b5107d83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:09.113958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3ed04-0b5b-4a98-9110-3b20b5107d83 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:09.142322 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:09.234522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 598/1183] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:09:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:09:09.240734 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ec267-da1d-43dd-b9d7-b222f87043c7 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:09.352690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ec267-da1d-43dd-b9d7-b222f87043c7 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:09.360938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:09.391494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22a5ca-cb00-4d8f-9f9e-b92d75df67cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:09.392279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22a5ca-cb00-4d8f-9f9e-b92d75df67cd None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:09.392556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22a5ca-cb00-4d8f-9f9e-b92d75df67cd None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:09.392825 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22a5ca-cb00-4d8f-9f9e-b92d75df67cd None admin] PATH_INFO: `/v3/projects/37659155b0ae44c2877156835f3b5d96` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:09.394096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22a5ca-cb00-4d8f-9f9e-b92d75df67cd None admin] RBAC: Authorizing `identity:get_project(project_id=37659155b0ae44c2877156835f3b5d96)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:09.395518 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22a5ca-cb00-4d8f-9f9e-b92d75df67cd None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:09.397364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 586/1184] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:09:09 2022] GET /identity/v3/projects/37659155b0ae44c2877156835f3b5d96 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:09.403603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3ed04-0b5b-4a98-9110-3b20b5107d83 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:09.511931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3ed04-0b5b-4a98-9110-3b20b5107d83 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:09.540165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:09.552678 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9657e73-bb03-4282-93f8-9856c3f3455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:09.553363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9657e73-bb03-4282-93f8-9856c3f3455d None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:09.553651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9657e73-bb03-4282-93f8-9856c3f3455d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:09.553923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9657e73-bb03-4282-93f8-9856c3f3455d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:09.554803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9657e73-bb03-4282-93f8-9856c3f3455d None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=37659155b0ae44c2877156835f3b5d96, user.id=85813fc4c6df4d74ba4989467cf2c728) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:09:09.555124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9657e73-bb03-4282-93f8-9856c3f3455d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:09.556597 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9657e73-bb03-4282-93f8-9856c3f3455d None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:09.562646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 599/1185] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:09:09 2022] GET /identity/v3/role_assignments?user.id=85813fc4c6df4d74ba4989467cf2c728&scope.project.id=37659155b0ae44c2877156835f3b5d96&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:11.574518 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342684e6-b423-46dc-8a19-b67ca6844db8 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:11.575297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342684e6-b423-46dc-8a19-b67ca6844db8 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:11.575297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342684e6-b423-46dc-8a19-b67ca6844db8 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:11.577613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 587/1186] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:09:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:09:11.583885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff272-7c23-408a-986c-fd6a297d7b6e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:11.584303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff272-7c23-408a-986c-fd6a297d7b6e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:11.584408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff272-7c23-408a-986c-fd6a297d7b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:11.601746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c70ff272-7c23-408a-986c-fd6a297d7b6e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:09:11.602970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c70ff272-7c23-408a-986c-fd6a297d7b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:09:11.675755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 600/1187] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:09:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:09:11.712252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342684e6-b423-46dc-8a19-b67ca6844db8 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:11.840169 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342684e6-b423-46dc-8a19-b67ca6844db8 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:11.876106 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfcc17-4bdd-4883-ae64-fa173a442b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:11.876898 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfcc17-4bdd-4883-ae64-fa173a442b2b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:11.877178 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfcc17-4bdd-4883-ae64-fa173a442b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:11.877488 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfcc17-4bdd-4883-ae64-fa173a442b2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:11.888267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfcc17-4bdd-4883-ae64-fa173a442b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-cacfcc17-4bdd-4883-ae64-fa173a442b2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:09:11.895925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:09:11.897066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:09:11.898155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 588/1188] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:09:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:09:11.905896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ff272-7c23-408a-986c-fd6a297d7b6e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:12.015297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ff272-7c23-408a-986c-fd6a297d7b6e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:12.035920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:12.050835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f3ddd-e853-4a26-a380-93c6e9686dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:12.051504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f3ddd-e853-4a26-a380-93c6e9686dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:12.051793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f3ddd-e853-4a26-a380-93c6e9686dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:12.052096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f3ddd-e853-4a26-a380-93c6e9686dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:12.052850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f3ddd-e853-4a26-a380-93c6e9686dd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:09:12.053159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f3ddd-e853-4a26-a380-93c6e9686dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:12.054576 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f3ddd-e853-4a26-a380-93c6e9686dd8 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:12.062818 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 601/1189] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:09:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:12.069931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfcc17-4bdd-4883-ae64-fa173a442b2b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:12.115630 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:12.183152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfcc17-4bdd-4883-ae64-fa173a442b2b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:12.220598 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2f749-ac4e-4535-8048-edac7aff25df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:12.221645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2f749-ac4e-4535-8048-edac7aff25df None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:12.221919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2f749-ac4e-4535-8048-edac7aff25df None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:12.222198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2f749-ac4e-4535-8048-edac7aff25df None admin] PATH_INFO: `/v3/users/85813fc4c6df4d74ba4989467cf2c728` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:12.223533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2f749-ac4e-4535-8048-edac7aff25df None admin] RBAC: Authorizing `identity:get_user(user_id=85813fc4c6df4d74ba4989467cf2c728)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:12.225009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2f749-ac4e-4535-8048-edac7aff25df None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:12.226701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 589/1190] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:09:12 2022] GET /identity/v3/users/85813fc4c6df4d74ba4989467cf2c728 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:12.233475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f3ddd-e853-4a26-a380-93c6e9686dd8 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:12.343959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f3ddd-e853-4a26-a380-93c6e9686dd8 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:12.380381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec4b47-c051-4e05-97e2-880bcbf44609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:12.381270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec4b47-c051-4e05-97e2-880bcbf44609 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:12.381558 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec4b47-c051-4e05-97e2-880bcbf44609 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:12.381841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec4b47-c051-4e05-97e2-880bcbf44609 None admin] PATH_INFO: `/v3/projects/37659155b0ae44c2877156835f3b5d96` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:12.383161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec4b47-c051-4e05-97e2-880bcbf44609 None admin] RBAC: Authorizing `identity:get_project(project_id=37659155b0ae44c2877156835f3b5d96)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:12.384656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec4b47-c051-4e05-97e2-880bcbf44609 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:12.386457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 602/1191] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:09:12 2022] GET /identity/v3/projects/37659155b0ae44c2877156835f3b5d96 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:12.393042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2f749-ac4e-4535-8048-edac7aff25df None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:12.499288 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2f749-ac4e-4535-8048-edac7aff25df None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:12.500885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:12.538576 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807774d3-15a6-45de-9b97-37a40bb07685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:12.539466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807774d3-15a6-45de-9b97-37a40bb07685 None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:12.539747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807774d3-15a6-45de-9b97-37a40bb07685 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:12.540028 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807774d3-15a6-45de-9b97-37a40bb07685 None admin] PATH_INFO: `/v3/projects/37659155b0ae44c2877156835f3b5d96/users/85813fc4c6df4d74ba4989467cf2c728/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:12.542360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807774d3-15a6-45de-9b97-37a40bb07685 None admin] RBAC: Authorizing `identity:create_grant(project_id=37659155b0ae44c2877156835f3b5d96, user_id=85813fc4c6df4d74ba4989467cf2c728, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:12.543886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807774d3-15a6-45de-9b97-37a40bb07685 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:12.559425 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 590/1192] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:09:12 2022] PUT /identity/v3/projects/37659155b0ae44c2877156835f3b5d96/users/85813fc4c6df4d74ba4989467cf2c728/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:09:14.562817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc22c4-d45b-4cde-a21f-51175dfef532 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:14.563686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc22c4-d45b-4cde-a21f-51175dfef532 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:14.563686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc22c4-d45b-4cde-a21f-51175dfef532 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:14.566389 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 603/1193] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:09:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:09:14.575228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc085f-a8e5-4020-9e9e-199ca42aaf69 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:14.575982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc085f-a8e5-4020-9e9e-199ca42aaf69 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:14.576144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc085f-a8e5-4020-9e9e-199ca42aaf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:14.596617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-cbcc085f-a8e5-4020-9e9e-199ca42aaf69 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:09:14.597842 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cbcc085f-a8e5-4020-9e9e-199ca42aaf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:09:14.670011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 591/1194] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:09:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:09:14.694972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc22c4-d45b-4cde-a21f-51175dfef532 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:14.757237 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:14.809736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc22c4-d45b-4cde-a21f-51175dfef532 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:14.856793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1ca73-c633-470e-8c16-699e59070037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:14.857625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1ca73-c633-470e-8c16-699e59070037 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:14.857907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1ca73-c633-470e-8c16-699e59070037 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:14.858184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1ca73-c633-470e-8c16-699e59070037 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:14.869727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1ca73-c633-470e-8c16-699e59070037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-88b1ca73-c633-470e-8c16-699e59070037 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:09:14.877259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:09:14.878318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:09:14.879281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 604/1195] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:09:14.884914 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc085f-a8e5-4020-9e9e-199ca42aaf69 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:14.982799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:14.993182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc085f-a8e5-4020-9e9e-199ca42aaf69 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:15.029386 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b09cf8-4004-4b68-badf-a52543f10e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:15.030041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b09cf8-4004-4b68-badf-a52543f10e46 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:15.030321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b09cf8-4004-4b68-badf-a52543f10e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:15.030588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b09cf8-4004-4b68-badf-a52543f10e46 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:15.031326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b09cf8-4004-4b68-badf-a52543f10e46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:09:15.031626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b09cf8-4004-4b68-badf-a52543f10e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:15.033003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b09cf8-4004-4b68-badf-a52543f10e46 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:15.041415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 592/1196] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:15.050091 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1ca73-c633-470e-8c16-699e59070037 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:15.157161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1ca73-c633-470e-8c16-699e59070037 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:15.170610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:15.206769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d891a-ac31-406a-9e69-6b0bfe7f676e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:15.208588 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d891a-ac31-406a-9e69-6b0bfe7f676e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:15.208588 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d891a-ac31-406a-9e69-6b0bfe7f676e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:15.208588 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d891a-ac31-406a-9e69-6b0bfe7f676e None admin] PATH_INFO: `/v3/users/85813fc4c6df4d74ba4989467cf2c728` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:15.209639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d891a-ac31-406a-9e69-6b0bfe7f676e None admin] RBAC: Authorizing `identity:get_user(user_id=85813fc4c6df4d74ba4989467cf2c728)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:15.211112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d891a-ac31-406a-9e69-6b0bfe7f676e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:15.212805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 605/1197] 10.222.0.62 () {56 vars in 1177 bytes} [Thu Jul 7 07:09:15 2022] GET /identity/v3/users/85813fc4c6df4d74ba4989467cf2c728 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:15.219288 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b09cf8-4004-4b68-badf-a52543f10e46 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:15.328937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b09cf8-4004-4b68-badf-a52543f10e46 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:15.366537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6f0ed-7779-4279-9ead-4a1701fd34e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:15.367186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6f0ed-7779-4279-9ead-4a1701fd34e5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:15.367471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6f0ed-7779-4279-9ead-4a1701fd34e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:15.367741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6f0ed-7779-4279-9ead-4a1701fd34e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:15.392039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:15.438123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6f0ed-7779-4279-9ead-4a1701fd34e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:15.439603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6f0ed-7779-4279-9ead-4a1701fd34e5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:15.544871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 593/1198] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:09:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:09:15.551791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d891a-ac31-406a-9e69-6b0bfe7f676e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:15.655957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d891a-ac31-406a-9e69-6b0bfe7f676e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:15.691555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73393c-14aa-43aa-bf20-8a0f3f707c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:15.692415 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73393c-14aa-43aa-bf20-8a0f3f707c5b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:15.692760 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73393c-14aa-43aa-bf20-8a0f3f707c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:15.693039 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73393c-14aa-43aa-bf20-8a0f3f707c5b None admin] PATH_INFO: `/v3/projects/37659155b0ae44c2877156835f3b5d96` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:15.694499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73393c-14aa-43aa-bf20-8a0f3f707c5b None admin] RBAC: Authorizing `identity:get_project(project_id=37659155b0ae44c2877156835f3b5d96)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:15.695960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73393c-14aa-43aa-bf20-8a0f3f707c5b None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:15.697738 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 606/1199] 10.222.0.62 () {56 vars in 1186 bytes} [Thu Jul 7 07:09:15 2022] GET /identity/v3/projects/37659155b0ae44c2877156835f3b5d96 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:15.707507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6f0ed-7779-4279-9ead-4a1701fd34e5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:09:15.773239 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:15.825074 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6f0ed-7779-4279-9ead-4a1701fd34e5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:09:15.860249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360847e7-0691-4e8c-88e2-6d2fae2627b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:09:15.860899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360847e7-0691-4e8c-88e2-6d2fae2627b0 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:09:15.861181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360847e7-0691-4e8c-88e2-6d2fae2627b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:09:15.861487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360847e7-0691-4e8c-88e2-6d2fae2627b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:09:15.862312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360847e7-0691-4e8c-88e2-6d2fae2627b0 None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=37659155b0ae44c2877156835f3b5d96, user.id=85813fc4c6df4d74ba4989467cf2c728) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:09:15.862616 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360847e7-0691-4e8c-88e2-6d2fae2627b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:09:15.864052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360847e7-0691-4e8c-88e2-6d2fae2627b0 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:09:15.870088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 594/1200] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:09:15 2022] GET /identity/v3/role_assignments?user.id=85813fc4c6df4d74ba4989467cf2c728&scope.project.id=37659155b0ae44c2877156835f3b5d96&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:09:25.686410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=77 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:09:25.867646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=41 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:11.694559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426b59-a2c0-4f1c-9f20-4b09c5986d59 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:11.694559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426b59-a2c0-4f1c-9f20-4b09c5986d59 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:11.694559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426b59-a2c0-4f1c-9f20-4b09c5986d59 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:11.695611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 607/1201] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:10:11.703383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298369b-2f6d-4a75-8c51-d956c0442572 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:11.703917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298369b-2f6d-4a75-8c51-d956c0442572 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:11.704088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298369b-2f6d-4a75-8c51-d956c0442572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:11.726415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-8298369b-2f6d-4a75-8c51-d956c0442572 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:10:11.727777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-8298369b-2f6d-4a75-8c51-d956c0442572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:10:11.810797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 595/1202] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:10:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:10:11.836150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe426b59-a2c0-4f1c-9f20-4b09c5986d59 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:11.970266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe426b59-a2c0-4f1c-9f20-4b09c5986d59 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:12.014084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d92a24-5dd2-4294-be02-f5aa26a4c4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:12.014887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d92a24-5dd2-4294-be02-f5aa26a4c4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:12.015167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d92a24-5dd2-4294-be02-f5aa26a4c4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:12.015446 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d92a24-5dd2-4294-be02-f5aa26a4c4b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:12.026941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d92a24-5dd2-4294-be02-f5aa26a4c4b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:12.028446 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d92a24-5dd2-4294-be02-f5aa26a4c4b3 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-d9d92a24-5dd2-4294-be02-f5aa26a4c4b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:12.052283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:12.054081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:12.055050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:12.055050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:12.055050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:12.055050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:12.055050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 608/1203] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:10:12.059767 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298369b-2f6d-4a75-8c51-d956c0442572 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:12.189515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298369b-2f6d-4a75-8c51-d956c0442572 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:12.222520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:12.228929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8b2c2-e99f-49c5-a5ae-90c3f513e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:12.229669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8b2c2-e99f-49c5-a5ae-90c3f513e076 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:12.229936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8b2c2-e99f-49c5-a5ae-90c3f513e076 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:12.230218 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8b2c2-e99f-49c5-a5ae-90c3f513e076 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:12.231236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8b2c2-e99f-49c5-a5ae-90c3f513e076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:12.232138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8b2c2-e99f-49c5-a5ae-90c3f513e076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:12.233837 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8b2c2-e99f-49c5-a5ae-90c3f513e076 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:12.250315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 596/1204] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:12.256939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d92a24-5dd2-4294-be02-f5aa26a4c4b3 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:12.333441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:12.399318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d92a24-5dd2-4294-be02-f5aa26a4c4b3 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:12.447135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79847497-30a3-4ad3-95d7-d4dc1db823fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:12.447942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79847497-30a3-4ad3-95d7-d4dc1db823fc None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:12.448250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79847497-30a3-4ad3-95d7-d4dc1db823fc None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:12.448525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79847497-30a3-4ad3-95d7-d4dc1db823fc None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:12.449361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79847497-30a3-4ad3-95d7-d4dc1db823fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:12.450977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79847497-30a3-4ad3-95d7-d4dc1db823fc None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:12.482588 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 609/1205] 10.222.0.62 () {60 vars in 1132 bytes} [Thu Jul 7 07:10:12 2022] POST /identity/v3/users => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:10:14.790101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a96c4-752b-4415-8ddf-de5f99a7f047 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:14.790681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a96c4-752b-4415-8ddf-de5f99a7f047 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:14.790681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a96c4-752b-4415-8ddf-de5f99a7f047 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:14.792514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 597/1206] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:10:14.798125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000ba0e-7971-41e0-b698-1aec145c65a4 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:14.798615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000ba0e-7971-41e0-b698-1aec145c65a4 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:14.798711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000ba0e-7971-41e0-b698-1aec145c65a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:14.817757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-7000ba0e-7971-41e0-b698-1aec145c65a4 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:10:14.819051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7000ba0e-7971-41e0-b698-1aec145c65a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:10:14.904457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 610/1207] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:10:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:10:14.931334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a96c4-752b-4415-8ddf-de5f99a7f047 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:15.060967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a96c4-752b-4415-8ddf-de5f99a7f047 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:15.106199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbb121-1f15-48d2-a2de-7c9cdb2f2d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:15.108036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbb121-1f15-48d2-a2de-7c9cdb2f2d1c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:15.108036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbb121-1f15-48d2-a2de-7c9cdb2f2d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:15.108036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbb121-1f15-48d2-a2de-7c9cdb2f2d1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:15.120555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbb121-1f15-48d2-a2de-7c9cdb2f2d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-b2fbb121-1f15-48d2-a2de-7c9cdb2f2d1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:10:15.128610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:15.130067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:15.131139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 598/1208] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:10:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:15.136965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000ba0e-7971-41e0-b698-1aec145c65a4 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:15.186475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:15.267456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000ba0e-7971-41e0-b698-1aec145c65a4 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:15.305261 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aded51-4bdd-4ba7-b625-795b0fd45a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:15.305581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aded51-4bdd-4ba7-b625-795b0fd45a03 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:15.305763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aded51-4bdd-4ba7-b625-795b0fd45a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:15.305917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aded51-4bdd-4ba7-b625-795b0fd45a03 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:15.306685 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aded51-4bdd-4ba7-b625-795b0fd45a03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:15.306991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aded51-4bdd-4ba7-b625-795b0fd45a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:15.308381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aded51-4bdd-4ba7-b625-795b0fd45a03 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:15.317914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 611/1209] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:10:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:10:15.324450 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbb121-1f15-48d2-a2de-7c9cdb2f2d1c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:15.394720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:15.469485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbb121-1f15-48d2-a2de-7c9cdb2f2d1c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:15.529102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb52ed-4ea9-42c7-861b-c5212d6e62e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:15.530284 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb52ed-4ea9-42c7-861b-c5212d6e62e6 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:15.530284 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb52ed-4ea9-42c7-861b-c5212d6e62e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:15.530284 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb52ed-4ea9-42c7-861b-c5212d6e62e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:15.543645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb52ed-4ea9-42c7-861b-c5212d6e62e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:15.545208 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb52ed-4ea9-42c7-861b-c5212d6e62e6 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-23bb52ed-4ea9-42c7-861b-c5212d6e62e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:15.570391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:15.571628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:15.577579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:15.577579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:15.577579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:15.577579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:15.577579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 599/1210] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:15.579071 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aded51-4bdd-4ba7-b625-795b0fd45a03 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:15.736764 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:15.740967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aded51-4bdd-4ba7-b625-795b0fd45a03 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:15.793064 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe4b8f-b2fd-4277-aa7b-165a1dcf57a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:15.794154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4b8f-b2fd-4277-aa7b-165a1dcf57a3 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:15.794455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4b8f-b2fd-4277-aa7b-165a1dcf57a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:15.794884 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4b8f-b2fd-4277-aa7b-165a1dcf57a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:15.795731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe4b8f-b2fd-4277-aa7b-165a1dcf57a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:15.796217 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe4b8f-b2fd-4277-aa7b-165a1dcf57a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:15.797835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe4b8f-b2fd-4277-aa7b-165a1dcf57a3 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:15.812391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 612/1211] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:15.819490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb52ed-4ea9-42c7-861b-c5212d6e62e6 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:15.941935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb52ed-4ea9-42c7-861b-c5212d6e62e6 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:15.943694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:15.988200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b233b7-e4ab-478a-a5aa-8a73a379746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:15.989232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b233b7-e4ab-478a-a5aa-8a73a379746c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:15.989580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b233b7-e4ab-478a-a5aa-8a73a379746c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:15.989964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b233b7-e4ab-478a-a5aa-8a73a379746c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:15.998868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b233b7-e4ab-478a-a5aa-8a73a379746c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:16.000342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b233b7-e4ab-478a-a5aa-8a73a379746c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-f0b233b7-e4ab-478a-a5aa-8a73a379746c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:10:16.019426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:16.021034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:16.022318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:16.022318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:16.022318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:10:16.022318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:10:16.022318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:10:16.022318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:10:16.022318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:10:16.022318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:10:16.022318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 07 07:10:16.022318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:16.022318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 600/1212] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:16.027084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe4b8f-b2fd-4277-aa7b-165a1dcf57a3 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:16.173203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe4b8f-b2fd-4277-aa7b-165a1dcf57a3 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:16.227355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d134ed0-8a48-48ca-86e4-e655297c206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:16.227355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d134ed0-8a48-48ca-86e4-e655297c206f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:16.227355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d134ed0-8a48-48ca-86e4-e655297c206f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:16.227355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d134ed0-8a48-48ca-86e4-e655297c206f None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:16.227782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d134ed0-8a48-48ca-86e4-e655297c206f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:16.227782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d134ed0-8a48-48ca-86e4-e655297c206f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:16.228892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d134ed0-8a48-48ca-86e4-e655297c206f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:16.250457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 613/1213] 10.222.0.62 () {56 vars in 1143 bytes} [Thu Jul 7 07:10:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:16.256563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b233b7-e4ab-478a-a5aa-8a73a379746c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:16.398024 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b233b7-e4ab-478a-a5aa-8a73a379746c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:16.437050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda7719-a7b4-408c-b802-589becf7c721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:16.437743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda7719-a7b4-408c-b802-589becf7c721 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:16.438026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda7719-a7b4-408c-b802-589becf7c721 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:16.438295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda7719-a7b4-408c-b802-589becf7c721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:16.474741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:16.522719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda7719-a7b4-408c-b802-589becf7c721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:16.524406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda7719-a7b4-408c-b802-589becf7c721 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:16.645536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 601/1214] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:10:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 07 07:10:16.652150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d134ed0-8a48-48ca-86e4-e655297c206f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:16.673189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:16.774824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d134ed0-8a48-48ca-86e4-e655297c206f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:16.815404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639edf6c-0f48-455e-a0a5-f858f0145e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:16.816192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639edf6c-0f48-455e-a0a5-f858f0145e43 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:16.817865 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639edf6c-0f48-455e-a0a5-f858f0145e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:16.817865 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639edf6c-0f48-455e-a0a5-f858f0145e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:16.828962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639edf6c-0f48-455e-a0a5-f858f0145e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:16.830567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639edf6c-0f48-455e-a0a5-f858f0145e43 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-639edf6c-0f48-455e-a0a5-f858f0145e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:16.849328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:16.850952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:16.852290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:16.852290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:16.852290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:16.852290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:16.856095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 614/1215] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:16.856924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda7719-a7b4-408c-b802-589becf7c721 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:16.931120 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:16.971804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda7719-a7b4-408c-b802-589becf7c721 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:17.019892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e29b76-4259-4ef6-a6eb-23224dc3da86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:17.020966 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e29b76-4259-4ef6-a6eb-23224dc3da86 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:17.021126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e29b76-4259-4ef6-a6eb-23224dc3da86 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:17.021434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e29b76-4259-4ef6-a6eb-23224dc3da86 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:17.022191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e29b76-4259-4ef6-a6eb-23224dc3da86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:17.022508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e29b76-4259-4ef6-a6eb-23224dc3da86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:17.023888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e29b76-4259-4ef6-a6eb-23224dc3da86 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:17.040386 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 602/1216] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:17.046792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639edf6c-0f48-455e-a0a5-f858f0145e43 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:17.132292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:17.164499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639edf6c-0f48-455e-a0a5-f858f0145e43 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:17.203032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3586fb6-79f1-452b-bc65-c193b89feb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:17.203928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3586fb6-79f1-452b-bc65-c193b89feb8d None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:17.204302 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3586fb6-79f1-452b-bc65-c193b89feb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:17.204650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3586fb6-79f1-452b-bc65-c193b89feb8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:17.212172 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3586fb6-79f1-452b-bc65-c193b89feb8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:17.213834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3586fb6-79f1-452b-bc65-c193b89feb8d None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-b3586fb6-79f1-452b-bc65-c193b89feb8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:10:17.228858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:17.230062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:17.231114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:10:17.231114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:10:17.231114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:10:17.231114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:10:17.231114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:10:17.231114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:10:17.231114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:10:17.231114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:17.231631 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 615/1217] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:10:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:17.236750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e29b76-4259-4ef6-a6eb-23224dc3da86 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:17.369973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e29b76-4259-4ef6-a6eb-23224dc3da86 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:17.400078 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:17.419560 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ed834-512b-40cc-905d-a837e747d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:17.420600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ed834-512b-40cc-905d-a837e747d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:17.421093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ed834-512b-40cc-905d-a837e747d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:17.421627 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ed834-512b-40cc-905d-a837e747d9e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:17.422642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ed834-512b-40cc-905d-a837e747d9e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:17.424187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ed834-512b-40cc-905d-a837e747d9e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:17.425036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ed834-512b-40cc-905d-a837e747d9e8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:17.443240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 603/1218] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:10:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:17.445140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3586fb6-79f1-452b-bc65-c193b89feb8d None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:17.566236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3586fb6-79f1-452b-bc65-c193b89feb8d None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:17.601127 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:17.608623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acf31e-9f60-49e7-b4ff-3ece5830f963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:17.609555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acf31e-9f60-49e7-b4ff-3ece5830f963 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:17.610374 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acf31e-9f60-49e7-b4ff-3ece5830f963 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:17.611058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acf31e-9f60-49e7-b4ff-3ece5830f963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:17.612179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acf31e-9f60-49e7-b4ff-3ece5830f963 None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=bd80f27a4499407d8c350f2908638334) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:17.612632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acf31e-9f60-49e7-b4ff-3ece5830f963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:17.614367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acf31e-9f60-49e7-b4ff-3ece5830f963 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:17.621426 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 616/1219] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:10:17 2022] GET /identity/v3/role_assignments?user.id=bd80f27a4499407d8c350f2908638334&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:19.754969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888293d5-eb8f-4a0c-a03c-ba54c8ddad23 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:19.755663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888293d5-eb8f-4a0c-a03c-ba54c8ddad23 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:19.755663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888293d5-eb8f-4a0c-a03c-ba54c8ddad23 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:19.756901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 604/1220] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:10:19.763231 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f4f9-02db-49e5-8f7d-11cb5b0f36c3 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:19.764109 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f4f9-02db-49e5-8f7d-11cb5b0f36c3 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:19.764109 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f4f9-02db-49e5-8f7d-11cb5b0f36c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:19.789939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-3279f4f9-02db-49e5-8f7d-11cb5b0f36c3 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:10:19.791210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3279f4f9-02db-49e5-8f7d-11cb5b0f36c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:10:19.884765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 617/1221] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:10:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:10:19.911659 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888293d5-eb8f-4a0c-a03c-ba54c8ddad23 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:20.042448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888293d5-eb8f-4a0c-a03c-ba54c8ddad23 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:20.084534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb32536-4590-4d70-9e56-baa584fccd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:20.085633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb32536-4590-4d70-9e56-baa584fccd95 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:20.085946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb32536-4590-4d70-9e56-baa584fccd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:20.086293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb32536-4590-4d70-9e56-baa584fccd95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:20.098045 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb32536-4590-4d70-9e56-baa584fccd95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-feb32536-4590-4d70-9e56-baa584fccd95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:10:20.107345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:20.108754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:20.109923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:20.109923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:20.109923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:20.109923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:20.109923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:10:20.109923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:10:20.109923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:10:20.109923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:10:20.109923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:10:20.109923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:10:20.109923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:10:20.109923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:20.114965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 605/1222] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:10:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:20.116442 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279f4f9-02db-49e5-8f7d-11cb5b0f36c3 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:20.232456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279f4f9-02db-49e5-8f7d-11cb5b0f36c3 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:20.256297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:20.268033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94213ad-4252-4555-aa86-100927d3a69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:20.268756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94213ad-4252-4555-aa86-100927d3a69c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:20.269076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94213ad-4252-4555-aa86-100927d3a69c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:20.269407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94213ad-4252-4555-aa86-100927d3a69c None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:20.270257 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94213ad-4252-4555-aa86-100927d3a69c None admin] RBAC: Adding query filter params (name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:20.270569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94213ad-4252-4555-aa86-100927d3a69c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:20.272129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94213ad-4252-4555-aa86-100927d3a69c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:20.281637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 618/1223] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:10:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:20.287897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb32536-4590-4d70-9e56-baa584fccd95 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:20.338284 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:20.400839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb32536-4590-4d70-9e56-baa584fccd95 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:20.441685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf732d-a260-451f-b3a4-d6aec86b20e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:20.442994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf732d-a260-451f-b3a4-d6aec86b20e5 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:20.443479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf732d-a260-451f-b3a4-d6aec86b20e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:20.443952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf732d-a260-451f-b3a4-d6aec86b20e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:20.461972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf732d-a260-451f-b3a4-d6aec86b20e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:20.464590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf732d-a260-451f-b3a4-d6aec86b20e5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-3eaf732d-a260-451f-b3a4-d6aec86b20e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:20.485796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:20.486919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:20.488075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:20.488075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:20.488075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:20.488075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:20.488075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 606/1224] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:20.494087 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94213ad-4252-4555-aa86-100927d3a69c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:20.603735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94213ad-4252-4555-aa86-100927d3a69c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:20.640755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ff6da-53d0-472b-96fd-29fde10583b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:20.641473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ff6da-53d0-472b-96fd-29fde10583b1 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:20.641762 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ff6da-53d0-472b-96fd-29fde10583b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:20.642045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ff6da-53d0-472b-96fd-29fde10583b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:20.642907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ff6da-53d0-472b-96fd-29fde10583b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:20.643138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ff6da-53d0-472b-96fd-29fde10583b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:20.644557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ff6da-53d0-472b-96fd-29fde10583b1 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:20.657237 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 619/1225] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:20.666254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf732d-a260-451f-b3a4-d6aec86b20e5 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:20.768358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:20.775851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf732d-a260-451f-b3a4-d6aec86b20e5 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:20.809847 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c13ca2-a643-4b30-8bb4-e0ceb0af5335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:20.810676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13ca2-a643-4b30-8bb4-e0ceb0af5335 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:20.810958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13ca2-a643-4b30-8bb4-e0ceb0af5335 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:20.811235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13ca2-a643-4b30-8bb4-e0ceb0af5335 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:20.820215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c13ca2-a643-4b30-8bb4-e0ceb0af5335 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:20.821739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c13ca2-a643-4b30-8bb4-e0ceb0af5335 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-20c13ca2-a643-4b30-8bb4-e0ceb0af5335 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:10:20.836324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:20.837375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:20.838379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:20.838379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:20.838379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:10:20.838379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:10:20.838379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:10:20.838379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:10:20.838379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:10:20.838379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:10:20.838379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 07 07:10:20.838379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:20.838379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 607/1226] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:20.843526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ff6da-53d0-472b-96fd-29fde10583b1 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:20.895841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:20.955164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ff6da-53d0-472b-96fd-29fde10583b1 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:20.994309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0465331-e3ea-4677-aa87-66f794c9c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:20.995095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0465331-e3ea-4677-aa87-66f794c9c466 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:20.995396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0465331-e3ea-4677-aa87-66f794c9c466 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:20.995708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0465331-e3ea-4677-aa87-66f794c9c466 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:20.996572 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0465331-e3ea-4677-aa87-66f794c9c466 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:20.996881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0465331-e3ea-4677-aa87-66f794c9c466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:20.998481 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0465331-e3ea-4677-aa87-66f794c9c466 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:21.018065 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 620/1227] 10.222.0.62 () {56 vars in 1143 bytes} [Thu Jul 7 07:10:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:21.024549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c13ca2-a643-4b30-8bb4-e0ceb0af5335 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:21.140265 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c13ca2-a643-4b30-8bb4-e0ceb0af5335 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:21.181894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fbc50-7008-4b3e-9d2e-16d9867d4a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:21.182648 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fbc50-7008-4b3e-9d2e-16d9867d4a40 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:21.182932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fbc50-7008-4b3e-9d2e-16d9867d4a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:21.183207 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fbc50-7008-4b3e-9d2e-16d9867d4a40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:21.195558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fbc50-7008-4b3e-9d2e-16d9867d4a40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:21.197396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fbc50-7008-4b3e-9d2e-16d9867d4a40 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-772fbc50-7008-4b3e-9d2e-16d9867d4a40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:21.220006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:21.221009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:21.222309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:21.222309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:21.222309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:21.222309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:21.222309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 608/1228] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:10:21.227896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0465331-e3ea-4677-aa87-66f794c9c466 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:21.353195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0465331-e3ea-4677-aa87-66f794c9c466 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:21.355867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:21.391780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88b64d-fc88-458d-b755-d8f250e913bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:21.392383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88b64d-fc88-458d-b755-d8f250e913bf None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:21.392752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88b64d-fc88-458d-b755-d8f250e913bf None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:21.392929 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88b64d-fc88-458d-b755-d8f250e913bf None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:21.393750 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88b64d-fc88-458d-b755-d8f250e913bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:21.394058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88b64d-fc88-458d-b755-d8f250e913bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:21.395463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88b64d-fc88-458d-b755-d8f250e913bf None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:21.415676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 621/1229] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:10:21.416920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fbc50-7008-4b3e-9d2e-16d9867d4a40 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:21.427266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:21.542510 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fbc50-7008-4b3e-9d2e-16d9867d4a40 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:21.582461 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd423714-2989-479d-9a20-6e4ca5c99f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:21.583311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd423714-2989-479d-9a20-6e4ca5c99f4e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:21.583571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd423714-2989-479d-9a20-6e4ca5c99f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:21.583919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd423714-2989-479d-9a20-6e4ca5c99f4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:21.592287 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd423714-2989-479d-9a20-6e4ca5c99f4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:21.594043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd423714-2989-479d-9a20-6e4ca5c99f4e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-bd423714-2989-479d-9a20-6e4ca5c99f4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:10:21.613184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:21.614289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:21.615306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:10:21.615306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:10:21.615306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:10:21.615306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:10:21.615306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:10:21.615306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:10:21.615306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:10:21.615306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:21.615306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 609/1230] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:10:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:21.621307 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88b64d-fc88-458d-b755-d8f250e913bf None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:21.745758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88b64d-fc88-458d-b755-d8f250e913bf None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:21.786713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146be7d4-af98-4481-91b2-8d1510435bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:21.787646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146be7d4-af98-4481-91b2-8d1510435bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:21.788169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146be7d4-af98-4481-91b2-8d1510435bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:21.788490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146be7d4-af98-4481-91b2-8d1510435bb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:21.789418 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146be7d4-af98-4481-91b2-8d1510435bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:21.789729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146be7d4-af98-4481-91b2-8d1510435bb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:21.791916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146be7d4-af98-4481-91b2-8d1510435bb6 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:21.809497 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 622/1231] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:10:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:21.816524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd423714-2989-479d-9a20-6e4ca5c99f4e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:21.897142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:21.938431 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd423714-2989-479d-9a20-6e4ca5c99f4e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:21.978340 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6abcee-6bf0-4b9f-a68b-67d7a55b06a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:21.979302 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6abcee-6bf0-4b9f-a68b-67d7a55b06a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:21.979647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6abcee-6bf0-4b9f-a68b-67d7a55b06a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:21.979950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6abcee-6bf0-4b9f-a68b-67d7a55b06a5 None admin] PATH_INFO: `/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/bd80f27a4499407d8c350f2908638334/roles/bc1cedb3c00f446dbe9f7c756a01d28a` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:21.998629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6abcee-6bf0-4b9f-a68b-67d7a55b06a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d7163b6caf648d89fd2cd48f27b1a23, user_id=bd80f27a4499407d8c350f2908638334, role_id=bc1cedb3c00f446dbe9f7c756a01d28a)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:22.000332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6abcee-6bf0-4b9f-a68b-67d7a55b06a5 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:22.015159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 610/1232] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:10:21 2022] PUT /identity/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/bd80f27a4499407d8c350f2908638334/roles/bc1cedb3c00f446dbe9f7c756a01d28a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:10:24.223671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3d99-0834-4ab1-b5dc-2182e8ecb35d None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:24.224480 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3d99-0834-4ab1-b5dc-2182e8ecb35d None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:24.224750 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3d99-0834-4ab1-b5dc-2182e8ecb35d None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:24.227094 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 623/1233] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:10:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:10:24.233346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104c40a-887b-4166-a89d-ede2dbba5a17 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:24.233891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104c40a-887b-4166-a89d-ede2dbba5a17 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:24.234043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104c40a-887b-4166-a89d-ede2dbba5a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:24.253677 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-4104c40a-887b-4166-a89d-ede2dbba5a17 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:10:24.255149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4104c40a-887b-4166-a89d-ede2dbba5a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:10:24.348594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 611/1234] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:10:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:10:24.375264 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae3d99-0834-4ab1-b5dc-2182e8ecb35d None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:24.405283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:24.488178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae3d99-0834-4ab1-b5dc-2182e8ecb35d None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:24.541612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4939aa-92e5-4414-b1b3-a9382739905b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:24.542937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4939aa-92e5-4414-b1b3-a9382739905b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:24.543434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4939aa-92e5-4414-b1b3-a9382739905b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:24.543916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4939aa-92e5-4414-b1b3-a9382739905b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:24.561181 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4939aa-92e5-4414-b1b3-a9382739905b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-ca4939aa-92e5-4414-b1b3-a9382739905b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:10:24.576187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:24.577267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:24.578107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:24.578107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:24.578107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:24.578107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:24.578107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:10:24.578107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:10:24.578107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:10:24.578107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:10:24.578107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:10:24.578107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:10:24.578107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 07:10:24.578107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:24.583823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 624/1235] 10.222.0.62 () {56 vars in 1102 bytes} [Thu Jul 7 07:10:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:24.585021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104c40a-887b-4166-a89d-ede2dbba5a17 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:24.639257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:24.698248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104c40a-887b-4166-a89d-ede2dbba5a17 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:24.739021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83f76b-75cd-449d-8531-5fabed24c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:24.739625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83f76b-75cd-449d-8531-5fabed24c953 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:24.739930 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83f76b-75cd-449d-8531-5fabed24c953 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:24.740195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83f76b-75cd-449d-8531-5fabed24c953 None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:24.740936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83f76b-75cd-449d-8531-5fabed24c953 None admin] RBAC: Adding query filter params (name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:24.741300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83f76b-75cd-449d-8531-5fabed24c953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:24.742678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83f76b-75cd-449d-8531-5fabed24c953 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:24.752451 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 612/1236] 10.222.0.62 () {56 vars in 1103 bytes} [Thu Jul 7 07:10:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:24.759081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4939aa-92e5-4414-b1b3-a9382739905b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:24.859709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:24.880469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4939aa-92e5-4414-b1b3-a9382739905b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:24.925708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fca9c2-fed7-498b-868a-9de41bb0cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:24.926524 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fca9c2-fed7-498b-868a-9de41bb0cee9 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:24.926792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fca9c2-fed7-498b-868a-9de41bb0cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:24.927067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fca9c2-fed7-498b-868a-9de41bb0cee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:24.939299 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fca9c2-fed7-498b-868a-9de41bb0cee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:24.941105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fca9c2-fed7-498b-868a-9de41bb0cee9 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-a1fca9c2-fed7-498b-868a-9de41bb0cee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:24.963624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:24.964872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:24.966269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:24.966269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:24.966269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:24.966269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:24.966269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 625/1237] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:10:24.971314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83f76b-75cd-449d-8531-5fabed24c953 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:25.086689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83f76b-75cd-449d-8531-5fabed24c953 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:25.098398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:25.132646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e7672-4708-4e32-970a-d7a46afc58f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:25.133548 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e7672-4708-4e32-970a-d7a46afc58f8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:25.133885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e7672-4708-4e32-970a-d7a46afc58f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:25.134410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e7672-4708-4e32-970a-d7a46afc58f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:25.135031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e7672-4708-4e32-970a-d7a46afc58f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:25.135426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e7672-4708-4e32-970a-d7a46afc58f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:25.143409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e7672-4708-4e32-970a-d7a46afc58f8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:25.160416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 613/1238] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:25.161912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fca9c2-fed7-498b-868a-9de41bb0cee9 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:25.290310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fca9c2-fed7-498b-868a-9de41bb0cee9 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:25.352021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf5865-a53f-459d-aa0a-c87945e4cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:25.353465 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf5865-a53f-459d-aa0a-c87945e4cdea None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:25.353999 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf5865-a53f-459d-aa0a-c87945e4cdea None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:25.354601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf5865-a53f-459d-aa0a-c87945e4cdea None admin] PATH_INFO: `/v3/users/placement` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:25.360737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:25.368164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf5865-a53f-459d-aa0a-c87945e4cdea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:25.370464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf5865-a53f-459d-aa0a-c87945e4cdea None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-ffdf5865-a53f-459d-aa0a-c87945e4cdea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:10:25.387505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:25.389490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:25.390950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:25.390950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:25.390950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:10:25.390950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:10:25.390950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:10:25.390950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:10:25.390950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:10:25.390950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:10:25.390950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 07 07:10:25.390950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:25.390950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 626/1239] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:25.395423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e7672-4708-4e32-970a-d7a46afc58f8 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:25.526977 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e7672-4708-4e32-970a-d7a46afc58f8 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:25.575929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee04b61-0f85-4ce9-8320-879f05ed5960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:25.577084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee04b61-0f85-4ce9-8320-879f05ed5960 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:25.577612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee04b61-0f85-4ce9-8320-879f05ed5960 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:25.578101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee04b61-0f85-4ce9-8320-879f05ed5960 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:25.579685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee04b61-0f85-4ce9-8320-879f05ed5960 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:25.580233 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee04b61-0f85-4ce9-8320-879f05ed5960 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:25.582931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee04b61-0f85-4ce9-8320-879f05ed5960 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:25.622375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 614/1240] 10.222.0.62 () {56 vars in 1143 bytes} [Thu Jul 7 07:10:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:10:25.623749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf5865-a53f-459d-aa0a-c87945e4cdea None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:25.773873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf5865-a53f-459d-aa0a-c87945e4cdea None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:25.818338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375ebbe-1a87-46f9-a5f6-167976d31867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:25.819000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375ebbe-1a87-46f9-a5f6-167976d31867 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:25.819360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375ebbe-1a87-46f9-a5f6-167976d31867 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:25.819640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375ebbe-1a87-46f9-a5f6-167976d31867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:25.894685 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:25.904925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375ebbe-1a87-46f9-a5f6-167976d31867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:25.906769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375ebbe-1a87-46f9-a5f6-167976d31867 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:26.022355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 627/1241] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:10:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:10:26.029059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee04b61-0f85-4ce9-8320-879f05ed5960 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:26.058358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:26.159172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee04b61-0f85-4ce9-8320-879f05ed5960 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:26.203149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048c84f-beba-40b8-bf23-10343a5d6e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:26.203945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048c84f-beba-40b8-bf23-10343a5d6e21 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:26.204253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048c84f-beba-40b8-bf23-10343a5d6e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:26.204548 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048c84f-beba-40b8-bf23-10343a5d6e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:26.215092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048c84f-beba-40b8-bf23-10343a5d6e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:26.216558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048c84f-beba-40b8-bf23-10343a5d6e21 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-f048c84f-beba-40b8-bf23-10343a5d6e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:26.236036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:26.237308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:26.238589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:26.238589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:26.238589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:26.238589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:26.238589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 615/1242] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:26.243491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375ebbe-1a87-46f9-a5f6-167976d31867 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:26.344921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:26.352749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375ebbe-1a87-46f9-a5f6-167976d31867 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:26.390169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216179d1-183b-42e0-be5d-26884401950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:26.390837 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216179d1-183b-42e0-be5d-26884401950c None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:26.391142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216179d1-183b-42e0-be5d-26884401950c None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:26.391460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216179d1-183b-42e0-be5d-26884401950c None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:26.392396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216179d1-183b-42e0-be5d-26884401950c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:26.392820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216179d1-183b-42e0-be5d-26884401950c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:26.395161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216179d1-183b-42e0-be5d-26884401950c None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:26.408076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 628/1243] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:26.413902 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048c84f-beba-40b8-bf23-10343a5d6e21 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:26.498376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:26.522877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048c84f-beba-40b8-bf23-10343a5d6e21 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:26.560900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b765d-e42d-499a-8a90-8338e72217ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:26.562104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b765d-e42d-499a-8a90-8338e72217ac None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:26.562396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b765d-e42d-499a-8a90-8338e72217ac None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:26.562671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b765d-e42d-499a-8a90-8338e72217ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:26.571171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b765d-e42d-499a-8a90-8338e72217ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:26.572753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b765d-e42d-499a-8a90-8338e72217ac None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-d39b765d-e42d-499a-8a90-8338e72217ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:10:26.587989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:26.589312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:26.590524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:10:26.590524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:10:26.590524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:10:26.590524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:10:26.590524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:10:26.590524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:10:26.590524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:10:26.590524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:26.590524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 616/1244] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:26.595573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216179d1-183b-42e0-be5d-26884401950c None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:26.718977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216179d1-183b-42e0-be5d-26884401950c None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:26.780265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362f087-d57b-405d-877a-3794b9bee5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:26.780943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362f087-d57b-405d-877a-3794b9bee5ed None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:26.781410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362f087-d57b-405d-877a-3794b9bee5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:26.781706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362f087-d57b-405d-877a-3794b9bee5ed None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:26.782643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362f087-d57b-405d-877a-3794b9bee5ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:26.782958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362f087-d57b-405d-877a-3794b9bee5ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:26.784740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362f087-d57b-405d-877a-3794b9bee5ed None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:26.800725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 629/1245] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:26.810500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b765d-e42d-499a-8a90-8338e72217ac None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:26.932776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b765d-e42d-499a-8a90-8338e72217ac None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:26.973988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ee06b-5481-43ff-b48e-1ee0df0064d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:26.974619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ee06b-5481-43ff-b48e-1ee0df0064d9 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:26.974933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ee06b-5481-43ff-b48e-1ee0df0064d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:26.975190 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ee06b-5481-43ff-b48e-1ee0df0064d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:26.976007 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ee06b-5481-43ff-b48e-1ee0df0064d9 None admin] RBAC: Adding query filter params (role.id=bc1cedb3c00f446dbe9f7c756a01d28a, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=bd80f27a4499407d8c350f2908638334) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:26.976322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ee06b-5481-43ff-b48e-1ee0df0064d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:26.977795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ee06b-5481-43ff-b48e-1ee0df0064d9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:26.997246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 617/1246] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:10:26 2022] GET /identity/v3/role_assignments?user.id=bd80f27a4499407d8c350f2908638334&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=bc1cedb3c00f446dbe9f7c756a01d28a => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:29.257738 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac21135-192e-4f43-be04-e1c1be90d8ea None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:29.258326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac21135-192e-4f43-be04-e1c1be90d8ea None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:29.258326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac21135-192e-4f43-be04-e1c1be90d8ea None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:29.259720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 630/1247] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:10:29.265978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769ae7-09e2-4e26-b29f-88e429e4814c None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:29.266544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769ae7-09e2-4e26-b29f-88e429e4814c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:29.266723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769ae7-09e2-4e26-b29f-88e429e4814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:29.273472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:29.292663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-24769ae7-09e2-4e26-b29f-88e429e4814c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:10:29.293037 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-24769ae7-09e2-4e26-b29f-88e429e4814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:10:29.378457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 618/1248] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:10:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:10:29.404726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac21135-192e-4f43-be04-e1c1be90d8ea None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:29.427423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:29.561660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac21135-192e-4f43-be04-e1c1be90d8ea None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:29.617295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4413d-23ba-4b21-bf61-7fa73f887e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:29.618334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4413d-23ba-4b21-bf61-7fa73f887e2b None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:29.618654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4413d-23ba-4b21-bf61-7fa73f887e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:29.618958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4413d-23ba-4b21-bf61-7fa73f887e2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:29.632884 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4413d-23ba-4b21-bf61-7fa73f887e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-4fa4413d-23ba-4b21-bf61-7fa73f887e2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:10:29.640928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:29.642068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:29.643026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 631/1249] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:10:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 07:10:29.651896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769ae7-09e2-4e26-b29f-88e429e4814c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:29.795857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769ae7-09e2-4e26-b29f-88e429e4814c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:29.833114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:29.839141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab9816-899b-4eb2-b304-ed13f513a69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:29.839857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab9816-899b-4eb2-b304-ed13f513a69a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:29.840136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab9816-899b-4eb2-b304-ed13f513a69a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:29.840413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab9816-899b-4eb2-b304-ed13f513a69a None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:29.841164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab9816-899b-4eb2-b304-ed13f513a69a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:29.841499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab9816-899b-4eb2-b304-ed13f513a69a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:29.842894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab9816-899b-4eb2-b304-ed13f513a69a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:29.852605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 619/1250] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:10:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:29.858899 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4413d-23ba-4b21-bf61-7fa73f887e2b None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:29.953314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:29.981599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4413d-23ba-4b21-bf61-7fa73f887e2b None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:30.023213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2803962-6bb9-4b60-a356-a73cc3ebc87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:30.024025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2803962-6bb9-4b60-a356-a73cc3ebc87e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:30.024303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2803962-6bb9-4b60-a356-a73cc3ebc87e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:30.024575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2803962-6bb9-4b60-a356-a73cc3ebc87e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:30.036852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2803962-6bb9-4b60-a356-a73cc3ebc87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:30.038774 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2803962-6bb9-4b60-a356-a73cc3ebc87e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-c2803962-6bb9-4b60-a356-a73cc3ebc87e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:30.059592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:30.060827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:30.062317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:30.062317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:30.062317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:30.062317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:30.062317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 632/1251] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:30.067442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab9816-899b-4eb2-b304-ed13f513a69a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:30.214417 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab9816-899b-4eb2-b304-ed13f513a69a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:30.260371 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c20da2-dbe7-4295-93cb-d8a1ed8ede9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:30.261108 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c20da2-dbe7-4295-93cb-d8a1ed8ede9e None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:30.261477 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c20da2-dbe7-4295-93cb-d8a1ed8ede9e None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:30.261754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c20da2-dbe7-4295-93cb-d8a1ed8ede9e None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:30.262696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c20da2-dbe7-4295-93cb-d8a1ed8ede9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:30.263066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c20da2-dbe7-4295-93cb-d8a1ed8ede9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:30.264965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c20da2-dbe7-4295-93cb-d8a1ed8ede9e None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:30.279733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 620/1252] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:30.286193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2803962-6bb9-4b60-a356-a73cc3ebc87e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:30.457070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2803962-6bb9-4b60-a356-a73cc3ebc87e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:30.487993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:30.502604 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42773c2-b0c0-44d3-8192-0a93893fab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:30.504327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42773c2-b0c0-44d3-8192-0a93893fab15 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:30.504832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42773c2-b0c0-44d3-8192-0a93893fab15 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:30.505485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42773c2-b0c0-44d3-8192-0a93893fab15 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:30.522149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42773c2-b0c0-44d3-8192-0a93893fab15 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:30.526093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42773c2-b0c0-44d3-8192-0a93893fab15 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-b42773c2-b0c0-44d3-8192-0a93893fab15 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:10:30.554703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:30.556243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:30.559173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:30.559173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:30.559173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:10:30.559173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:10:30.559173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:10:30.559173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:10:30.559173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:10:30.559173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:10:30.559173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 07 07:10:30.559173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:30.562660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 633/1253] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:30.569404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c20da2-dbe7-4295-93cb-d8a1ed8ede9e None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:30.654605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:30.718772 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c20da2-dbe7-4295-93cb-d8a1ed8ede9e None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:30.766235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a747274-2cd2-4d9b-9fd8-1c7348f0076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:30.766818 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a747274-2cd2-4d9b-9fd8-1c7348f0076b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:30.767128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a747274-2cd2-4d9b-9fd8-1c7348f0076b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:30.767366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a747274-2cd2-4d9b-9fd8-1c7348f0076b None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:30.768340 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a747274-2cd2-4d9b-9fd8-1c7348f0076b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:30.768647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a747274-2cd2-4d9b-9fd8-1c7348f0076b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:30.770167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a747274-2cd2-4d9b-9fd8-1c7348f0076b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:30.792647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 621/1254] 10.222.0.62 () {56 vars in 1143 bytes} [Thu Jul 7 07:10:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:10:30.798843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42773c2-b0c0-44d3-8192-0a93893fab15 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:30.932775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42773c2-b0c0-44d3-8192-0a93893fab15 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:30.973810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e7660-076f-4b50-85ee-f02b80e5cc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:30.974602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e7660-076f-4b50-85ee-f02b80e5cc61 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:30.974883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e7660-076f-4b50-85ee-f02b80e5cc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:30.975192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e7660-076f-4b50-85ee-f02b80e5cc61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:31.036132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:31.052035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e7660-076f-4b50-85ee-f02b80e5cc61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:31.053713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e7660-076f-4b50-85ee-f02b80e5cc61 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:31.187266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 634/1255] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:10:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:10:31.196150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a747274-2cd2-4d9b-9fd8-1c7348f0076b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:31.318656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a747274-2cd2-4d9b-9fd8-1c7348f0076b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:31.335962 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:31.359104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7605d2-55f0-4de5-9042-e8baf5c61fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:31.359962 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7605d2-55f0-4de5-9042-e8baf5c61fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:31.360276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7605d2-55f0-4de5-9042-e8baf5c61fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:31.360558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7605d2-55f0-4de5-9042-e8baf5c61fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:31.371289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7605d2-55f0-4de5-9042-e8baf5c61fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:31.372785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7605d2-55f0-4de5-9042-e8baf5c61fc8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-8a7605d2-55f0-4de5-9042-e8baf5c61fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:31.392521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:31.393556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:31.394447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:31.394447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:31.394447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:31.394447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:31.394447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 622/1256] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:31.400199 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e7660-076f-4b50-85ee-f02b80e5cc61 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:31.501614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:31.515476 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e7660-076f-4b50-85ee-f02b80e5cc61 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:31.553907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb7420-ec2a-4ad8-a260-e27fecfdf66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:31.554586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb7420-ec2a-4ad8-a260-e27fecfdf66e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:31.554868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb7420-ec2a-4ad8-a260-e27fecfdf66e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:31.555148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb7420-ec2a-4ad8-a260-e27fecfdf66e None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:31.555887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb7420-ec2a-4ad8-a260-e27fecfdf66e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:31.556194 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb7420-ec2a-4ad8-a260-e27fecfdf66e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:31.557637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb7420-ec2a-4ad8-a260-e27fecfdf66e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:31.570371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 635/1257] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:31.576244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7605d2-55f0-4de5-9042-e8baf5c61fc8 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:31.730874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7605d2-55f0-4de5-9042-e8baf5c61fc8 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:31.779160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97966-5afe-4f21-95fa-7874d732aa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:31.780889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97966-5afe-4f21-95fa-7874d732aa6d None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:31.781200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97966-5afe-4f21-95fa-7874d732aa6d None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:31.781492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97966-5afe-4f21-95fa-7874d732aa6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:31.789530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97966-5afe-4f21-95fa-7874d732aa6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:31.791007 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97966-5afe-4f21-95fa-7874d732aa6d None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-afa97966-5afe-4f21-95fa-7874d732aa6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:10:31.806135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:31.807251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:31.808150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:10:31.808150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:10:31.808150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:10:31.808150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:10:31.808150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:10:31.808150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:10:31.808150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:10:31.808150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:31.808150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 623/1258] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:10:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:31.813612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb7420-ec2a-4ad8-a260-e27fecfdf66e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:31.932195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb7420-ec2a-4ad8-a260-e27fecfdf66e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:31.971550 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617289e9-c716-44a8-baf7-ace2412111f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:31.972218 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617289e9-c716-44a8-baf7-ace2412111f5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:31.972503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617289e9-c716-44a8-baf7-ace2412111f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:31.972784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617289e9-c716-44a8-baf7-ace2412111f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:31.973801 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617289e9-c716-44a8-baf7-ace2412111f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:31.974134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617289e9-c716-44a8-baf7-ace2412111f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:31.975593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617289e9-c716-44a8-baf7-ace2412111f5 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:31.995553 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 636/1259] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:31.996778 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97966-5afe-4f21-95fa-7874d732aa6d None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:32.027445 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:32.107229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97966-5afe-4f21-95fa-7874d732aa6d None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:32.166919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9de60-7e21-476f-ba7a-659344fd4d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:32.167926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9de60-7e21-476f-ba7a-659344fd4d91 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:32.168352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9de60-7e21-476f-ba7a-659344fd4d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:32.168739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9de60-7e21-476f-ba7a-659344fd4d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:32.170060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9de60-7e21-476f-ba7a-659344fd4d91 None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=bd80f27a4499407d8c350f2908638334) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:32.170594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9de60-7e21-476f-ba7a-659344fd4d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:32.172789 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9de60-7e21-476f-ba7a-659344fd4d91 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:32.182015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 624/1260] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:10:31 2022] GET /identity/v3/role_assignments?user.id=bd80f27a4499407d8c350f2908638334&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:34.355453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aebcd-2d98-442a-a3af-11ae32ce64f4 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:34.356070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aebcd-2d98-442a-a3af-11ae32ce64f4 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:34.356070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aebcd-2d98-442a-a3af-11ae32ce64f4 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:34.357456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 637/1261] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:10:34.363008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3962b-95bf-476e-bc15-1999d24fc1fb None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:34.363491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3962b-95bf-476e-bc15-1999d24fc1fb None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:34.363614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3962b-95bf-476e-bc15-1999d24fc1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:34.381504 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-46e3962b-95bf-476e-bc15-1999d24fc1fb None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:10:34.382721 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-46e3962b-95bf-476e-bc15-1999d24fc1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:10:34.461692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 625/1262] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:10:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:10:34.484341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804aebcd-2d98-442a-a3af-11ae32ce64f4 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:34.502173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:34.601137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804aebcd-2d98-442a-a3af-11ae32ce64f4 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:34.640678 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444675c5-a8ce-4165-9834-6ba0697c331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:34.641433 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444675c5-a8ce-4165-9834-6ba0697c331f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:34.641714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444675c5-a8ce-4165-9834-6ba0697c331f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:34.641991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444675c5-a8ce-4165-9834-6ba0697c331f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:34.654221 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444675c5-a8ce-4165-9834-6ba0697c331f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-444675c5-a8ce-4165-9834-6ba0697c331f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:10:34.662097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:34.663972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:34.665770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 638/1263] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:34.670253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3962b-95bf-476e-bc15-1999d24fc1fb None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:34.691167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:34.777251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3962b-95bf-476e-bc15-1999d24fc1fb None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:34.815091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83450f-fd9f-4f58-9df5-7b000ede4f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:34.815903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83450f-fd9f-4f58-9df5-7b000ede4f5a None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:34.816300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83450f-fd9f-4f58-9df5-7b000ede4f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:34.816680 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83450f-fd9f-4f58-9df5-7b000ede4f5a None admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:34.817594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83450f-fd9f-4f58-9df5-7b000ede4f5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:34.817996 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83450f-fd9f-4f58-9df5-7b000ede4f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:34.819494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83450f-fd9f-4f58-9df5-7b000ede4f5a None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:34.830029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 626/1264] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:34.836621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444675c5-a8ce-4165-9834-6ba0697c331f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:34.910416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:34.949803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444675c5-a8ce-4165-9834-6ba0697c331f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:34.986866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f53ba4-9419-4b0f-b488-5c76c2fe46e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:34.987670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f53ba4-9419-4b0f-b488-5c76c2fe46e5 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:34.987947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f53ba4-9419-4b0f-b488-5c76c2fe46e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:34.988224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f53ba4-9419-4b0f-b488-5c76c2fe46e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:35.000223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f53ba4-9419-4b0f-b488-5c76c2fe46e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:35.001743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f53ba4-9419-4b0f-b488-5c76c2fe46e5 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-08f53ba4-9419-4b0f-b488-5c76c2fe46e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:35.020173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:35.021403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:35.022474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:35.022474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:35.022474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:35.022474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:35.022474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 639/1265] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:35.027575 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83450f-fd9f-4f58-9df5-7b000ede4f5a None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:35.119768 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:35.143888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83450f-fd9f-4f58-9df5-7b000ede4f5a None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:35.193632 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee78e-1092-490e-9374-97957fd27202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:35.194737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee78e-1092-490e-9374-97957fd27202 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:35.195242 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee78e-1092-490e-9374-97957fd27202 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:35.195749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee78e-1092-490e-9374-97957fd27202 None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:35.197164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ee78e-1092-490e-9374-97957fd27202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:35.197755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ee78e-1092-490e-9374-97957fd27202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:35.200327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ee78e-1092-490e-9374-97957fd27202 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:35.222549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 627/1266] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:35.229583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f53ba4-9419-4b0f-b488-5c76c2fe46e5 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:35.339101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f53ba4-9419-4b0f-b488-5c76c2fe46e5 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:35.360188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:35.374938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ca55d-6db5-4819-b12c-29638846170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:35.375769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ca55d-6db5-4819-b12c-29638846170f None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:35.376053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ca55d-6db5-4819-b12c-29638846170f None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:35.376333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ca55d-6db5-4819-b12c-29638846170f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:35.384937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ca55d-6db5-4819-b12c-29638846170f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:35.386441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ca55d-6db5-4819-b12c-29638846170f None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-e88ca55d-6db5-4819-b12c-29638846170f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:10:35.402120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:35.403305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:35.404695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:35.404695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:35.404695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:10:35.404695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:10:35.404695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:10:35.404695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:10:35.404695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:10:35.404695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:10:35.404695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 07 07:10:35.404695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:35.404695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 640/1267] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:35.409559 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee78e-1092-490e-9374-97957fd27202 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:35.519711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee78e-1092-490e-9374-97957fd27202 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:35.556922 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58259e4-02b0-4085-87ca-ea2310f7f5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:35.557641 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58259e4-02b0-4085-87ca-ea2310f7f5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:35.557926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58259e4-02b0-4085-87ca-ea2310f7f5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:35.558207 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58259e4-02b0-4085-87ca-ea2310f7f5d2 None admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:35.559055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58259e4-02b0-4085-87ca-ea2310f7f5d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:35.559364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58259e4-02b0-4085-87ca-ea2310f7f5d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:35.560813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58259e4-02b0-4085-87ca-ea2310f7f5d2 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:35.571814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:35.581838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 628/1268] 10.222.0.62 () {56 vars in 1143 bytes} [Thu Jul 7 07:10:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:35.587913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ca55d-6db5-4819-b12c-29638846170f None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:35.697784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ca55d-6db5-4819-b12c-29638846170f None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:35.732029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f454d-8844-4504-9ce0-f67dc2b85c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:35.732821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f454d-8844-4504-9ce0-f67dc2b85c22 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:35.733100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f454d-8844-4504-9ce0-f67dc2b85c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:35.733406 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f454d-8844-4504-9ce0-f67dc2b85c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:35.744268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f454d-8844-4504-9ce0-f67dc2b85c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:35.745745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f454d-8844-4504-9ce0-f67dc2b85c22 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-5f4f454d-8844-4504-9ce0-f67dc2b85c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:35.762677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:35.763802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:35.764729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:35.764729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:35.764729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:35.764729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:35.764729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 641/1269] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:35.769982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58259e4-02b0-4085-87ca-ea2310f7f5d2 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:35.891606 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58259e4-02b0-4085-87ca-ea2310f7f5d2 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:35.927211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf38eed-d200-460c-8870-6ebcb8e52e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:35.927875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf38eed-d200-460c-8870-6ebcb8e52e0f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:35.928160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf38eed-d200-460c-8870-6ebcb8e52e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:35.928435 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf38eed-d200-460c-8870-6ebcb8e52e0f None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:35.929172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf38eed-d200-460c-8870-6ebcb8e52e0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:35.929514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf38eed-d200-460c-8870-6ebcb8e52e0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:35.930931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf38eed-d200-460c-8870-6ebcb8e52e0f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:35.943313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 629/1270] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:35.949675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f454d-8844-4504-9ce0-f67dc2b85c22 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:35.992245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:36.066566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f454d-8844-4504-9ce0-f67dc2b85c22 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:36.104432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4e00f-1b09-45de-84b5-e84e092d2717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:36.105299 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e00f-1b09-45de-84b5-e84e092d2717 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:36.105691 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e00f-1b09-45de-84b5-e84e092d2717 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:36.105832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e00f-1b09-45de-84b5-e84e092d2717 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:36.113951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4e00f-1b09-45de-84b5-e84e092d2717 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:36.115897 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4e00f-1b09-45de-84b5-e84e092d2717 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-38c4e00f-1b09-45de-84b5-e84e092d2717 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:10:36.134286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:36.135397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:36.136332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:10:36.136332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:10:36.136332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:10:36.136332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:10:36.136332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:10:36.136332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:10:36.136332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:10:36.136332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:36.136332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 642/1271] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:10:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:36.145108 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf38eed-d200-460c-8870-6ebcb8e52e0f None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:36.213932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:36.259774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf38eed-d200-460c-8870-6ebcb8e52e0f None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:36.298295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be66b51-df90-4504-ae03-61e30451f9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:36.298970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be66b51-df90-4504-ae03-61e30451f9fb None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:36.299256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be66b51-df90-4504-ae03-61e30451f9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:36.299533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be66b51-df90-4504-ae03-61e30451f9fb None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:36.300328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be66b51-df90-4504-ae03-61e30451f9fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:36.300642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be66b51-df90-4504-ae03-61e30451f9fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:36.302249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be66b51-df90-4504-ae03-61e30451f9fb None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:36.315538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 630/1272] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:10:36.321874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4e00f-1b09-45de-84b5-e84e092d2717 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:36.417847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:36.427323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4e00f-1b09-45de-84b5-e84e092d2717 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:36.466568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca563ae-d203-4dfd-8995-91bc19d581cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:36.467536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca563ae-d203-4dfd-8995-91bc19d581cb None admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:36.467805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca563ae-d203-4dfd-8995-91bc19d581cb None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:36.468108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca563ae-d203-4dfd-8995-91bc19d581cb None admin] PATH_INFO: `/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/bd80f27a4499407d8c350f2908638334/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:36.470197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca563ae-d203-4dfd-8995-91bc19d581cb None admin] RBAC: Authorizing `identity:create_grant(project_id=2d7163b6caf648d89fd2cd48f27b1a23, user_id=bd80f27a4499407d8c350f2908638334, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:36.471620 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca563ae-d203-4dfd-8995-91bc19d581cb None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:36.486037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 643/1273] 10.222.0.62 () {58 vars in 1439 bytes} [Thu Jul 7 07:10:36 2022] PUT /identity/v3/projects/2d7163b6caf648d89fd2cd48f27b1a23/users/bd80f27a4499407d8c350f2908638334/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:10:38.511005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd370c5c-5387-4ee8-9143-d35a2b9e23f3 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:38.511603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd370c5c-5387-4ee8-9143-d35a2b9e23f3 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:38.511603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd370c5c-5387-4ee8-9143-d35a2b9e23f3 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:38.513140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 631/1274] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:10:38.519501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c5cf8-6aad-424e-ad9d-184db940f26f None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:38.520124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c5cf8-6aad-424e-ad9d-184db940f26f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:38.520124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c5cf8-6aad-424e-ad9d-184db940f26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:38.538627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-534c5cf8-6aad-424e-ad9d-184db940f26f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:10:38.539868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-534c5cf8-6aad-424e-ad9d-184db940f26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:10:38.615878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 644/1275] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:10:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:10:38.641663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd370c5c-5387-4ee8-9143-d35a2b9e23f3 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:38.786000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd370c5c-5387-4ee8-9143-d35a2b9e23f3 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:38.810839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:38.831824 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf920737-5722-431e-9f48-cc38cee1aa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:38.832647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf920737-5722-431e-9f48-cc38cee1aa75 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:38.832929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf920737-5722-431e-9f48-cc38cee1aa75 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:38.833207 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf920737-5722-431e-9f48-cc38cee1aa75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:38.845790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf920737-5722-431e-9f48-cc38cee1aa75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-cf920737-5722-431e-9f48-cc38cee1aa75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 07:10:38.853946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:38.855215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:38.856256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 632/1276] 10.222.0.62 () {56 vars in 1096 bytes} [Thu Jul 7 07:10:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:38.861799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c5cf8-6aad-424e-ad9d-184db940f26f None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:38.959313 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:38.989874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c5cf8-6aad-424e-ad9d-184db940f26f None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:39.038350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436a5d4-630c-46f0-9e5c-e0e6ba5d17d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:39.039063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436a5d4-630c-46f0-9e5c-e0e6ba5d17d9 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:39.039348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436a5d4-630c-46f0-9e5c-e0e6ba5d17d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:39.039627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436a5d4-630c-46f0-9e5c-e0e6ba5d17d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:39.040409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436a5d4-630c-46f0-9e5c-e0e6ba5d17d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:39.040720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436a5d4-630c-46f0-9e5c-e0e6ba5d17d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:39.042984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436a5d4-630c-46f0-9e5c-e0e6ba5d17d9 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:39.054699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 645/1277] 10.222.0.62 () {56 vars in 1099 bytes} [Thu Jul 7 07:10:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:39.062918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf920737-5722-431e-9f48-cc38cee1aa75 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:39.185419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf920737-5722-431e-9f48-cc38cee1aa75 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:39.225146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af501df5-aca6-4258-a80f-88cc1f58bdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:39.225987 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af501df5-aca6-4258-a80f-88cc1f58bdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:39.226270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af501df5-aca6-4258-a80f-88cc1f58bdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:39.226547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af501df5-aca6-4258-a80f-88cc1f58bdd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:39.239107 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af501df5-aca6-4258-a80f-88cc1f58bdd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:39.240720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af501df5-aca6-4258-a80f-88cc1f58bdd9 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-af501df5-aca6-4258-a80f-88cc1f58bdd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:39.259017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:39.260678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:39.263063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:39.263063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:39.263063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:39.263063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:39.263063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 633/1278] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:39.267688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436a5d4-630c-46f0-9e5c-e0e6ba5d17d9 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:39.436132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436a5d4-630c-46f0-9e5c-e0e6ba5d17d9 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:39.505888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b365c4-6b68-4e2a-9777-80d203c011ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:39.506632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b365c4-6b68-4e2a-9777-80d203c011ee None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:39.506954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b365c4-6b68-4e2a-9777-80d203c011ee None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:39.507430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b365c4-6b68-4e2a-9777-80d203c011ee None admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:39.508234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b365c4-6b68-4e2a-9777-80d203c011ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:39.508587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b365c4-6b68-4e2a-9777-80d203c011ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:39.510040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b365c4-6b68-4e2a-9777-80d203c011ee None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:39.524868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 646/1279] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:39.530872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af501df5-aca6-4258-a80f-88cc1f58bdd9 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:39.566779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:39.654364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af501df5-aca6-4258-a80f-88cc1f58bdd9 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:39.695216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3d2ac-3a6f-4a39-a82b-0cf7889ff4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:39.695981 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3d2ac-3a6f-4a39-a82b-0cf7889ff4ac None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:39.696253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3d2ac-3a6f-4a39-a82b-0cf7889ff4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:39.696535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3d2ac-3a6f-4a39-a82b-0cf7889ff4ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:39.705771 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3d2ac-3a6f-4a39-a82b-0cf7889ff4ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:39.707445 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3d2ac-3a6f-4a39-a82b-0cf7889ff4ac None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-38e3d2ac-3a6f-4a39-a82b-0cf7889ff4ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 07:10:39.723405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:39.724555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:39.725572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:39.725572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:39.725572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 07:10:39.725572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 07:10:39.725572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 07:10:39.725572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 07:10:39.725572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 07:10:39.725572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 07:10:39.725572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 07 07:10:39.725572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:39.725572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 634/1280] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:39.731349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b365c4-6b68-4e2a-9777-80d203c011ee None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:39.737415 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:39.846296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b365c4-6b68-4e2a-9777-80d203c011ee None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:39.885153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9c6cb-6df8-4380-b60e-5d7d97d8ef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:39.885885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9c6cb-6df8-4380-b60e-5d7d97d8ef20 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:39.886166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9c6cb-6df8-4380-b60e-5d7d97d8ef20 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:39.886439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9c6cb-6df8-4380-b60e-5d7d97d8ef20 None admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:39.887342 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9c6cb-6df8-4380-b60e-5d7d97d8ef20 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:39.887647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9c6cb-6df8-4380-b60e-5d7d97d8ef20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:39.889209 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9c6cb-6df8-4380-b60e-5d7d97d8ef20 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:39.910732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 647/1281] 10.222.0.62 () {56 vars in 1143 bytes} [Thu Jul 7 07:10:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:39.920644 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3d2ac-3a6f-4a39-a82b-0cf7889ff4ac None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:40.072058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:40.083269 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3d2ac-3a6f-4a39-a82b-0cf7889ff4ac None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:40.123562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0585ae5-a052-4101-a25a-21a1cfbbe2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:40.124236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0585ae5-a052-4101-a25a-21a1cfbbe2db None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:40.124523 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0585ae5-a052-4101-a25a-21a1cfbbe2db None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:40.124802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0585ae5-a052-4101-a25a-21a1cfbbe2db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:40.207536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0585ae5-a052-4101-a25a-21a1cfbbe2db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:40.209273 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0585ae5-a052-4101-a25a-21a1cfbbe2db None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:40.310622 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:40.323912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 635/1282] 10.222.0.62 () {58 vars in 1282 bytes} [Thu Jul 7 07:10:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 07:10:40.330160 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9c6cb-6df8-4380-b60e-5d7d97d8ef20 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:40.401393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:40.446922 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9c6cb-6df8-4380-b60e-5d7d97d8ef20 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:40.487051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fc585-e438-42fc-bb46-f58ce1a92a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:40.487910 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fc585-e438-42fc-bb46-f58ce1a92a0e None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:40.488198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fc585-e438-42fc-bb46-f58ce1a92a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:40.488477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fc585-e438-42fc-bb46-f58ce1a92a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:40.505952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fc585-e438-42fc-bb46-f58ce1a92a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:40.505952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fc585-e438-42fc-bb46-f58ce1a92a0e None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-a27fc585-e438-42fc-bb46-f58ce1a92a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 07:10:40.523944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:40.525537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:40.526605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 07:10:40.526605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 07:10:40.526605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 07:10:40.526605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:40.526605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 648/1283] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:40.532240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0585ae5-a052-4101-a25a-21a1cfbbe2db None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:40.651076 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0585ae5-a052-4101-a25a-21a1cfbbe2db None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:40.704707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e967124-5a6b-4f49-b003-ee62f51ad39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:40.705437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e967124-5a6b-4f49-b003-ee62f51ad39b None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:40.705731 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e967124-5a6b-4f49-b003-ee62f51ad39b None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:40.706012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e967124-5a6b-4f49-b003-ee62f51ad39b None admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:40.706799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e967124-5a6b-4f49-b003-ee62f51ad39b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:40.707108 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e967124-5a6b-4f49-b003-ee62f51ad39b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:40.708689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e967124-5a6b-4f49-b003-ee62f51ad39b None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:40.723054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 636/1284] 10.222.0.62 () {56 vars in 1109 bytes} [Thu Jul 7 07:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:40.729723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fc585-e438-42fc-bb46-f58ce1a92a0e None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:40.847815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fc585-e438-42fc-bb46-f58ce1a92a0e None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:40.865057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:40.887362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac999ad-e261-4bd8-85ad-0e31a896ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:40.888258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac999ad-e261-4bd8-85ad-0e31a896ba68 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:40.888537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac999ad-e261-4bd8-85ad-0e31a896ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:40.888784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac999ad-e261-4bd8-85ad-0e31a896ba68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:40.896666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac999ad-e261-4bd8-85ad-0e31a896ba68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:40.898252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac999ad-e261-4bd8-85ad-0e31a896ba68 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application [None req-1ac999ad-e261-4bd8-85ad-0e31a896ba68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 07:10:40.913327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:40.914289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:40.915575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 07:10:40.915575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 07:10:40.915575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 07:10:40.915575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 07:10:40.915575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 07:10:40.915575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 07:10:40.915575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 07:10:40.915575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: ERROR keystone.server.flask.application Jul 07 07:10:40.915575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 649/1285] 10.222.0.62 () {56 vars in 1111 bytes} [Thu Jul 7 07:10:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:40.920841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e967124-5a6b-4f49-b003-ee62f51ad39b None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:40.979487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:41.033629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e967124-5a6b-4f49-b003-ee62f51ad39b None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:41.068650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9127b-1047-4d07-99e2-f14ad74c5be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:41.069345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9127b-1047-4d07-99e2-f14ad74c5be8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:41.069627 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9127b-1047-4d07-99e2-f14ad74c5be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:41.069904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9127b-1047-4d07-99e2-f14ad74c5be8 None admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:41.070701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9127b-1047-4d07-99e2-f14ad74c5be8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:41.071012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9127b-1047-4d07-99e2-f14ad74c5be8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:41.072578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9127b-1047-4d07-99e2-f14ad74c5be8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:41.088828 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 637/1286] 10.222.0.62 () {56 vars in 1148 bytes} [Thu Jul 7 07:10:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:41.095655 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac999ad-e261-4bd8-85ad-0e31a896ba68 None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:41.206775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac999ad-e261-4bd8-85ad-0e31a896ba68 None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:41.242918 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b913cf-5ddd-4f8c-8a80-ed834f768e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:41.243597 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b913cf-5ddd-4f8c-8a80-ed834f768e2a None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:41.243880 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b913cf-5ddd-4f8c-8a80-ed834f768e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:41.244159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b913cf-5ddd-4f8c-8a80-ed834f768e2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:41.245012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b913cf-5ddd-4f8c-8a80-ed834f768e2a None admin] RBAC: Adding query filter params (role.id=7e74783d36c14c6bbb1e28c75c1c0aea, scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23, user.id=bd80f27a4499407d8c350f2908638334) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:41.245354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b913cf-5ddd-4f8c-8a80-ed834f768e2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:41.246827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b913cf-5ddd-4f8c-8a80-ed834f768e2a None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:41.253670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 650/1287] 10.222.0.62 () {56 vars in 1374 bytes} [Thu Jul 7 07:10:41 2022] GET /identity/v3/role_assignments?user.id=bd80f27a4499407d8c350f2908638334&scope.project.id=2d7163b6caf648d89fd2cd48f27b1a23&role.id=7e74783d36c14c6bbb1e28c75c1c0aea => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:10:43.377089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a7dde-f76a-467c-a8e1-aa5f45008577 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:43.377732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a7dde-f76a-467c-a8e1-aa5f45008577 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:43.377827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a7dde-f76a-467c-a8e1-aa5f45008577 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:43.379354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 638/1288] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:10:43.385821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c6f35-a4c9-4bbc-880e-f4689dbb2980 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:43.386328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c6f35-a4c9-4bbc-880e-f4689dbb2980 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:43.386449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c6f35-a4c9-4bbc-880e-f4689dbb2980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:43.404015 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-733c6f35-a4c9-4bbc-880e-f4689dbb2980 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:10:43.405261 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-733c6f35-a4c9-4bbc-880e-f4689dbb2980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:10:43.437023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:43.476848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 651/1289] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:10:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:10:43.499992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a7dde-f76a-467c-a8e1-aa5f45008577 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:43.610303 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a7dde-f76a-467c-a8e1-aa5f45008577 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:43.621858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:43.647828 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16be682-bd15-4b3c-af19-d0f89b09ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:43.648552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16be682-bd15-4b3c-af19-d0f89b09ad2f None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:43.648836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16be682-bd15-4b3c-af19-d0f89b09ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:43.649111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16be682-bd15-4b3c-af19-d0f89b09ad2f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:43.649798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16be682-bd15-4b3c-af19-d0f89b09ad2f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:43.651193 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16be682-bd15-4b3c-af19-d0f89b09ad2f None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-f16be682-bd15-4b3c-af19-d0f89b09ad2f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:43.663901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:43.665121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:43.666011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 639/1290] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Jul 7 07:10:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:43.671389 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c6f35-a4c9-4bbc-880e-f4689dbb2980 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:43.786848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c6f35-a4c9-4bbc-880e-f4689dbb2980 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:43.822651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe62a99-08b9-4418-b5a1-80ba1f8ae3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:43.823308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe62a99-08b9-4418-b5a1-80ba1f8ae3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:43.823593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe62a99-08b9-4418-b5a1-80ba1f8ae3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:43.823864 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe62a99-08b9-4418-b5a1-80ba1f8ae3e8 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:43.824583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe62a99-08b9-4418-b5a1-80ba1f8ae3e8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:43.824889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe62a99-08b9-4418-b5a1-80ba1f8ae3e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:43.826324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe62a99-08b9-4418-b5a1-80ba1f8ae3e8 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:43.832049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 652/1291] 10.222.0.62 () {56 vars in 1116 bytes} [Thu Jul 7 07:10:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:43.838387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16be682-bd15-4b3c-af19-d0f89b09ad2f None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:43.953815 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16be682-bd15-4b3c-af19-d0f89b09ad2f None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:43.993923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15030f4a-edfc-44d5-b945-e001fbc35289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:43.994597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15030f4a-edfc-44d5-b945-e001fbc35289 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:43.994874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15030f4a-edfc-44d5-b945-e001fbc35289 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:43.995148 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15030f4a-edfc-44d5-b945-e001fbc35289 None admin] PATH_INFO: `/v3/services` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:43.995861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15030f4a-edfc-44d5-b945-e001fbc35289 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:43.996167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15030f4a-edfc-44d5-b945-e001fbc35289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:43.997594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15030f4a-edfc-44d5-b945-e001fbc35289 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:44.002838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 640/1292] 10.222.0.62 () {56 vars in 1116 bytes} [Thu Jul 7 07:10:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:46.036707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e145-99c8-49e6-8fe6-90ace1658c2e None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:46.037342 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e145-99c8-49e6-8fe6-90ace1658c2e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:46.037342 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e145-99c8-49e6-8fe6-90ace1658c2e None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:46.038738 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 653/1293] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:10:46.044259 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d317-c96d-4031-9647-4a7bdb8f857c None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:46.044695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d317-c96d-4031-9647-4a7bdb8f857c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:46.044787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d317-c96d-4031-9647-4a7bdb8f857c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:46.063923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-6e57d317-c96d-4031-9647-4a7bdb8f857c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:10:46.065457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6e57d317-c96d-4031-9647-4a7bdb8f857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:10:46.097387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:46.141336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 641/1294] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:10:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:10:46.168926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2e145-99c8-49e6-8fe6-90ace1658c2e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:46.207671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:46.283992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2e145-99c8-49e6-8fe6-90ace1658c2e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:46.321603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e443469-e1e9-442b-bf30-c95201be8376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:46.322278 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e443469-e1e9-442b-bf30-c95201be8376 None admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:46.322567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e443469-e1e9-442b-bf30-c95201be8376 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:46.322846 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e443469-e1e9-442b-bf30-c95201be8376 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:46.323572 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e443469-e1e9-442b-bf30-c95201be8376 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:46.324963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e443469-e1e9-442b-bf30-c95201be8376 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:46.341749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 654/1295] 10.222.0.62 () {60 vars in 1141 bytes} [Thu Jul 7 07:10:46 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:10:48.366679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c31d7-9538-4e47-9caa-7c6c2d1f06f5 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:48.367265 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c31d7-9538-4e47-9caa-7c6c2d1f06f5 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:48.367265 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c31d7-9538-4e47-9caa-7c6c2d1f06f5 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:48.368659 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 642/1296] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:10:48.376215 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2578f-3337-442e-b198-fd16303eab4c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:48.376947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2578f-3337-442e-b198-fd16303eab4c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:48.377122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2578f-3337-442e-b198-fd16303eab4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:48.401399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a5e2578f-3337-442e-b198-fd16303eab4c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:10:48.402616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a5e2578f-3337-442e-b198-fd16303eab4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:10:48.495230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 655/1297] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:10:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 07:10:48.519101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c31d7-9538-4e47-9caa-7c6c2d1f06f5 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:48.634004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c31d7-9538-4e47-9caa-7c6c2d1f06f5 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:48.676135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c5a78-4fe1-4dd2-bde1-f1f6f6a4739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:48.676943 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c5a78-4fe1-4dd2-bde1-f1f6f6a4739c None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:48.677248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c5a78-4fe1-4dd2-bde1-f1f6f6a4739c None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:48.677595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c5a78-4fe1-4dd2-bde1-f1f6f6a4739c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:48.678251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c5a78-4fe1-4dd2-bde1-f1f6f6a4739c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:48.679628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c5a78-4fe1-4dd2-bde1-f1f6f6a4739c None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-861c5a78-4fe1-4dd2-bde1-f1f6f6a4739c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:48.691969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:48.694366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:48.695645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 643/1298] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Jul 7 07:10:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:48.699865 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2578f-3337-442e-b198-fd16303eab4c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:48.720542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:48.810120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2578f-3337-442e-b198-fd16303eab4c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:48.847511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea939c-1de9-49f6-905a-09838f4138db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:48.848181 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea939c-1de9-49f6-905a-09838f4138db None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:48.848509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea939c-1de9-49f6-905a-09838f4138db None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:48.848782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea939c-1de9-49f6-905a-09838f4138db None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:48.849533 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea939c-1de9-49f6-905a-09838f4138db None admin] RBAC: Adding query filter params (name=placement) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:48.849842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea939c-1de9-49f6-905a-09838f4138db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:48.851244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea939c-1de9-49f6-905a-09838f4138db None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:48.857193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 656/1299] 10.222.0.62 () {56 vars in 1116 bytes} [Thu Jul 7 07:10:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:48.865248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c5a78-4fe1-4dd2-bde1-f1f6f6a4739c None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:48.906393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:48.987142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c5a78-4fe1-4dd2-bde1-f1f6f6a4739c None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:49.026230 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f762845-1241-49cc-b8f2-d8f02b40d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:49.026905 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f762845-1241-49cc-b8f2-d8f02b40d203 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:49.027190 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f762845-1241-49cc-b8f2-d8f02b40d203 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:49.027470 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f762845-1241-49cc-b8f2-d8f02b40d203 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:49.028250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f762845-1241-49cc-b8f2-d8f02b40d203 None admin] RBAC: Adding query filter params (interface=public, service_id=0c23450ed8de4438a3ff576de54ee06f, region_id=RegionOne) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:49.028564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f762845-1241-49cc-b8f2-d8f02b40d203 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:49.030053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f762845-1241-49cc-b8f2-d8f02b40d203 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:49.036103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 644/1300] 10.222.0.62 () {56 vars in 1251 bytes} [Thu Jul 7 07:10:48 2022] GET /identity/v3/endpoints?service_id=0c23450ed8de4438a3ff576de54ee06f&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:49.042057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea939c-1de9-49f6-905a-09838f4138db None admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:49.149471 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:49.172001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea939c-1de9-49f6-905a-09838f4138db None admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:49.217904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92501df-1677-4f08-8f14-dbd867ce7723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:49.218568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92501df-1677-4f08-8f14-dbd867ce7723 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:49.218844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92501df-1677-4f08-8f14-dbd867ce7723 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:49.219098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92501df-1677-4f08-8f14-dbd867ce7723 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:49.220192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92501df-1677-4f08-8f14-dbd867ce7723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:49.222705 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92501df-1677-4f08-8f14-dbd867ce7723 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:49.231722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 657/1301] 10.222.0.62 () {56 vars in 1087 bytes} [Thu Jul 7 07:10:49 2022] GET /identity/v3/services => generated 2191 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:10:51.263734 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f1423-f427-482a-a2fc-546c0d8abdf7 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:51.264341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f1423-f427-482a-a2fc-546c0d8abdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:51.264341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f1423-f427-482a-a2fc-546c0d8abdf7 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:51.265697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 645/1302] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:10:51.271613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e181aca-0aa2-4518-bb2d-31ca18aea4c6 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:51.272110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e181aca-0aa2-4518-bb2d-31ca18aea4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:51.272110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e181aca-0aa2-4518-bb2d-31ca18aea4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:51.289521 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-7e181aca-0aa2-4518-bb2d-31ca18aea4c6 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:10:51.290739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7e181aca-0aa2-4518-bb2d-31ca18aea4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:10:51.364908 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 658/1303] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:10:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 07:10:51.389165 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f1423-f427-482a-a2fc-546c0d8abdf7 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:51.493915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:51.501513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f1423-f427-482a-a2fc-546c0d8abdf7 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:51.537296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7e3a1-d85d-4330-9ca1-424ee844bbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:51.538134 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7e3a1-d85d-4330-9ca1-424ee844bbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:51.538419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7e3a1-d85d-4330-9ca1-424ee844bbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:51.538697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7e3a1-d85d-4330-9ca1-424ee844bbc8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:51.539470 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7e3a1-d85d-4330-9ca1-424ee844bbc8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:51.540774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7e3a1-d85d-4330-9ca1-424ee844bbc8 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application [None req-11f7e3a1-d85d-4330-9ca1-424ee844bbc8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 07:10:51.554048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 07:10:51.555321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application with Lock( Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self._enter() Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application return self.creator() Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application created_value = creator( Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: ERROR keystone.server.flask.application Jul 07 07:10:51.556346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 646/1304] 10.222.0.62 () {56 vars in 1117 bytes} [Thu Jul 7 07:10:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 07:10:51.561724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e181aca-0aa2-4518-bb2d-31ca18aea4c6 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:51.648441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:10:51.674273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e181aca-0aa2-4518-bb2d-31ca18aea4c6 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:51.710283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fff579-a412-409f-9d1e-881edf5f3f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:51.710945 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fff579-a412-409f-9d1e-881edf5f3f54 None admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:51.711222 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fff579-a412-409f-9d1e-881edf5f3f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:51.711488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fff579-a412-409f-9d1e-881edf5f3f54 None admin] PATH_INFO: `/v3/services` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:51.712198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fff579-a412-409f-9d1e-881edf5f3f54 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:10:51.712498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fff579-a412-409f-9d1e-881edf5f3f54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:51.713914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fff579-a412-409f-9d1e-881edf5f3f54 None admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:51.719458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 659/1305] 10.222.0.62 () {56 vars in 1116 bytes} [Thu Jul 7 07:10:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:10:51.726955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7e3a1-d85d-4330-9ca1-424ee844bbc8 None admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:10:51.831314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7e3a1-d85d-4330-9ca1-424ee844bbc8 None admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:10:51.870213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05c838-1069-4569-b1dc-8193a953b908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:10:51.870886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05c838-1069-4569-b1dc-8193a953b908 None admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:10:51.871169 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05c838-1069-4569-b1dc-8193a953b908 None admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:10:51.871449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05c838-1069-4569-b1dc-8193a953b908 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:10:51.872197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05c838-1069-4569-b1dc-8193a953b908 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:10:51.873612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05c838-1069-4569-b1dc-8193a953b908 None admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:10:51.896062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 647/1306] 10.222.0.62 () {60 vars in 1144 bytes} [Thu Jul 7 07:10:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:11:01.716303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=30 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:11:01.892375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:11:55.920231 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a9e63-2f45-4f68-9344-da8236439079 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:11:55.920957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a9e63-2f45-4f68-9344-da8236439079 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:11:55.920957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a9e63-2f45-4f68-9344-da8236439079 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:11:55.922405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 660/1307] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:11:55.927889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89b000-b83b-4dbc-99dd-f4bd36e5870b None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:11:55.928278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89b000-b83b-4dbc-99dd-f4bd36e5870b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:11:55.928486 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89b000-b83b-4dbc-99dd-f4bd36e5870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:11:56.073022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1d89b000-b83b-4dbc-99dd-f4bd36e5870b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:11:56.074368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1d89b000-b83b-4dbc-99dd-f4bd36e5870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:11:56.201172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 648/1308] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:11:56.256856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de582a01-8cca-4b33-8faa-c296e571e729 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:11:56.257149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de582a01-8cca-4b33-8faa-c296e571e729 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:11:56.257670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de582a01-8cca-4b33-8faa-c296e571e729 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:11:56.259373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 661/1309] 10.222.0.62 () {54 vars in 964 bytes} [Thu Jul 7 07:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:11:56.268348 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543d8c2-2bff-4c36-aa2a-c32f391614fe None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:11:56.268749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543d8c2-2bff-4c36-aa2a-c32f391614fe None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:11:56.269131 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543d8c2-2bff-4c36-aa2a-c32f391614fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:11:56.349653 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-4543d8c2-2bff-4c36-aa2a-c32f391614fe None None] MFA Rules not processed for user `4d0c6b46b5d248e5bed2b1bbdfa74f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:11:56.351156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4543d8c2-2bff-4c36-aa2a-c32f391614fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:11:56.374357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:11:56.442916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 649/1310] 10.222.0.62 () {58 vars in 1061 bytes} [Thu Jul 7 07:11:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:11:56.452193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de582a01-8cca-4b33-8faa-c296e571e729 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:11:56.454150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-de582a01-8cca-4b33-8faa-c296e571e729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:11:56.570570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de582a01-8cca-4b33-8faa-c296e571e729 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:11:56.652478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a7c4c-ecf3-40ab-87cc-99ee600d5329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:11:56.653532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a7c4c-ecf3-40ab-87cc-99ee600d5329 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:11:56.653807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a7c4c-ecf3-40ab-87cc-99ee600d5329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:11:56.654127 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a7c4c-ecf3-40ab-87cc-99ee600d5329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:11:56.656606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d23a7c4c-ecf3-40ab-87cc-99ee600d5329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:11:56.714775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:11:56.782011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a7c4c-ecf3-40ab-87cc-99ee600d5329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:11:56.783684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a7c4c-ecf3-40ab-87cc-99ee600d5329 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:11:56.806199 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 662/1311] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:11:59.135912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a22f0-8c00-4dde-96be-8d20e0701ca5 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:11:59.136503 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a22f0-8c00-4dde-96be-8d20e0701ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:11:59.136503 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a22f0-8c00-4dde-96be-8d20e0701ca5 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:11:59.138734 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 650/1312] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:11:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:11:59.144920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b23105-c0c3-45fe-bf46-8a1798b632b3 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:11:59.146047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b23105-c0c3-45fe-bf46-8a1798b632b3 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:11:59.146345 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b23105-c0c3-45fe-bf46-8a1798b632b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:11:59.225705 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e4b23105-c0c3-45fe-bf46-8a1798b632b3 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:11:59.226928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e4b23105-c0c3-45fe-bf46-8a1798b632b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:11:59.333050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 663/1313] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:11:59.371836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a22f0-8c00-4dde-96be-8d20e0701ca5 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:11:59.373487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-974a22f0-8c00-4dde-96be-8d20e0701ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:11:59.486849 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a22f0-8c00-4dde-96be-8d20e0701ca5 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:11:59.555875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:11:59.558720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33374c54-1a53-41f5-9c71-7270e44f0f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:11:59.559379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374c54-1a53-41f5-9c71-7270e44f0f0d service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:11:59.559665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374c54-1a53-41f5-9c71-7270e44f0f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:11:59.559944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374c54-1a53-41f5-9c71-7270e44f0f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:11:59.562204 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-33374c54-1a53-41f5-9c71-7270e44f0f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:11:59.682873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33374c54-1a53-41f5-9c71-7270e44f0f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:11:59.684228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33374c54-1a53-41f5-9c71-7270e44f0f0d service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:11:59.703869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 651/1314] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:02.058729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99613d00-8aed-4279-acdb-c6cb2930e56e None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:02.059273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99613d00-8aed-4279-acdb-c6cb2930e56e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:02.059273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99613d00-8aed-4279-acdb-c6cb2930e56e None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:02.060715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 664/1315] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:02.067042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5481d4-07c0-43f7-a1c9-391b35a2660f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:02.067695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5481d4-07c0-43f7-a1c9-391b35a2660f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:02.067695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5481d4-07c0-43f7-a1c9-391b35a2660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:02.142734 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-4e5481d4-07c0-43f7-a1c9-391b35a2660f None None] MFA Rules not processed for user `4b27b1bc486d4913b619fc0b63c6c425`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:02.143931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4e5481d4-07c0-43f7-a1c9-391b35a2660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:02.199173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:02.247554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 652/1316] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:02.301676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132d989-3588-4f9a-b44f-c1693bbdff37 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:02.302030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132d989-3588-4f9a-b44f-c1693bbdff37 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:02.302310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132d989-3588-4f9a-b44f-c1693bbdff37 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:02.303800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 665/1317] 10.222.0.62 () {54 vars in 964 bytes} [Thu Jul 7 07:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:02.310163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ae045-1e22-43c5-afde-f5ffa4b4ec3d None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:02.310548 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ae045-1e22-43c5-afde-f5ffa4b4ec3d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:02.310898 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ae045-1e22-43c5-afde-f5ffa4b4ec3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:02.393094 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-509ae045-1e22-43c5-afde-f5ffa4b4ec3d None None] MFA Rules not processed for user `4d0c6b46b5d248e5bed2b1bbdfa74f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:02.394365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-509ae045-1e22-43c5-afde-f5ffa4b4ec3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:02.477343 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 653/1318] 10.222.0.62 () {58 vars in 1061 bytes} [Thu Jul 7 07:12:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:02.486632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132d989-3588-4f9a-b44f-c1693bbdff37 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:02.488201 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8132d989-3588-4f9a-b44f-c1693bbdff37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:02.498761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:02.604565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132d989-3588-4f9a-b44f-c1693bbdff37 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:02.685069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00037d41-5282-4d4c-bbb2-aeba3692595d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:02.685761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00037d41-5282-4d4c-bbb2-aeba3692595d service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:02.686047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00037d41-5282-4d4c-bbb2-aeba3692595d service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:02.686325 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00037d41-5282-4d4c-bbb2-aeba3692595d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:02.688377 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-00037d41-5282-4d4c-bbb2-aeba3692595d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:02.768123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:02.818997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00037d41-5282-4d4c-bbb2-aeba3692595d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:02.820504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00037d41-5282-4d4c-bbb2-aeba3692595d service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:02.845569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 666/1319] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:05.792233 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afa37e-53b6-4f8f-a667-2c08d4c12fa9 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:05.793176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afa37e-53b6-4f8f-a667-2c08d4c12fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:05.793176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afa37e-53b6-4f8f-a667-2c08d4c12fa9 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:05.795524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 654/1320] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:05.801000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a0496-546c-4b5d-861f-1a5441eb5773 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:05.801462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a0496-546c-4b5d-861f-1a5441eb5773 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:05.801572 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a0496-546c-4b5d-861f-1a5441eb5773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:05.871679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-510a0496-546c-4b5d-861f-1a5441eb5773 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:05.872923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-510a0496-546c-4b5d-861f-1a5441eb5773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:05.982165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 667/1321] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:06.024167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afa37e-53b6-4f8f-a667-2c08d4c12fa9 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:06.026674 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-88afa37e-53b6-4f8f-a667-2c08d4c12fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:06.094273 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:06.153766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afa37e-53b6-4f8f-a667-2c08d4c12fa9 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:06.241727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5a363-efe7-4225-b78d-e06ba221df57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:06.242394 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5a363-efe7-4225-b78d-e06ba221df57 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:06.242675 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5a363-efe7-4225-b78d-e06ba221df57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:06.242949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5a363-efe7-4225-b78d-e06ba221df57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:06.244627 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-11b5a363-efe7-4225-b78d-e06ba221df57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:06.350111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:06.365529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5a363-efe7-4225-b78d-e06ba221df57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:06.366987 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5a363-efe7-4225-b78d-e06ba221df57 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:06.386644 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 655/1322] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:09.205270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164929c-b1c4-499f-83ff-bcaae0f61ad6 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:09.205858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164929c-b1c4-499f-83ff-bcaae0f61ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:09.205858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164929c-b1c4-499f-83ff-bcaae0f61ad6 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:09.207528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 668/1323] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:09.212985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b8c39-106f-433c-90c2-158ff2841718 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:09.213479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b8c39-106f-433c-90c2-158ff2841718 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:09.213592 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b8c39-106f-433c-90c2-158ff2841718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:09.283200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-3b2b8c39-106f-433c-90c2-158ff2841718 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:09.284893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3b2b8c39-106f-433c-90c2-158ff2841718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:09.400603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 656/1324] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:09.437937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164929c-b1c4-499f-83ff-bcaae0f61ad6 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:09.439564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d164929c-b1c4-499f-83ff-bcaae0f61ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:09.462221 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:09.568737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164929c-b1c4-499f-83ff-bcaae0f61ad6 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:09.647821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8af2d9-278c-4f2f-808e-578f8698e128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:09.648490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8af2d9-278c-4f2f-808e-578f8698e128 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:09.648778 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8af2d9-278c-4f2f-808e-578f8698e128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:09.649060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8af2d9-278c-4f2f-808e-578f8698e128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:09.650793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3e8af2d9-278c-4f2f-808e-578f8698e128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:09.728648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:09.769974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8af2d9-278c-4f2f-808e-578f8698e128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:09.771360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8af2d9-278c-4f2f-808e-578f8698e128 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:09.791797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 669/1325] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:11.913004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcad8e-478a-49db-b069-3a30a4f1ca11 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:11.913580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcad8e-478a-49db-b069-3a30a4f1ca11 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:11.913580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcad8e-478a-49db-b069-3a30a4f1ca11 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:11.914890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 657/1326] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:11.920521 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbc01c-bd64-4e98-b1e9-f0c176b0d412 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:11.920954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbc01c-bd64-4e98-b1e9-f0c176b0d412 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:11.921083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbc01c-bd64-4e98-b1e9-f0c176b0d412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:11.988380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-88fbc01c-bd64-4e98-b1e9-f0c176b0d412 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:11.989642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-88fbc01c-bd64-4e98-b1e9-f0c176b0d412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:12.091856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 670/1327] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:12.128036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcad8e-478a-49db-b069-3a30a4f1ca11 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:12.129738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0cbcad8e-478a-49db-b069-3a30a4f1ca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:12.194784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:12.245890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcad8e-478a-49db-b069-3a30a4f1ca11 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:12.332717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cbddf-8919-44ba-a757-a518b1c26f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:12.333437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cbddf-8919-44ba-a757-a518b1c26f5c service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:12.333723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cbddf-8919-44ba-a757-a518b1c26f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:12.334003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cbddf-8919-44ba-a757-a518b1c26f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:12.335803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d56cbddf-8919-44ba-a757-a518b1c26f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:12.469711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:12.472833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cbddf-8919-44ba-a757-a518b1c26f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:12.474722 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cbddf-8919-44ba-a757-a518b1c26f5c service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:12.500062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 658/1328] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:14.604395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f8ebe-2597-40ce-8603-b7c6c455bc6b None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:14.604966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f8ebe-2597-40ce-8603-b7c6c455bc6b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:14.604966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f8ebe-2597-40ce-8603-b7c6c455bc6b None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:14.606590 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 671/1329] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:14.612408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2adc91-4327-43ba-b885-9983d775d8ed None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:14.613018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2adc91-4327-43ba-b885-9983d775d8ed None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:14.613018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2adc91-4327-43ba-b885-9983d775d8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:14.698673 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-6d2adc91-4327-43ba-b885-9983d775d8ed None None] MFA Rules not processed for user `4b27b1bc486d4913b619fc0b63c6c425`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:14.699906 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6d2adc91-4327-43ba-b885-9983d775d8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:14.813124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 659/1330] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:14.852597 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f8ebe-2597-40ce-8603-b7c6c455bc6b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:14.854452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d73f8ebe-2597-40ce-8603-b7c6c455bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:14.889566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:14.975986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f8ebe-2597-40ce-8603-b7c6c455bc6b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:15.053088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe929b2-13be-473b-aa36-09f84cfc9134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:15.053776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe929b2-13be-473b-aa36-09f84cfc9134 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:15.054061 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe929b2-13be-473b-aa36-09f84cfc9134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:15.054332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe929b2-13be-473b-aa36-09f84cfc9134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:15.055996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3fe929b2-13be-473b-aa36-09f84cfc9134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:15.151758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:15.191262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe929b2-13be-473b-aa36-09f84cfc9134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:15.192818 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe929b2-13be-473b-aa36-09f84cfc9134 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:15.214950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 672/1331] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:17.573195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b31998-dadd-494c-8d4e-0ae5523f03e2 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:17.573762 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b31998-dadd-494c-8d4e-0ae5523f03e2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:17.573851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b31998-dadd-494c-8d4e-0ae5523f03e2 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:17.575440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 660/1332] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:17.581511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1230b-fe0b-4bb7-81e8-6c0853576bf8 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:17.581964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1230b-fe0b-4bb7-81e8-6c0853576bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:17.581964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1230b-fe0b-4bb7-81e8-6c0853576bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:17.660126 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ead1230b-fe0b-4bb7-81e8-6c0853576bf8 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:17.661327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ead1230b-fe0b-4bb7-81e8-6c0853576bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:17.776709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 673/1333] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:17.821716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b31998-dadd-494c-8d4e-0ae5523f03e2 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:17.823303 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-54b31998-dadd-494c-8d4e-0ae5523f03e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:17.899840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:17.938266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b31998-dadd-494c-8d4e-0ae5523f03e2 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:18.021537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dcaa2-3aeb-4dab-b65b-ad981dd1f193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:18.022223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dcaa2-3aeb-4dab-b65b-ad981dd1f193 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:18.022508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dcaa2-3aeb-4dab-b65b-ad981dd1f193 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:18.022787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dcaa2-3aeb-4dab-b65b-ad981dd1f193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:18.024463 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b58dcaa2-3aeb-4dab-b65b-ad981dd1f193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:18.143610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dcaa2-3aeb-4dab-b65b-ad981dd1f193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:18.145095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dcaa2-3aeb-4dab-b65b-ad981dd1f193 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:18.156104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:18.165855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 661/1334] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:20.298107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ba149-5c07-424f-9261-ead2fa1b6700 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:20.298701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ba149-5c07-424f-9261-ead2fa1b6700 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:20.298701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ba149-5c07-424f-9261-ead2fa1b6700 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:20.300543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 674/1335] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:20.306060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08ab03-025b-4dcb-abb0-7bf89b84bf52 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:20.306498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08ab03-025b-4dcb-abb0-7bf89b84bf52 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:20.306589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08ab03-025b-4dcb-abb0-7bf89b84bf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:20.373463 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-6e08ab03-025b-4dcb-abb0-7bf89b84bf52 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:20.374700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6e08ab03-025b-4dcb-abb0-7bf89b84bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:20.480569 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 662/1336] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:20.521004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ba149-5c07-424f-9261-ead2fa1b6700 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:20.522597 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0c3ba149-5c07-424f-9261-ead2fa1b6700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:20.569510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:20.636844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ba149-5c07-424f-9261-ead2fa1b6700 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:20.726255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1383880-e840-4e7c-8dfb-08dbcdc1f7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:20.726913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383880-e840-4e7c-8dfb-08dbcdc1f7af service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:20.727189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383880-e840-4e7c-8dfb-08dbcdc1f7af service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:20.727461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383880-e840-4e7c-8dfb-08dbcdc1f7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:20.729118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e1383880-e840-4e7c-8dfb-08dbcdc1f7af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:20.818355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:20.847378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1383880-e840-4e7c-8dfb-08dbcdc1f7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:20.849507 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1383880-e840-4e7c-8dfb-08dbcdc1f7af service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:20.875138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 675/1337] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:23.329501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e55155-f2d9-46fa-a93a-29bd437367fc None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:23.330253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e55155-f2d9-46fa-a93a-29bd437367fc None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:23.330253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e55155-f2d9-46fa-a93a-29bd437367fc None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:23.331537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 663/1338] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:12:23.337969 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01ee7-578d-4c72-bcb2-36b6fbd35a15 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:23.338522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01ee7-578d-4c72-bcb2-36b6fbd35a15 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:23.338639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01ee7-578d-4c72-bcb2-36b6fbd35a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:23.418319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-70d01ee7-578d-4c72-bcb2-36b6fbd35a15 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:23.419587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-70d01ee7-578d-4c72-bcb2-36b6fbd35a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:23.532477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 676/1339] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:12:23.571093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e55155-f2d9-46fa-a93a-29bd437367fc None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:23.573054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-65e55155-f2d9-46fa-a93a-29bd437367fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:23.666998 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:23.705070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e55155-f2d9-46fa-a93a-29bd437367fc None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:23.794487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428afd7-5de6-4466-b344-57f39e67f697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:23.795172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428afd7-5de6-4466-b344-57f39e67f697 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:23.795441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428afd7-5de6-4466-b344-57f39e67f697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:23.795728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428afd7-5de6-4466-b344-57f39e67f697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:23.797905 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1428afd7-5de6-4466-b344-57f39e67f697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:23.920485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428afd7-5de6-4466-b344-57f39e67f697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:23.921885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428afd7-5de6-4466-b344-57f39e67f697 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:23.942054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 664/1340] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:28.032326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759cedb-a898-410d-ba89-9ad1b42336ed None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:28.033068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759cedb-a898-410d-ba89-9ad1b42336ed None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:28.033068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759cedb-a898-410d-ba89-9ad1b42336ed None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:28.034693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 677/1341] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:28.040501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50cca-ca2c-4e19-bfc7-cfd1c3822de7 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:28.041576 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50cca-ca2c-4e19-bfc7-cfd1c3822de7 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:28.041576 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50cca-ca2c-4e19-bfc7-cfd1c3822de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:28.048262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:28.135737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e8d50cca-ca2c-4e19-bfc7-cfd1c3822de7 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:28.137662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e8d50cca-ca2c-4e19-bfc7-cfd1c3822de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:28.273404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 665/1342] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:12:28.312626 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759cedb-a898-410d-ba89-9ad1b42336ed None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:28.315712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f759cedb-a898-410d-ba89-9ad1b42336ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:28.380326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:28.447487 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759cedb-a898-410d-ba89-9ad1b42336ed None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:28.451471 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b268015-62e0-4a59-95f6-6e35f6894bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:28.452134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b268015-62e0-4a59-95f6-6e35f6894bcb service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:28.452418 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b268015-62e0-4a59-95f6-6e35f6894bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:28.452696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b268015-62e0-4a59-95f6-6e35f6894bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:28.462984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b268015-62e0-4a59-95f6-6e35f6894bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:28.464461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b268015-62e0-4a59-95f6-6e35f6894bcb service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:28.475398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 678/1343] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:31.368620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b9d6a-7ee0-4633-ae41-49e004a0c4a4 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:31.369335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b9d6a-7ee0-4633-ae41-49e004a0c4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:31.369335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b9d6a-7ee0-4633-ae41-49e004a0c4a4 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:31.370652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 666/1344] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:31.376510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef35a1-2edc-4c3f-a1b4-39ae1ad8724d None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:31.377192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef35a1-2edc-4c3f-a1b4-39ae1ad8724d None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:31.377192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef35a1-2edc-4c3f-a1b4-39ae1ad8724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:31.412492 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-f1ef35a1-2edc-4c3f-a1b4-39ae1ad8724d None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:31.413793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f1ef35a1-2edc-4c3f-a1b4-39ae1ad8724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:31.509529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 679/1345] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:31.548742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b9d6a-7ee0-4633-ae41-49e004a0c4a4 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:31.561584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b9d6a-7ee0-4633-ae41-49e004a0c4a4 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:31.566109 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72605c-a636-4106-bd8d-753d48f6f8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:31.566775 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72605c-a636-4106-bd8d-753d48f6f8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:31.567051 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72605c-a636-4106-bd8d-753d48f6f8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:31.567323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72605c-a636-4106-bd8d-753d48f6f8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:31.578495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72605c-a636-4106-bd8d-753d48f6f8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:31.579225 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72605c-a636-4106-bd8d-753d48f6f8b1 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:31.590114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 667/1346] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:35.936870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4fc86-e9c4-466e-a1e0-a738513f5b31 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:35.937512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4fc86-e9c4-466e-a1e0-a738513f5b31 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:35.937512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4fc86-e9c4-466e-a1e0-a738513f5b31 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:35.939290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 680/1347] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:35.945118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2a41c-b3a5-45f3-992b-7c9d89af1ae2 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:35.945699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2a41c-b3a5-45f3-992b-7c9d89af1ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:35.945699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2a41c-b3a5-45f3-992b-7c9d89af1ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:35.964383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-53f2a41c-b3a5-45f3-992b-7c9d89af1ae2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:35.965687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-53f2a41c-b3a5-45f3-992b-7c9d89af1ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:35.975696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 668/1348] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:36.013650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4fc86-e9c4-466e-a1e0-a738513f5b31 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:36.028893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4fc86-e9c4-466e-a1e0-a738513f5b31 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:36.033081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c24254-2ddf-45d4-a033-271b51664db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:36.033710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24254-2ddf-45d4-a033-271b51664db3 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:36.034513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24254-2ddf-45d4-a033-271b51664db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:36.034513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24254-2ddf-45d4-a033-271b51664db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:36.044861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c24254-2ddf-45d4-a033-271b51664db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:36.046350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c24254-2ddf-45d4-a033-271b51664db3 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:36.056734 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 681/1349] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:41.084937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b925d38-97fb-40d6-a908-3c54cc2c62e2 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:41.085965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b925d38-97fb-40d6-a908-3c54cc2c62e2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:41.086466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b925d38-97fb-40d6-a908-3c54cc2c62e2 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:41.089091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 669/1350] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:12:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:41.096016 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dd19d-e7f6-4a40-8907-6ed54c5d9218 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:41.096910 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dd19d-e7f6-4a40-8907-6ed54c5d9218 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:41.097592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dd19d-e7f6-4a40-8907-6ed54c5d9218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:41.228536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-3a1dd19d-e7f6-4a40-8907-6ed54c5d9218 None None] MFA Rules not processed for user `bd80f27a4499407d8c350f2908638334`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:41.230071 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3a1dd19d-e7f6-4a40-8907-6ed54c5d9218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:41.259778 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:41.312371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 682/1351] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:12:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:45.541728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821101c2-6fd8-4239-b576-8cedf52a6f44 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:45.542261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821101c2-6fd8-4239-b576-8cedf52a6f44 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:45.542261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821101c2-6fd8-4239-b576-8cedf52a6f44 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:45.543672 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 670/1352] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:45.549091 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047931f5-c6cc-46d9-8388-790f58cb2acd None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:45.549546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047931f5-c6cc-46d9-8388-790f58cb2acd None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:45.549985 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047931f5-c6cc-46d9-8388-790f58cb2acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:45.569108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-047931f5-c6cc-46d9-8388-790f58cb2acd None None] MFA Rules not processed for user `bd80f27a4499407d8c350f2908638334`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:45.570348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-047931f5-c6cc-46d9-8388-790f58cb2acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:45.580347 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 683/1353] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:12:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:12:45.958123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=72 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:47.100144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db5ba5-9c56-40b9-8e32-368517736f46 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:47.100901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db5ba5-9c56-40b9-8e32-368517736f46 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:47.101020 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db5ba5-9c56-40b9-8e32-368517736f46 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:47.102491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 671/1354] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:47.108037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8da46-cb44-4edc-b45c-d84967b3828c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:47.108579 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8da46-cb44-4edc-b45c-d84967b3828c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:47.108676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8da46-cb44-4edc-b45c-d84967b3828c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:47.133164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-4ff8da46-cb44-4edc-b45c-d84967b3828c None None] MFA Rules not processed for user `bd80f27a4499407d8c350f2908638334`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:47.133164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-4ff8da46-cb44-4edc-b45c-d84967b3828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:47.139721 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 684/1355] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:12:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:50.927600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b2e9-1ad9-47e7-ad9f-592726bbe949 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:50.928338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b2e9-1ad9-47e7-ad9f-592726bbe949 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:50.928338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b2e9-1ad9-47e7-ad9f-592726bbe949 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:50.929689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 672/1356] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:12:50.935109 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49f9f2-5800-4313-a058-47d79c27d6e8 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:50.935931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49f9f2-5800-4313-a058-47d79c27d6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:50.936444 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49f9f2-5800-4313-a058-47d79c27d6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:50.956203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-6e49f9f2-5800-4313-a058-47d79c27d6e8 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:50.957834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6e49f9f2-5800-4313-a058-47d79c27d6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:50.985383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 685/1357] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:12:51.060732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604304de-f2c0-490d-99ae-3d24628f9c34 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:51.062170 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604304de-f2c0-490d-99ae-3d24628f9c34 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:51.062676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604304de-f2c0-490d-99ae-3d24628f9c34 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:51.065448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 673/1358] 10.222.0.62 () {54 vars in 961 bytes} [Thu Jul 7 07:12:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:51.079635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d9cc5-5cec-4e3f-b95d-3ba3daa1704e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:51.082023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d9cc5-5cec-4e3f-b95d-3ba3daa1704e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:51.082912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d9cc5-5cec-4e3f-b95d-3ba3daa1704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:51.159277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ef9d9cc5-5cec-4e3f-b95d-3ba3daa1704e None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:51.160834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ef9d9cc5-5cec-4e3f-b95d-3ba3daa1704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:51.267035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 686/1359] 10.222.0.62 () {58 vars in 1058 bytes} [Thu Jul 7 07:12:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:51.278733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604304de-f2c0-490d-99ae-3d24628f9c34 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:51.295398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604304de-f2c0-490d-99ae-3d24628f9c34 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:51.302105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41fe0-0be0-41a8-b01d-c4791d096057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:51.302930 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41fe0-0be0-41a8-b01d-c4791d096057 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:51.303234 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41fe0-0be0-41a8-b01d-c4791d096057 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:51.303729 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41fe0-0be0-41a8-b01d-c4791d096057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:51.316850 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad41fe0-0be0-41a8-b01d-c4791d096057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:51.318935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad41fe0-0be0-41a8-b01d-c4791d096057 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:51.341523 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 674/1360] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:53.587387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9904-6b7a-4452-89e9-e584506f2552 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:53.587931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9904-6b7a-4452-89e9-e584506f2552 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:53.587931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9904-6b7a-4452-89e9-e584506f2552 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:53.589617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 687/1361] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:53.594999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa093-9614-42f9-8677-cd2ffe2bbc37 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:53.595467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa093-9614-42f9-8677-cd2ffe2bbc37 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:53.595561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa093-9614-42f9-8677-cd2ffe2bbc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:53.613834 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-200aa093-9614-42f9-8677-cd2ffe2bbc37 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:53.615039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-200aa093-9614-42f9-8677-cd2ffe2bbc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:53.623498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 675/1362] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:53.672891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9904-6b7a-4452-89e9-e584506f2552 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:53.689369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9904-6b7a-4452-89e9-e584506f2552 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:53.695619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1ec93-e73c-43b1-9c9a-e62eb719f96f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:53.696489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1ec93-e73c-43b1-9c9a-e62eb719f96f service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:53.696959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1ec93-e73c-43b1-9c9a-e62eb719f96f service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:53.697412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1ec93-e73c-43b1-9c9a-e62eb719f96f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:53.707193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1ec93-e73c-43b1-9c9a-e62eb719f96f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:53.709087 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1ec93-e73c-43b1-9c9a-e62eb719f96f service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:53.722934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 688/1363] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:56.150158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c028dc7-a908-492c-9cd5-5cde32df12fd None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:56.150603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c028dc7-a908-492c-9cd5-5cde32df12fd None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:56.150723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c028dc7-a908-492c-9cd5-5cde32df12fd None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:56.152148 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 676/1364] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:12:56.157861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e4ee2-dee7-4da6-bbd1-f5163e289b23 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:56.158979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e4ee2-dee7-4da6-bbd1-f5163e289b23 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:56.158979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e4ee2-dee7-4da6-bbd1-f5163e289b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:56.177349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-027e4ee2-dee7-4da6-bbd1-f5163e289b23 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:56.178625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-027e4ee2-dee7-4da6-bbd1-f5163e289b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:56.187453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 689/1365] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:56.235768 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9107b-5e56-4a7f-a1b2-6f241149649a None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:56.236143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9107b-5e56-4a7f-a1b2-6f241149649a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:56.236544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9107b-5e56-4a7f-a1b2-6f241149649a None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:56.238113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 677/1366] 10.222.0.62 () {54 vars in 961 bytes} [Thu Jul 7 07:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:56.255385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bf8fc-a127-45a1-8c19-36338a5fcf63 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:56.255714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bf8fc-a127-45a1-8c19-36338a5fcf63 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:56.256007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bf8fc-a127-45a1-8c19-36338a5fcf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:56.276405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-515bf8fc-a127-45a1-8c19-36338a5fcf63 None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:56.277658 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-515bf8fc-a127-45a1-8c19-36338a5fcf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:56.291846 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 690/1367] 10.222.0.62 () {58 vars in 1058 bytes} [Thu Jul 7 07:12:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:56.300977 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9107b-5e56-4a7f-a1b2-6f241149649a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:56.323578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9107b-5e56-4a7f-a1b2-6f241149649a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:56.331831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67106d74-ef07-40f1-b600-4974c743706f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:56.332522 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67106d74-ef07-40f1-b600-4974c743706f service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:56.332814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67106d74-ef07-40f1-b600-4974c743706f service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:56.333098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67106d74-ef07-40f1-b600-4974c743706f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:56.342952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67106d74-ef07-40f1-b600-4974c743706f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:56.344664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67106d74-ef07-40f1-b600-4974c743706f service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:56.356476 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 678/1368] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:12:58.493583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249fa49-8e45-4567-91ad-34b5d375aafb None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:58.494204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249fa49-8e45-4567-91ad-34b5d375aafb None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:58.494204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249fa49-8e45-4567-91ad-34b5d375aafb None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:58.495546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 691/1369] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:58.505885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6075cf-860e-4772-95aa-a7dca053e47d None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:58.506501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6075cf-860e-4772-95aa-a7dca053e47d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:58.506501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6075cf-860e-4772-95aa-a7dca053e47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:58.529958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-fb6075cf-860e-4772-95aa-a7dca053e47d None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:58.531338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-fb6075cf-860e-4772-95aa-a7dca053e47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:58.541266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 679/1370] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:58.589338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249fa49-8e45-4567-91ad-34b5d375aafb None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:58.611293 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249fa49-8e45-4567-91ad-34b5d375aafb None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:58.620155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb7af8-28db-47f3-8307-7ca867816049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:58.620841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb7af8-28db-47f3-8307-7ca867816049 service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:58.621126 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb7af8-28db-47f3-8307-7ca867816049 service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:58.621424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb7af8-28db-47f3-8307-7ca867816049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:58.632044 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb7af8-28db-47f3-8307-7ca867816049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:58.634282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb7af8-28db-47f3-8307-7ca867816049 service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:12:58.646713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 692/1371] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:12:59.425905 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1189d-f362-444a-b1b8-570640158a75 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:59.426206 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1189d-f362-444a-b1b8-570640158a75 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:59.426458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1189d-f362-444a-b1b8-570640158a75 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:59.427982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 680/1372] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:12:59.434249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09d1fb-fa1d-4a0d-bec5-f71ef9090f77 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:59.434512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09d1fb-fa1d-4a0d-bec5-f71ef9090f77 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:59.434805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09d1fb-fa1d-4a0d-bec5-f71ef9090f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:59.462942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-2e09d1fb-fa1d-4a0d-bec5-f71ef9090f77 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:59.464208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2e09d1fb-fa1d-4a0d-bec5-f71ef9090f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:59.475550 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 693/1373] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:59.795991 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5145-53f7-4d0b-9241-3d2d6ddc0899 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:59.796565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5145-53f7-4d0b-9241-3d2d6ddc0899 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:59.796661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5145-53f7-4d0b-9241-3d2d6ddc0899 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:59.799091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 681/1374] 10.222.0.62 () {54 vars in 963 bytes} [Thu Jul 7 07:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:12:59.803983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd35de-64da-47d8-aa2f-988ca487f25f None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:59.804833 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd35de-64da-47d8-aa2f-988ca487f25f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:59.805114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd35de-64da-47d8-aa2f-988ca487f25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:59.812809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:59.868829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-0bcd35de-64da-47d8-aa2f-988ca487f25f None None] MFA Rules not processed for user `af7af6f0c53d4c599f5dd80150b4a22e`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:12:59.870102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0bcd35de-64da-47d8-aa2f-988ca487f25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:12:59.945978 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 694/1375] 10.222.0.62 () {58 vars in 1060 bytes} [Thu Jul 7 07:12:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:12:59.954497 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa5145-53f7-4d0b-9241-3d2d6ddc0899 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:12:59.972350 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa5145-53f7-4d0b-9241-3d2d6ddc0899 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:12:59.976845 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579db23-338e-4f99-8c39-a2b4cd63717e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:12:59.977949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579db23-338e-4f99-8c39-a2b4cd63717e service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:12:59.978408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579db23-338e-4f99-8c39-a2b4cd63717e service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:12:59.979000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579db23-338e-4f99-8c39-a2b4cd63717e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:12:59.990864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579db23-338e-4f99-8c39-a2b4cd63717e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:12:59.992942 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579db23-338e-4f99-8c39-a2b4cd63717e service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:00.006814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 682/1376] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:00.786722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d841291-928c-442f-af59-ac010b546909 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:00.786722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d841291-928c-442f-af59-ac010b546909 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:00.786722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d841291-928c-442f-af59-ac010b546909 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:00.789134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 695/1377] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:00.798179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed8ae1-8c61-470b-ae92-e44233bae698 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:00.798179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed8ae1-8c61-470b-ae92-e44233bae698 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:00.798179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed8ae1-8c61-470b-ae92-e44233bae698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:00.824793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-60ed8ae1-8c61-470b-ae92-e44233bae698 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:00.824793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-60ed8ae1-8c61-470b-ae92-e44233bae698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:00.851661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 683/1378] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:00.881788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d841291-928c-442f-af59-ac010b546909 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:00.907660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d841291-928c-442f-af59-ac010b546909 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:00.917906 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ffa15-61a6-416d-8d82-5c4407a2839a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:00.919086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ffa15-61a6-416d-8d82-5c4407a2839a service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:00.919577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ffa15-61a6-416d-8d82-5c4407a2839a service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:00.920135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ffa15-61a6-416d-8d82-5c4407a2839a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:00.931645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ffa15-61a6-416d-8d82-5c4407a2839a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:00.933369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ffa15-61a6-416d-8d82-5c4407a2839a service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:00.946700 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 696/1379] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:03.126290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd97f6-901c-44cf-8904-bc8253ba55c4 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:03.126871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd97f6-901c-44cf-8904-bc8253ba55c4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:03.126871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd97f6-901c-44cf-8904-bc8253ba55c4 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:03.129076 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 684/1380] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:03.136401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107b66-6340-4915-970c-04e05900a3cd None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:03.136925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107b66-6340-4915-970c-04e05900a3cd None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:03.137465 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107b66-6340-4915-970c-04e05900a3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:03.157801 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-fc107b66-6340-4915-970c-04e05900a3cd None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:03.159059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-fc107b66-6340-4915-970c-04e05900a3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:03.167689 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 697/1381] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:03.214891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd97f6-901c-44cf-8904-bc8253ba55c4 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:03.239958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd97f6-901c-44cf-8904-bc8253ba55c4 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:03.249733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea456102-baa3-436e-883f-fa76c6d160f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:03.250753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea456102-baa3-436e-883f-fa76c6d160f8 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:03.251242 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea456102-baa3-436e-883f-fa76c6d160f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:03.251691 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea456102-baa3-436e-883f-fa76c6d160f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:03.267944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea456102-baa3-436e-883f-fa76c6d160f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:03.271034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea456102-baa3-436e-883f-fa76c6d160f8 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:03.291623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 685/1382] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:05.636410 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305fd2f-7bd1-424f-81cc-4238870c84ec None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:05.637428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305fd2f-7bd1-424f-81cc-4238870c84ec None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:05.637700 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305fd2f-7bd1-424f-81cc-4238870c84ec None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:05.639396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 698/1383] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:05.645695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2a7d6-0429-4bd7-bb27-91818f95d48c None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:05.646667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2a7d6-0429-4bd7-bb27-91818f95d48c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:05.647040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2a7d6-0429-4bd7-bb27-91818f95d48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:05.666722 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-f7a2a7d6-0429-4bd7-bb27-91818f95d48c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:05.668223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f7a2a7d6-0429-4bd7-bb27-91818f95d48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:05.676737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 686/1384] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:13:05.721136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305fd2f-7bd1-424f-81cc-4238870c84ec None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:05.737718 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305fd2f-7bd1-424f-81cc-4238870c84ec None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:05.744545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075060e3-f558-4e7c-9635-36527359b418 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:05.745324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075060e3-f558-4e7c-9635-36527359b418 service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:05.745666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075060e3-f558-4e7c-9635-36527359b418 service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:05.745942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075060e3-f558-4e7c-9635-36527359b418 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:05.756857 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075060e3-f558-4e7c-9635-36527359b418 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:05.758801 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075060e3-f558-4e7c-9635-36527359b418 service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:05.771137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 699/1385] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:08.020516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbab45d-11db-4eba-b2a9-4d629f49f502 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:08.021111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbab45d-11db-4eba-b2a9-4d629f49f502 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:08.021375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbab45d-11db-4eba-b2a9-4d629f49f502 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:08.023931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 687/1386] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:13:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:08.030291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e192c-5704-41ed-8d0a-c957dbb0b2fa None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:08.031152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e192c-5704-41ed-8d0a-c957dbb0b2fa None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:08.031152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e192c-5704-41ed-8d0a-c957dbb0b2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:08.052285 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c46e192c-5704-41ed-8d0a-c957dbb0b2fa None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:08.053836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c46e192c-5704-41ed-8d0a-c957dbb0b2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:08.064250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 700/1387] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:13:08.109852 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbab45d-11db-4eba-b2a9-4d629f49f502 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:08.135652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbab45d-11db-4eba-b2a9-4d629f49f502 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:08.145437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad6387-6823-4b56-a445-debe33b1ed0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:08.146548 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad6387-6823-4b56-a445-debe33b1ed0c service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:08.147453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad6387-6823-4b56-a445-debe33b1ed0c service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:08.147916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad6387-6823-4b56-a445-debe33b1ed0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:08.164857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad6387-6823-4b56-a445-debe33b1ed0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:08.168112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad6387-6823-4b56-a445-debe33b1ed0c service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:08.187407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 688/1388] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:13:10.960367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87686e5-382f-40a2-a7d3-af808f37f36a None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:10.960956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87686e5-382f-40a2-a7d3-af808f37f36a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:10.961130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87686e5-382f-40a2-a7d3-af808f37f36a None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:10.963193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 701/1389] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:13:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:10.971188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235d3ef-3cac-4392-aacd-dad029c94af4 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:10.971767 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235d3ef-3cac-4392-aacd-dad029c94af4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:10.971767 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235d3ef-3cac-4392-aacd-dad029c94af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:10.999395 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-6235d3ef-3cac-4392-aacd-dad029c94af4 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:11.001593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6235d3ef-3cac-4392-aacd-dad029c94af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:11.018398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 689/1390] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:11.081428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87686e5-382f-40a2-a7d3-af808f37f36a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:11.100526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87686e5-382f-40a2-a7d3-af808f37f36a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:11.108507 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538df4ee-af43-48cd-a45b-3e701dafb82a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:11.109159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538df4ee-af43-48cd-a45b-3e701dafb82a service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:11.109563 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538df4ee-af43-48cd-a45b-3e701dafb82a service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:11.109842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538df4ee-af43-48cd-a45b-3e701dafb82a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:11.122092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538df4ee-af43-48cd-a45b-3e701dafb82a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:11.123734 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538df4ee-af43-48cd-a45b-3e701dafb82a service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:11.140094 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 702/1391] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:13.354703 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeaecb-5f05-4d7f-8335-6a0d4bc012fa None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:13.355602 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeaecb-5f05-4d7f-8335-6a0d4bc012fa None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:13.355602 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aeaecb-5f05-4d7f-8335-6a0d4bc012fa None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:13.356884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 690/1392] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:13:13.363957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343d23-1b51-44c9-87c3-e7438255464c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:13.364544 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343d23-1b51-44c9-87c3-e7438255464c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:13.364859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343d23-1b51-44c9-87c3-e7438255464c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:13.388154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-67343d23-1b51-44c9-87c3-e7438255464c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:13.389756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-67343d23-1b51-44c9-87c3-e7438255464c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:13.398738 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 703/1393] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:13.460146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aeaecb-5f05-4d7f-8335-6a0d4bc012fa None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:13.482767 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aeaecb-5f05-4d7f-8335-6a0d4bc012fa None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:13.490654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a2f8f-21eb-45aa-8b21-f9ec51042194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:13.491249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a2f8f-21eb-45aa-8b21-f9ec51042194 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:13.491529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a2f8f-21eb-45aa-8b21-f9ec51042194 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:13.491819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a2f8f-21eb-45aa-8b21-f9ec51042194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:13.503348 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a2f8f-21eb-45aa-8b21-f9ec51042194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:13.505100 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a2f8f-21eb-45aa-8b21-f9ec51042194 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:13.517074 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 691/1394] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:15.837066 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3790d-c1c2-410e-9fe5-559fde5381b0 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:15.837670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3790d-c1c2-410e-9fe5-559fde5381b0 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:15.837670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3790d-c1c2-410e-9fe5-559fde5381b0 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:15.839079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 704/1395] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:15.844832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717256ea-6143-4f2a-9b2e-6684fcb3867e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:15.845388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717256ea-6143-4f2a-9b2e-6684fcb3867e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:15.845388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717256ea-6143-4f2a-9b2e-6684fcb3867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:15.865467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-717256ea-6143-4f2a-9b2e-6684fcb3867e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:15.867082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-717256ea-6143-4f2a-9b2e-6684fcb3867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:15.875683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 692/1396] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:15.921249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3790d-c1c2-410e-9fe5-559fde5381b0 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:15.938011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3790d-c1c2-410e-9fe5-559fde5381b0 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:15.944459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548663c-5279-4548-90bb-e43768046143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:15.945132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548663c-5279-4548-90bb-e43768046143 service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:15.945441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548663c-5279-4548-90bb-e43768046143 service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:15.945722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548663c-5279-4548-90bb-e43768046143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:15.955886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548663c-5279-4548-90bb-e43768046143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:15.957556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548663c-5279-4548-90bb-e43768046143 service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:15.968156 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 705/1397] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:16.242413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759575-65da-4fce-9248-44a019a4119c None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:16.242658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759575-65da-4fce-9248-44a019a4119c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:16.242926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759575-65da-4fce-9248-44a019a4119c None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:16.244712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 693/1398] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:13:16.251139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768f486-eeff-447b-9c6e-9b068907cfcc None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:16.251445 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768f486-eeff-447b-9c6e-9b068907cfcc None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:16.251726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768f486-eeff-447b-9c6e-9b068907cfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:16.272422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-0768f486-eeff-447b-9c6e-9b068907cfcc None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:16.273667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0768f486-eeff-447b-9c6e-9b068907cfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:16.282169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 706/1399] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:16.338188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f29538-c002-4156-aa1f-f34a1df585c3 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:16.338469 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f29538-c002-4156-aa1f-f34a1df585c3 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:16.338752 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f29538-c002-4156-aa1f-f34a1df585c3 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:16.340156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 694/1400] 10.222.0.62 () {54 vars in 962 bytes} [Thu Jul 7 07:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:16.346213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b500a-2ef3-4843-929f-800d7488dadc None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:16.346536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b500a-2ef3-4843-929f-800d7488dadc None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:16.346821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b500a-2ef3-4843-929f-800d7488dadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:16.404169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c42b500a-2ef3-4843-929f-800d7488dadc None None] MFA Rules not processed for user `3a6af41d833941debd6afcecd952af0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:16.405459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c42b500a-2ef3-4843-929f-800d7488dadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:16.443400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:13:16.475637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 707/1401] 10.222.0.62 () {58 vars in 1059 bytes} [Thu Jul 7 07:13:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:16.483681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f29538-c002-4156-aa1f-f34a1df585c3 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:16.489620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=55 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:13:16.502787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f29538-c002-4156-aa1f-f34a1df585c3 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:16.506201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9787c6e-50bb-4a6b-ace1-869fdbd851b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6af41d833941debd6afcecd952af0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:16.506874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9787c6e-50bb-4a6b-ace1-869fdbd851b6 service glance] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:16.507468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9787c6e-50bb-4a6b-ace1-869fdbd851b6 service glance] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:16.507468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9787c6e-50bb-4a6b-ace1-869fdbd851b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:16.518533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9787c6e-50bb-4a6b-ace1-869fdbd851b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:16.520009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9787c6e-50bb-4a6b-ace1-869fdbd851b6 service glance] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:16.531008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 695/1402] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:17.273399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19150a7-a059-4fcf-83b2-3397943b2ae5 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:17.274256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19150a7-a059-4fcf-83b2-3397943b2ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:17.274256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19150a7-a059-4fcf-83b2-3397943b2ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:17.332588 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c19150a7-a059-4fcf-83b2-3397943b2ae5 None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:17.333860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c19150a7-a059-4fcf-83b2-3397943b2ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:17.401712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 708/1403] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:13:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:17.449630 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca549c9-1711-4909-8149-aed1e2d1f9a6 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:17.450188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca549c9-1711-4909-8149-aed1e2d1f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:17.450350 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca549c9-1711-4909-8149-aed1e2d1f9a6 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:17.452179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 696/1404] 10.222.0.62 () {54 vars in 942 bytes} [Thu Jul 7 07:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:17.459529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f658-4f72-476a-9978-bb5e0d35a36d None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:17.459817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f658-4f72-476a-9978-bb5e0d35a36d None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:17.460092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f658-4f72-476a-9978-bb5e0d35a36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:17.520466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-40c9f658-4f72-476a-9978-bb5e0d35a36d None None] MFA Rules not processed for user `16f8303298b04e009e22ea05ba24a3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:17.521846 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-40c9f658-4f72-476a-9978-bb5e0d35a36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:17.609406 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 709/1405] 10.222.0.62 () {58 vars in 1039 bytes} [Thu Jul 7 07:13:17 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:17.621264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca549c9-1711-4909-8149-aed1e2d1f9a6 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:17.636748 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca549c9-1711-4909-8149-aed1e2d1f9a6 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:17.642407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dd25a-632a-41da-b0a1-42659ed5b542 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:17.643096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dd25a-632a-41da-b0a1-42659ed5b542 service swift] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:17.643366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dd25a-632a-41da-b0a1-42659ed5b542 service swift] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:17.643658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dd25a-632a-41da-b0a1-42659ed5b542 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:17.652825 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dd25a-632a-41da-b0a1-42659ed5b542 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:17.654506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dd25a-632a-41da-b0a1-42659ed5b542 service swift] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:17.668288 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 697/1406] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:13:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:13:18.120320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8ab2f-dfe7-47ba-87e3-8cd653ce162f None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:18.120320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8ab2f-dfe7-47ba-87e3-8cd653ce162f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:18.120320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8ab2f-dfe7-47ba-87e3-8cd653ce162f None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:18.124312 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 710/1407] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:13:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:18.130617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1628c-c1e2-4074-b82e-9671ce2a42c9 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:18.131510 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1628c-c1e2-4074-b82e-9671ce2a42c9 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:18.132521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1628c-c1e2-4074-b82e-9671ce2a42c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:18.160568 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-3ce1628c-c1e2-4074-b82e-9671ce2a42c9 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:18.162769 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3ce1628c-c1e2-4074-b82e-9671ce2a42c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:18.174153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 698/1408] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:18.240566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8ab2f-dfe7-47ba-87e3-8cd653ce162f None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:18.259646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8ab2f-dfe7-47ba-87e3-8cd653ce162f None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:18.265121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bd936-87c0-4fb1-982a-de49425a0133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:18.265968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bd936-87c0-4fb1-982a-de49425a0133 service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:18.266256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bd936-87c0-4fb1-982a-de49425a0133 service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:18.266540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bd936-87c0-4fb1-982a-de49425a0133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:18.277167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bd936-87c0-4fb1-982a-de49425a0133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:18.278818 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bd936-87c0-4fb1-982a-de49425a0133 service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:18.284190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:13:18.290286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 711/1409] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:28.152138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=14 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:13:40.085506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c17a1-cf13-4153-aa0e-1687f193ddf9 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:40.086252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c17a1-cf13-4153-aa0e-1687f193ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:40.086252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c17a1-cf13-4153-aa0e-1687f193ddf9 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:40.087487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 699/1410] 10.222.0.62 () {54 vars in 918 bytes} [Thu Jul 7 07:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:40.092732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c22229-6dcf-4aef-ad91-60a59325daaf None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:40.093195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c22229-6dcf-4aef-ad91-60a59325daaf None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:40.093323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c22229-6dcf-4aef-ad91-60a59325daaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:40.113964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-32c22229-6dcf-4aef-ad91-60a59325daaf None None] MFA Rules not processed for user `bd80f27a4499407d8c350f2908638334`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:40.115244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-32c22229-6dcf-4aef-ad91-60a59325daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:40.124844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 712/1411] 10.222.0.62 () {58 vars in 1015 bytes} [Thu Jul 7 07:13:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:40.139494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b330387-0cee-4ba8-a353-37236fb707a1 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:40.139813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b330387-0cee-4ba8-a353-37236fb707a1 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:40.140130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b330387-0cee-4ba8-a353-37236fb707a1 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:40.141617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 700/1412] 10.222.0.62 () {54 vars in 918 bytes} [Thu Jul 7 07:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:40.146646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ab981-b37c-45f3-8b35-6e100b1bbda5 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:40.146935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ab981-b37c-45f3-8b35-6e100b1bbda5 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:40.147214 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ab981-b37c-45f3-8b35-6e100b1bbda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:40.166953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a43ab981-b37c-45f3-8b35-6e100b1bbda5 None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:40.168155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a43ab981-b37c-45f3-8b35-6e100b1bbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:40.178640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 713/1413] 10.222.0.62 () {58 vars in 1015 bytes} [Thu Jul 7 07:13:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:13:42.706548 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23115bb-ce66-489c-9641-3d7dd6ebac1e None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:42.707142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23115bb-ce66-489c-9641-3d7dd6ebac1e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:42.707142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23115bb-ce66-489c-9641-3d7dd6ebac1e None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:42.708584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:42.714147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57664d85-8ad0-4067-9a71-ffd83294ec55 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:42.714603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57664d85-8ad0-4067-9a71-ffd83294ec55 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:42.714724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57664d85-8ad0-4067-9a71-ffd83294ec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:42.733883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-57664d85-8ad0-4067-9a71-ffd83294ec55 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:42.735110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-57664d85-8ad0-4067-9a71-ffd83294ec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:42.743354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:42.790466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23115bb-ce66-489c-9641-3d7dd6ebac1e None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:42.806685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23115bb-ce66-489c-9641-3d7dd6ebac1e None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:42.812467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf0e16-35f8-4ab1-8784-254534edff0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:42.813109 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0e16-35f8-4ab1-8784-254534edff0b service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:42.813448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0e16-35f8-4ab1-8784-254534edff0b service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:42.813730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0e16-35f8-4ab1-8784-254534edff0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:42.822676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf0e16-35f8-4ab1-8784-254534edff0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:42.824270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf0e16-35f8-4ab1-8784-254534edff0b service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:42.834274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 702/1416] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:43.733091 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6016be3-cd92-44b3-a60f-351816eb0a15 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:43.733712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6016be3-cd92-44b3-a60f-351816eb0a15 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:43.733712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6016be3-cd92-44b3-a60f-351816eb0a15 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:43.735054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 07:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:13:43.741547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751c16b-43fe-4f64-b9ea-f4003d921ce1 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:43.742019 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751c16b-43fe-4f64-b9ea-f4003d921ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:43.742121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751c16b-43fe-4f64-b9ea-f4003d921ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:43.775677 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-5751c16b-43fe-4f64-b9ea-f4003d921ce1 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:43.776900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5751c16b-43fe-4f64-b9ea-f4003d921ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:43.791313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 07:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:43.945934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6016be3-cd92-44b3-a60f-351816eb0a15 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:43.966474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6016be3-cd92-44b3-a60f-351816eb0a15 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:43.972544 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d2580-836c-4924-9cf5-7392255a603f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:43.973191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2580-836c-4924-9cf5-7392255a603f service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:43.973519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2580-836c-4924-9cf5-7392255a603f service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:43.973796 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2580-836c-4924-9cf5-7392255a603f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:43.984129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d2580-836c-4924-9cf5-7392255a603f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:43.986592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d2580-836c-4924-9cf5-7392255a603f service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:44.001972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 716/1419] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:44.886739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cccf84-8ce0-4d19-a94f-ac2065ae189e None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:44.887347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cccf84-8ce0-4d19-a94f-ac2065ae189e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:44.887347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cccf84-8ce0-4d19-a94f-ac2065ae189e None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:44.888700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 07:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:44.894949 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5fca1-fd80-4cfc-a0bd-7f1274eb7429 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:44.895643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5fca1-fd80-4cfc-a0bd-7f1274eb7429 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:44.895779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5fca1-fd80-4cfc-a0bd-7f1274eb7429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:44.922906 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-97b5fca1-fd80-4cfc-a0bd-7f1274eb7429 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:44.924252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-97b5fca1-fd80-4cfc-a0bd-7f1274eb7429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:44.934096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 07:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:45.089320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cccf84-8ce0-4d19-a94f-ac2065ae189e None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:45.117256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cccf84-8ce0-4d19-a94f-ac2065ae189e None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:45.124223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b906bab-7e30-4043-9fbd-86810a07be69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:45.124890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b906bab-7e30-4043-9fbd-86810a07be69 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:45.125188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b906bab-7e30-4043-9fbd-86810a07be69 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:45.125501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b906bab-7e30-4043-9fbd-86810a07be69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:45.134605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b906bab-7e30-4043-9fbd-86810a07be69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:45.136265 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b906bab-7e30-4043-9fbd-86810a07be69 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:45.146257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 705/1422] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:46.030554 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1e7fb-d25c-4a6f-b7a7-63c66966dc6e None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:46.031154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1e7fb-d25c-4a6f-b7a7-63c66966dc6e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:46.031154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1e7fb-d25c-4a6f-b7a7-63c66966dc6e None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:46.032542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 07:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:46.038822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf49479-0bb1-4e89-a13c-8ff6ddc140f4 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:46.039495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf49479-0bb1-4e89-a13c-8ff6ddc140f4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:46.039683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf49479-0bb1-4e89-a13c-8ff6ddc140f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:46.065664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-2cf49479-0bb1-4e89-a13c-8ff6ddc140f4 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:46.066942 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-2cf49479-0bb1-4e89-a13c-8ff6ddc140f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:46.076668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 07:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:46.234120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1e7fb-d25c-4a6f-b7a7-63c66966dc6e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:46.258607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1e7fb-d25c-4a6f-b7a7-63c66966dc6e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:46.265149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194b05d-c01a-46a0-b2cc-13a75c0599ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:46.265881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194b05d-c01a-46a0-b2cc-13a75c0599ba service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:46.266153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194b05d-c01a-46a0-b2cc-13a75c0599ba service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:46.266433 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194b05d-c01a-46a0-b2cc-13a75c0599ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:46.276137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194b05d-c01a-46a0-b2cc-13a75c0599ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:46.277783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194b05d-c01a-46a0-b2cc-13a75c0599ba service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:46.287667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 719/1425] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:47.159399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0233fd-ea12-48f5-a8be-997d92bc1c8c None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:47.159956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0233fd-ea12-48f5-a8be-997d92bc1c8c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:47.159956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0233fd-ea12-48f5-a8be-997d92bc1c8c None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:47.161320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 07:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:47.166639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acb785-a23f-4148-be3d-a3a62d1152a8 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:47.167089 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acb785-a23f-4148-be3d-a3a62d1152a8 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:47.167213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acb785-a23f-4148-be3d-a3a62d1152a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:47.188456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-82acb785-a23f-4148-be3d-a3a62d1152a8 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:47.192880 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-82acb785-a23f-4148-be3d-a3a62d1152a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:47.200344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 07:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:47.355784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0233fd-ea12-48f5-a8be-997d92bc1c8c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:47.375464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0233fd-ea12-48f5-a8be-997d92bc1c8c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:47.381002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fadc57-f27f-4ba8-a0f5-28562468f608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:47.381697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadc57-f27f-4ba8-a0f5-28562468f608 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:47.381982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadc57-f27f-4ba8-a0f5-28562468f608 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:47.382261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadc57-f27f-4ba8-a0f5-28562468f608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:47.390999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fadc57-f27f-4ba8-a0f5-28562468f608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:47.392779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fadc57-f27f-4ba8-a0f5-28562468f608 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:47.403308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 708/1428] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:48.214323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24790e7-7468-4c05-b3ed-7f32fef94500 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:48.214977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24790e7-7468-4c05-b3ed-7f32fef94500 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:48.214977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24790e7-7468-4c05-b3ed-7f32fef94500 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:48.216300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 07:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:48.223136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b6e69-dc6e-488c-889c-3892b95646d2 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:48.223965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b6e69-dc6e-488c-889c-3892b95646d2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:48.224282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b6e69-dc6e-488c-889c-3892b95646d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:48.251801 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1e7b6e69-dc6e-488c-889c-3892b95646d2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:48.253070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1e7b6e69-dc6e-488c-889c-3892b95646d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:48.262248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 07:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:48.416235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24790e7-7468-4c05-b3ed-7f32fef94500 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:48.431289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24790e7-7468-4c05-b3ed-7f32fef94500 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:48.438190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b8c66-3a5f-4ad2-8d8f-511220240aad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:48.438855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b8c66-3a5f-4ad2-8d8f-511220240aad service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:48.439136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b8c66-3a5f-4ad2-8d8f-511220240aad service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:48.439783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b8c66-3a5f-4ad2-8d8f-511220240aad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:48.449208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b8c66-3a5f-4ad2-8d8f-511220240aad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:48.450873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b8c66-3a5f-4ad2-8d8f-511220240aad service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:48.461320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 722/1431] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:49.265476 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b38c3-0dc7-4eb1-948d-96ce675b2790 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:49.266049 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b38c3-0dc7-4eb1-948d-96ce675b2790 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:49.266049 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b38c3-0dc7-4eb1-948d-96ce675b2790 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:49.267441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 07:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:49.272915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eba030-08d2-494a-8593-b60d1bcdd4e6 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:49.273427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eba030-08d2-494a-8593-b60d1bcdd4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:49.273609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eba030-08d2-494a-8593-b60d1bcdd4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:49.293772 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-74eba030-08d2-494a-8593-b60d1bcdd4e6 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:49.294974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-74eba030-08d2-494a-8593-b60d1bcdd4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:49.303585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 07:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:49.454808 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b38c3-0dc7-4eb1-948d-96ce675b2790 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:49.471353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b38c3-0dc7-4eb1-948d-96ce675b2790 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:49.479999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e272ed9-ca6b-43d6-906b-18cff0892937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:49.481182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e272ed9-ca6b-43d6-906b-18cff0892937 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:49.481487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e272ed9-ca6b-43d6-906b-18cff0892937 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:49.481761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e272ed9-ca6b-43d6-906b-18cff0892937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:49.491860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e272ed9-ca6b-43d6-906b-18cff0892937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:49.493565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e272ed9-ca6b-43d6-906b-18cff0892937 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:49.503868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 711/1434] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:50.344130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0598730-949b-44c8-bfbc-618873b53121 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:50.344701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0598730-949b-44c8-bfbc-618873b53121 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:50.344701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0598730-949b-44c8-bfbc-618873b53121 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:50.346108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 07:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:50.352095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13952114-4b04-4be3-b688-af3566b09890 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:50.352797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13952114-4b04-4be3-b688-af3566b09890 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:50.352952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13952114-4b04-4be3-b688-af3566b09890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:50.376874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-13952114-4b04-4be3-b688-af3566b09890 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:50.378126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-13952114-4b04-4be3-b688-af3566b09890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:50.387962 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 07:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:50.539219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0598730-949b-44c8-bfbc-618873b53121 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:50.555668 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0598730-949b-44c8-bfbc-618873b53121 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:50.561505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8c166-0ae6-41f1-8e81-e98488c64025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:50.562147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8c166-0ae6-41f1-8e81-e98488c64025 service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:50.562432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8c166-0ae6-41f1-8e81-e98488c64025 service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:50.562705 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8c166-0ae6-41f1-8e81-e98488c64025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:50.571254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8c166-0ae6-41f1-8e81-e98488c64025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:50.572860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8c166-0ae6-41f1-8e81-e98488c64025 service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:50.582383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 725/1437] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:51.394520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234e8f0-b940-4af9-9717-17737bc8cdde None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:51.395081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234e8f0-b940-4af9-9717-17737bc8cdde None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:51.395081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234e8f0-b940-4af9-9717-17737bc8cdde None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:51.397272 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 07:13:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:51.402770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707be80-d3b1-48c4-ae6d-40b77d3369bf None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:51.403239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707be80-d3b1-48c4-ae6d-40b77d3369bf None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:51.403559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707be80-d3b1-48c4-ae6d-40b77d3369bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:51.427402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-1707be80-d3b1-48c4-ae6d-40b77d3369bf None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:51.428686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1707be80-d3b1-48c4-ae6d-40b77d3369bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:51.439012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 07:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:13:51.606553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234e8f0-b940-4af9-9717-17737bc8cdde None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:51.631468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234e8f0-b940-4af9-9717-17737bc8cdde None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:51.639374 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cf8eb-aba2-4cb0-85fe-d1abbdaeb303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:51.640007 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cf8eb-aba2-4cb0-85fe-d1abbdaeb303 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:51.640357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cf8eb-aba2-4cb0-85fe-d1abbdaeb303 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:51.640357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cf8eb-aba2-4cb0-85fe-d1abbdaeb303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:51.651538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cf8eb-aba2-4cb0-85fe-d1abbdaeb303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:51.653856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cf8eb-aba2-4cb0-85fe-d1abbdaeb303 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:51.664686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 714/1440] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:53.613627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06872e5d-f342-41c1-9947-22524deef7f9 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:53.614269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06872e5d-f342-41c1-9947-22524deef7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:53.614269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06872e5d-f342-41c1-9947-22524deef7f9 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:53.615614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:53.621564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e448cfd-65dd-4e8f-b235-1a325c1bcb10 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:53.622083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e448cfd-65dd-4e8f-b235-1a325c1bcb10 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:53.622083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e448cfd-65dd-4e8f-b235-1a325c1bcb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:53.640851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-7e448cfd-65dd-4e8f-b235-1a325c1bcb10 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:53.642126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7e448cfd-65dd-4e8f-b235-1a325c1bcb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:53.650726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:53.690053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06872e5d-f342-41c1-9947-22524deef7f9 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:53.692713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-06872e5d-f342-41c1-9947-22524deef7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:53.707811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06872e5d-f342-41c1-9947-22524deef7f9 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:53.711869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a84e7a-0cb6-4297-8eb7-6e70546e24b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:53.712835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a84e7a-0cb6-4297-8eb7-6e70546e24b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:53.712835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a84e7a-0cb6-4297-8eb7-6e70546e24b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:53.713106 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a84e7a-0cb6-4297-8eb7-6e70546e24b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:53.724488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a84e7a-0cb6-4297-8eb7-6e70546e24b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:53.726016 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a84e7a-0cb6-4297-8eb7-6e70546e24b4 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:53.736982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 728/1443] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:55.967854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345f91c-0747-4cd6-b659-99dfc347ad5c None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:55.968437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345f91c-0747-4cd6-b659-99dfc347ad5c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:55.968437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345f91c-0747-4cd6-b659-99dfc347ad5c None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:55.970499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:55.976954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b97018-05a6-4d80-9147-a25e6fb88db3 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:55.977412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b97018-05a6-4d80-9147-a25e6fb88db3 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:55.977647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b97018-05a6-4d80-9147-a25e6fb88db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:55.996768 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-07b97018-05a6-4d80-9147-a25e6fb88db3 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:55.997992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-07b97018-05a6-4d80-9147-a25e6fb88db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:56.006023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:56.046798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345f91c-0747-4cd6-b659-99dfc347ad5c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:56.065856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345f91c-0747-4cd6-b659-99dfc347ad5c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:56.071954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9f209-98b6-43bc-a320-2c1e2391ea35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:56.072598 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9f209-98b6-43bc-a320-2c1e2391ea35 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:56.072876 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9f209-98b6-43bc-a320-2c1e2391ea35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:56.073145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9f209-98b6-43bc-a320-2c1e2391ea35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:56.083089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9f209-98b6-43bc-a320-2c1e2391ea35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:56.084568 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9f209-98b6-43bc-a320-2c1e2391ea35 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:56.094803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 717/1446] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:58.576564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803842a8-d7f1-41e1-a22e-a5321ff7a134 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:58.577138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803842a8-d7f1-41e1-a22e-a5321ff7a134 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:58.577527 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803842a8-d7f1-41e1-a22e-a5321ff7a134 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:58.579405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:13:58.585990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5253f4e-ccdc-439a-afa4-bdf38ab92c0b None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:58.586529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5253f4e-ccdc-439a-afa4-bdf38ab92c0b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:58.586635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5253f4e-ccdc-439a-afa4-bdf38ab92c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:58.616841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e5253f4e-ccdc-439a-afa4-bdf38ab92c0b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:13:58.618446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e5253f4e-ccdc-439a-afa4-bdf38ab92c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:13:58.627671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:13:58.668992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803842a8-d7f1-41e1-a22e-a5321ff7a134 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:13:58.683648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803842a8-d7f1-41e1-a22e-a5321ff7a134 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:13:58.688074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23797979-7a4a-4438-9eef-c7f6b5b95fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:13:58.688714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23797979-7a4a-4438-9eef-c7f6b5b95fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:13:58.688986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23797979-7a4a-4438-9eef-c7f6b5b95fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:13:58.689565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23797979-7a4a-4438-9eef-c7f6b5b95fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:13:58.699866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23797979-7a4a-4438-9eef-c7f6b5b95fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:13:58.701334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23797979-7a4a-4438-9eef-c7f6b5b95fe3 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:13:58.711291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 731/1449] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:00.886367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4de36-9e37-42b8-a62e-2331c1021244 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:00.887289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4de36-9e37-42b8-a62e-2331c1021244 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:00.887289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4de36-9e37-42b8-a62e-2331c1021244 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:00.889529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:14:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:00.897549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbe820-e3fd-4f9b-bca2-2acb92312e44 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:00.898162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbe820-e3fd-4f9b-bca2-2acb92312e44 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:00.898162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbe820-e3fd-4f9b-bca2-2acb92312e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:00.917924 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-85bbe820-e3fd-4f9b-bca2-2acb92312e44 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:00.919155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-85bbe820-e3fd-4f9b-bca2-2acb92312e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:00.928313 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:00.969534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4de36-9e37-42b8-a62e-2331c1021244 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:00.982669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4de36-9e37-42b8-a62e-2331c1021244 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:00.986782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a622dcb-b564-4c7b-9136-fe3eb836ecb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:00.987421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a622dcb-b564-4c7b-9136-fe3eb836ecb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:00.987706 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a622dcb-b564-4c7b-9136-fe3eb836ecb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:00.987974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a622dcb-b564-4c7b-9136-fe3eb836ecb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:00.998326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a622dcb-b564-4c7b-9136-fe3eb836ecb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:00.999766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a622dcb-b564-4c7b-9136-fe3eb836ecb2 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:01.009696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 720/1452] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:03.139927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01ec07-465b-4e29-b262-3e1792c9314b None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:03.140795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01ec07-465b-4e29-b262-3e1792c9314b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:03.140947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01ec07-465b-4e29-b262-3e1792c9314b None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:03.143556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:14:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:03.149149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36adbbd-c2ee-492a-b5b0-49005c11f5ec None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:03.149652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36adbbd-c2ee-492a-b5b0-49005c11f5ec None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:03.149764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36adbbd-c2ee-492a-b5b0-49005c11f5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:03.168714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-f36adbbd-c2ee-492a-b5b0-49005c11f5ec None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:03.169989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f36adbbd-c2ee-492a-b5b0-49005c11f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:03.178365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:03.220829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01ec07-465b-4e29-b262-3e1792c9314b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:03.239997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01ec07-465b-4e29-b262-3e1792c9314b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:03.245529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957443ff-4f62-4e11-917b-7ca9d277de30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:03.246251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957443ff-4f62-4e11-917b-7ca9d277de30 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:03.246533 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957443ff-4f62-4e11-917b-7ca9d277de30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:03.246806 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957443ff-4f62-4e11-917b-7ca9d277de30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:03.260681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957443ff-4f62-4e11-917b-7ca9d277de30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:03.262862 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957443ff-4f62-4e11-917b-7ca9d277de30 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:03.276006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 734/1455] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:05.430061 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b07ab-62b3-4bd2-b83d-bba99c589d31 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:05.430575 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b07ab-62b3-4bd2-b83d-bba99c589d31 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:05.430679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b07ab-62b3-4bd2-b83d-bba99c589d31 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:05.432046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:05.437729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c57fd-41a2-4a13-9a19-f4113ebfa078 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:05.438139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c57fd-41a2-4a13-9a19-f4113ebfa078 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:05.438283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c57fd-41a2-4a13-9a19-f4113ebfa078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:05.464167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-377c57fd-41a2-4a13-9a19-f4113ebfa078 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:05.465450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-377c57fd-41a2-4a13-9a19-f4113ebfa078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:05.474717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:05.516538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b07ab-62b3-4bd2-b83d-bba99c589d31 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:05.529797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b07ab-62b3-4bd2-b83d-bba99c589d31 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:05.534388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537cb2d-caa7-4b08-bbe2-01af77156866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:05.535072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537cb2d-caa7-4b08-bbe2-01af77156866 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:05.535359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537cb2d-caa7-4b08-bbe2-01af77156866 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:05.535633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537cb2d-caa7-4b08-bbe2-01af77156866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:05.545802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537cb2d-caa7-4b08-bbe2-01af77156866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:05.547275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537cb2d-caa7-4b08-bbe2-01af77156866 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:05.558131 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 723/1458] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:07.628603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd463a20-be50-467b-90e6-43699ea001fb None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:07.629463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd463a20-be50-467b-90e6-43699ea001fb None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:07.629463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd463a20-be50-467b-90e6-43699ea001fb None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:07.631835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:14:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:07.638360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d48bf8-a709-4189-9412-dfe28e3a6594 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:07.639102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d48bf8-a709-4189-9412-dfe28e3a6594 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:07.639296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d48bf8-a709-4189-9412-dfe28e3a6594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:07.661654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-80d48bf8-a709-4189-9412-dfe28e3a6594 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:07.662810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-80d48bf8-a709-4189-9412-dfe28e3a6594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:07.673482 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:07.711954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd463a20-be50-467b-90e6-43699ea001fb None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:07.730234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd463a20-be50-467b-90e6-43699ea001fb None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:07.734369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5241b-eda4-4caf-ad22-3848caf1db5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:07.735035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5241b-eda4-4caf-ad22-3848caf1db5b service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:07.735319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5241b-eda4-4caf-ad22-3848caf1db5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:07.735596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5241b-eda4-4caf-ad22-3848caf1db5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:07.745991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5241b-eda4-4caf-ad22-3848caf1db5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:07.747459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5241b-eda4-4caf-ad22-3848caf1db5b service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:07.758083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 737/1461] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:09.846802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100b6a-452c-45c2-8a57-5894fc285dfa None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:09.847650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100b6a-452c-45c2-8a57-5894fc285dfa None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:09.847650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100b6a-452c-45c2-8a57-5894fc285dfa None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:09.850740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:14:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:09.857776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fb7ba-68fa-47e7-9d73-b16b878aba6e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:09.858275 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fb7ba-68fa-47e7-9d73-b16b878aba6e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:09.858386 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fb7ba-68fa-47e7-9d73-b16b878aba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:09.868360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=79 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:14:09.883045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-217fb7ba-68fa-47e7-9d73-b16b878aba6e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:09.884307 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-217fb7ba-68fa-47e7-9d73-b16b878aba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:09.893500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:09.932275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81100b6a-452c-45c2-8a57-5894fc285dfa None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:09.939740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=73 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:14:09.950277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81100b6a-452c-45c2-8a57-5894fc285dfa None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:09.956203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ecbec-0d1b-43ff-bd33-2170d2bf9711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:09.957173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ecbec-0d1b-43ff-bd33-2170d2bf9711 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:09.957664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ecbec-0d1b-43ff-bd33-2170d2bf9711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:09.958045 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ecbec-0d1b-43ff-bd33-2170d2bf9711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:09.969453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ecbec-0d1b-43ff-bd33-2170d2bf9711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:09.970969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ecbec-0d1b-43ff-bd33-2170d2bf9711 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:09.983046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 726/1464] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:12.050939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d83fd-8b3e-44c6-b5bb-85861b333c7b None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:12.051546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d83fd-8b3e-44c6-b5bb-85861b333c7b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:12.051546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d83fd-8b3e-44c6-b5bb-85861b333c7b None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:12.053038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:12.059595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa717463-b769-4e71-bcf5-1db77c72694e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:12.060340 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa717463-b769-4e71-bcf5-1db77c72694e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:12.060532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa717463-b769-4e71-bcf5-1db77c72694e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:12.090074 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-fa717463-b769-4e71-bcf5-1db77c72694e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:12.091414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-fa717463-b769-4e71-bcf5-1db77c72694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:12.101467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:12.141526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d83fd-8b3e-44c6-b5bb-85861b333c7b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:12.155920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d83fd-8b3e-44c6-b5bb-85861b333c7b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:12.159969 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdcc24-d359-4f1b-8097-555f2ad7ee16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:12.160617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdcc24-d359-4f1b-8097-555f2ad7ee16 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:12.160898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdcc24-d359-4f1b-8097-555f2ad7ee16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:12.161177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdcc24-d359-4f1b-8097-555f2ad7ee16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:12.171772 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdcc24-d359-4f1b-8097-555f2ad7ee16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:12.173293 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdcc24-d359-4f1b-8097-555f2ad7ee16 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:12.184170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 740/1467] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:14.327186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9b2d2-4eec-4dbb-8834-b93316e304e2 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:14.327757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9b2d2-4eec-4dbb-8834-b93316e304e2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:14.327757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9b2d2-4eec-4dbb-8834-b93316e304e2 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:14.329702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:14.337674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414ebe8-e167-4d69-af88-50cbd5d1fdd6 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:14.338224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414ebe8-e167-4d69-af88-50cbd5d1fdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:14.338224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414ebe8-e167-4d69-af88-50cbd5d1fdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:14.362994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-9414ebe8-e167-4d69-af88-50cbd5d1fdd6 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:14.364759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9414ebe8-e167-4d69-af88-50cbd5d1fdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:14.375328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:14:14.420615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9b2d2-4eec-4dbb-8834-b93316e304e2 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:14.433411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9b2d2-4eec-4dbb-8834-b93316e304e2 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:14.437534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52f6bf-9e03-40eb-a6c6-9bc566153cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:14.438186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52f6bf-9e03-40eb-a6c6-9bc566153cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:14.438480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52f6bf-9e03-40eb-a6c6-9bc566153cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:14.438755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52f6bf-9e03-40eb-a6c6-9bc566153cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:14.449494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52f6bf-9e03-40eb-a6c6-9bc566153cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:14.450967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52f6bf-9e03-40eb-a6c6-9bc566153cd3 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:14.462824 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 729/1470] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:24.353896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=11 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:14:24.456970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=14 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:14:34.679090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91432286-45c4-480e-9b13-769f3f355051 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:34.679727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91432286-45c4-480e-9b13-769f3f355051 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:34.679727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91432286-45c4-480e-9b13-769f3f355051 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:34.681181 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 742/1471] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:34.686965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a5685-8c51-4e3e-9426-a0e55b2ae7d7 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:34.687420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a5685-8c51-4e3e-9426-a0e55b2ae7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:34.687527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a5685-8c51-4e3e-9426-a0e55b2ae7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:34.707311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-3c8a5685-8c51-4e3e-9426-a0e55b2ae7d7 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:34.708523 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3c8a5685-8c51-4e3e-9426-a0e55b2ae7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:34.719117 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 730/1472] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:34.809058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de749ee-7615-4ccc-9da4-b8ef66bf5226 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:34.809393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de749ee-7615-4ccc-9da4-b8ef66bf5226 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:34.809677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de749ee-7615-4ccc-9da4-b8ef66bf5226 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:34.811142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 743/1473] 10.222.0.62 () {54 vars in 962 bytes} [Thu Jul 7 07:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:34.819087 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb3b64-3dcc-4bd7-b27b-d27e2fbea61e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:34.819530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb3b64-3dcc-4bd7-b27b-d27e2fbea61e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:34.819963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb3b64-3dcc-4bd7-b27b-d27e2fbea61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:34.843987 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-2eeb3b64-3dcc-4bd7-b27b-d27e2fbea61e None None] MFA Rules not processed for user `3a6af41d833941debd6afcecd952af0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:34.845265 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-2eeb3b64-3dcc-4bd7-b27b-d27e2fbea61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:34.852416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 731/1474] 10.222.0.62 () {58 vars in 1059 bytes} [Thu Jul 7 07:14:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:34.859933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de749ee-7615-4ccc-9da4-b8ef66bf5226 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:34.874214 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de749ee-7615-4ccc-9da4-b8ef66bf5226 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:34.880452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d5ab1-2155-4aa6-9809-cb479560ea28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6af41d833941debd6afcecd952af0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:34.881413 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d5ab1-2155-4aa6-9809-cb479560ea28 service glance] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:34.881800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d5ab1-2155-4aa6-9809-cb479560ea28 service glance] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:34.882152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d5ab1-2155-4aa6-9809-cb479560ea28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:34.893045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d5ab1-2155-4aa6-9809-cb479560ea28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:34.894533 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d5ab1-2155-4aa6-9809-cb479560ea28 service glance] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:34.904738 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 744/1475] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:37.023860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9ac5c-e3bc-4fd9-8d2c-e8fbd0d3a9b7 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:37.024815 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9ac5c-e3bc-4fd9-8d2c-e8fbd0d3a9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:37.024815 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9ac5c-e3bc-4fd9-8d2c-e8fbd0d3a9b7 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:37.026216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 732/1476] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:37.032835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c3940-28a6-4d83-8580-6033ece94dbd None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:37.033325 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c3940-28a6-4d83-8580-6033ece94dbd None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:37.033449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c3940-28a6-4d83-8580-6033ece94dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:37.054006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-764c3940-28a6-4d83-8580-6033ece94dbd None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:37.055208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-764c3940-28a6-4d83-8580-6033ece94dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:37.063897 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 745/1477] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:37.088173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9ac5c-e3bc-4fd9-8d2c-e8fbd0d3a9b7 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:37.116381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9ac5c-e3bc-4fd9-8d2c-e8fbd0d3a9b7 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:37.124361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf97f2-538e-47e2-866e-1d2bebf9f01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:37.125373 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf97f2-538e-47e2-866e-1d2bebf9f01f admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:37.125640 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf97f2-538e-47e2-866e-1d2bebf9f01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:37.126008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf97f2-538e-47e2-866e-1d2bebf9f01f admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:37.127041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf97f2-538e-47e2-866e-1d2bebf9f01f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:37.129278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: WARNING py.warnings [None req-2bdf97f2-538e-47e2-866e-1d2bebf9f01f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:14:37.129278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: warnings.warn(msg) Jul 07 07:14:37.129278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: Jul 07 07:14:37.131021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf97f2-538e-47e2-866e-1d2bebf9f01f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:37.152858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 733/1478] 10.222.0.62 () {56 vars in 1108 bytes} [Thu Jul 7 07:14:37 2022] GET /identity/v3/projects => generated 2553 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:14:39.218967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4115-1c66-4b18-b670-590ad563efa2 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:39.219792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4115-1c66-4b18-b670-590ad563efa2 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:39.219792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4115-1c66-4b18-b670-590ad563efa2 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:39.222178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 746/1479] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:14:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:39.230919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb640b4a-2ab4-4697-bb9f-56ae516c83a2 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:39.231690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb640b4a-2ab4-4697-bb9f-56ae516c83a2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:39.231880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb640b4a-2ab4-4697-bb9f-56ae516c83a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:39.255730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-fb640b4a-2ab4-4697-bb9f-56ae516c83a2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:39.256975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-fb640b4a-2ab4-4697-bb9f-56ae516c83a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:39.267110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 734/1480] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:39.311854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d4115-1c66-4b18-b670-590ad563efa2 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:39.328955 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d4115-1c66-4b18-b670-590ad563efa2 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:39.335118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133a75a-1636-4e7d-848b-03d541189821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:39.335797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133a75a-1636-4e7d-848b-03d541189821 service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:39.336076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133a75a-1636-4e7d-848b-03d541189821 service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:39.336350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133a75a-1636-4e7d-848b-03d541189821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:39.345874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133a75a-1636-4e7d-848b-03d541189821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:39.347477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133a75a-1636-4e7d-848b-03d541189821 service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:39.363874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 747/1481] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:41.590018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686d92-d6a1-43b4-99d3-71a9def5d042 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:41.590615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686d92-d6a1-43b4-99d3-71a9def5d042 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:41.590615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686d92-d6a1-43b4-99d3-71a9def5d042 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:41.592000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 735/1482] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:41.598370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e07053-1181-4823-91cc-42896be5f5ed None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:41.599290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e07053-1181-4823-91cc-42896be5f5ed None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:41.599290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e07053-1181-4823-91cc-42896be5f5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:41.625005 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-96e07053-1181-4823-91cc-42896be5f5ed None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:41.626241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-96e07053-1181-4823-91cc-42896be5f5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:41.635183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 748/1483] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:41.671020 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9686d92-d6a1-43b4-99d3-71a9def5d042 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:41.682727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9686d92-d6a1-43b4-99d3-71a9def5d042 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:41.686688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35dbc8-aa0f-4375-a3b8-24874e08c0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:41.687369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35dbc8-aa0f-4375-a3b8-24874e08c0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:41.687668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35dbc8-aa0f-4375-a3b8-24874e08c0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:41.688013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35dbc8-aa0f-4375-a3b8-24874e08c0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:41.697937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35dbc8-aa0f-4375-a3b8-24874e08c0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:41.699377 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35dbc8-aa0f-4375-a3b8-24874e08c0e2 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:41.709307 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 736/1484] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:14:43.797747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6b7e3-6677-46a4-9985-d9c5bcdba6d4 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:43.798645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6b7e3-6677-46a4-9985-d9c5bcdba6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:43.798645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6b7e3-6677-46a4-9985-d9c5bcdba6d4 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:43.801102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 749/1485] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:14:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:43.808379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a777f-b582-4d59-b59d-01e9a55a9d14 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:43.808859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a777f-b582-4d59-b59d-01e9a55a9d14 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:43.808973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a777f-b582-4d59-b59d-01e9a55a9d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:43.828510 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-565a777f-b582-4d59-b59d-01e9a55a9d14 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:43.830122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-565a777f-b582-4d59-b59d-01e9a55a9d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:43.838306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 737/1486] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:43.883241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6b7e3-6677-46a4-9985-d9c5bcdba6d4 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:43.897414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6b7e3-6677-46a4-9985-d9c5bcdba6d4 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:43.901929 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab47820-a7e1-4824-b372-140fe52bfc40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:43.902586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab47820-a7e1-4824-b372-140fe52bfc40 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:43.902874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab47820-a7e1-4824-b372-140fe52bfc40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:43.903153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab47820-a7e1-4824-b372-140fe52bfc40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:43.913489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab47820-a7e1-4824-b372-140fe52bfc40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:43.915428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab47820-a7e1-4824-b372-140fe52bfc40 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:43.925583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 750/1487] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:46.132717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d26be9-35bd-4305-82e7-cb886300c46c None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:46.133352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d26be9-35bd-4305-82e7-cb886300c46c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:46.133352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d26be9-35bd-4305-82e7-cb886300c46c None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:46.134755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 738/1488] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:46.140249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a67b94-24ba-43bd-abf8-959c7122c68f None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:46.140708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a67b94-24ba-43bd-abf8-959c7122c68f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:46.140814 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a67b94-24ba-43bd-abf8-959c7122c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:46.160027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c5a67b94-24ba-43bd-abf8-959c7122c68f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:46.161253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c5a67b94-24ba-43bd-abf8-959c7122c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:46.169910 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 751/1489] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:46.219809 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d26be9-35bd-4305-82e7-cb886300c46c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:46.232981 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d26be9-35bd-4305-82e7-cb886300c46c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:46.239823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb24b97-98ca-4065-b03b-efe92143d914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:46.240748 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb24b97-98ca-4065-b03b-efe92143d914 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:46.241062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb24b97-98ca-4065-b03b-efe92143d914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:46.241379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb24b97-98ca-4065-b03b-efe92143d914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:46.256522 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb24b97-98ca-4065-b03b-efe92143d914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:46.258822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb24b97-98ca-4065-b03b-efe92143d914 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:46.269489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 739/1490] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:48.499962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec8ad0-4158-407e-87cd-b7d9192bf3ce None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:48.500756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec8ad0-4158-407e-87cd-b7d9192bf3ce None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:48.500756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec8ad0-4158-407e-87cd-b7d9192bf3ce None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:48.503064 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 752/1491] 10.222.0.62 () {54 vars in 926 bytes} [Thu Jul 7 07:14:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:14:48.510688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699550e-7284-408f-b394-55f1eb3a4a8c None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:48.511098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699550e-7284-408f-b394-55f1eb3a4a8c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:48.511246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699550e-7284-408f-b394-55f1eb3a4a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:48.530569 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a699550e-7284-408f-b394-55f1eb3a4a8c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:14:48.531798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a699550e-7284-408f-b394-55f1eb3a4a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:14:48.541363 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 740/1492] 10.222.0.62 () {58 vars in 1023 bytes} [Thu Jul 7 07:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:14:48.583741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec8ad0-4158-407e-87cd-b7d9192bf3ce None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:14:48.602801 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec8ad0-4158-407e-87cd-b7d9192bf3ce None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:14:48.607095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84be6c4-d97c-4800-80cb-5a787d7df1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:14:48.607751 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84be6c4-d97c-4800-80cb-5a787d7df1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:14:48.608043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84be6c4-d97c-4800-80cb-5a787d7df1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:14:48.608345 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84be6c4-d97c-4800-80cb-5a787d7df1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:14:48.619834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84be6c4-d97c-4800-80cb-5a787d7df1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:14:48.621514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84be6c4-d97c-4800-80cb-5a787d7df1f6 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:14:48.631974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 753/1493] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:14:58.525079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=33 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:14:58.627137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=33 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:16:23.163021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf688a1-57a1-457f-81c4-78ddd1f47cb9 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.163617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf688a1-57a1-457f-81c4-78ddd1f47cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.163617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf688a1-57a1-457f-81c4-78ddd1f47cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.183174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-edf688a1-57a1-457f-81c4-78ddd1f47cb9 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:16:23.184786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-edf688a1-57a1-457f-81c4-78ddd1f47cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:16:23.195547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 741/1494] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:16:23.204241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8c90-27bb-4983-aa31-717b641a8fab None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.204835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8c90-27bb-4983-aa31-717b641a8fab None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.204835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8c90-27bb-4983-aa31-717b641a8fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.224382 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-fbdb8c90-27bb-4983-aa31-717b641a8fab None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:16:23.225760 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-fbdb8c90-27bb-4983-aa31-717b641a8fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:16:23.234710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 754/1495] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:16:23.239370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf688a1-57a1-457f-81c4-78ddd1f47cb9 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:16:23.250215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf688a1-57a1-457f-81c4-78ddd1f47cb9 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:16:23.254951 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b8562-d1b7-465d-8711-7c14a5fff30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:16:23.255664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b8562-d1b7-465d-8711-7c14a5fff30e admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.256124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b8562-d1b7-465d-8711-7c14a5fff30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.256406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b8562-d1b7-465d-8711-7c14a5fff30e admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.259990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b8562-d1b7-465d-8711-7c14a5fff30e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:16:23.259990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b8562-d1b7-465d-8711-7c14a5fff30e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:16:23.259990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: WARNING py.warnings [None req-236b8562-d1b7-465d-8711-7c14a5fff30e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:16:23.259990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: warnings.warn(msg) Jul 07 07:16:23.259990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: Jul 07 07:16:23.259990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b8562-d1b7-465d-8711-7c14a5fff30e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:16:23.274742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 742/1496] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:16:23.283470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb8c90-27bb-4983-aa31-717b641a8fab None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:16:23.293540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb8c90-27bb-4983-aa31-717b641a8fab None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:16:23.300024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b57777-509e-4aea-8af1-6628a45a38cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:16:23.300942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b57777-509e-4aea-8af1-6628a45a38cd admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.301249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b57777-509e-4aea-8af1-6628a45a38cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.301612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b57777-509e-4aea-8af1-6628a45a38cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.302837 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b57777-509e-4aea-8af1-6628a45a38cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:16:23.305619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: WARNING py.warnings [None req-25b57777-509e-4aea-8af1-6628a45a38cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:16:23.305619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: warnings.warn(msg) Jul 07 07:16:23.305619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: Jul 07 07:16:23.306874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b57777-509e-4aea-8af1-6628a45a38cd admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:16:23.361022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 755/1497] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:16:23 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:16:23.365944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b8562-d1b7-465d-8711-7c14a5fff30e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:16:23.378550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b8562-d1b7-465d-8711-7c14a5fff30e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:16:23.446605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf54368-4251-4f6b-95b9-2fdf3d0d9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:16:23.447185 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf54368-4251-4f6b-95b9-2fdf3d0d9e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.447472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf54368-4251-4f6b-95b9-2fdf3d0d9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.447779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf54368-4251-4f6b-95b9-2fdf3d0d9e07 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.448497 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf54368-4251-4f6b-95b9-2fdf3d0d9e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:16:23.449590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: WARNING py.warnings [None req-1bf54368-4251-4f6b-95b9-2fdf3d0d9e07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:16:23.449590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: warnings.warn(msg) Jul 07 07:16:23.449590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: Jul 07 07:16:23.451003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf54368-4251-4f6b-95b9-2fdf3d0d9e07 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:16:23.479006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 743/1498] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:16:23 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:16:23.483468 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b57777-509e-4aea-8af1-6628a45a38cd admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:16:23.494235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b57777-509e-4aea-8af1-6628a45a38cd admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:16:23.499345 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c4806-87be-46df-9072-cfbcd65a9e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:16:23.500039 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c4806-87be-46df-9072-cfbcd65a9e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.500322 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c4806-87be-46df-9072-cfbcd65a9e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.500619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c4806-87be-46df-9072-cfbcd65a9e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.501371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c4806-87be-46df-9072-cfbcd65a9e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:16:23.502414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: WARNING py.warnings [None req-963c4806-87be-46df-9072-cfbcd65a9e33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:16:23.502414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: warnings.warn(msg) Jul 07 07:16:23.502414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: Jul 07 07:16:23.503509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c4806-87be-46df-9072-cfbcd65a9e33 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:16:23.518166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 756/1499] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:16:23.522653 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf54368-4251-4f6b-95b9-2fdf3d0d9e07 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:16:23.534668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf54368-4251-4f6b-95b9-2fdf3d0d9e07 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:16:23.540325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efa3da-1026-4702-a1f0-7aa8a6e2fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:16:23.541014 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efa3da-1026-4702-a1f0-7aa8a6e2fc2c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.541332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efa3da-1026-4702-a1f0-7aa8a6e2fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.541615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efa3da-1026-4702-a1f0-7aa8a6e2fc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.542338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efa3da-1026-4702-a1f0-7aa8a6e2fc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:16:23.543364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: WARNING py.warnings [None req-f6efa3da-1026-4702-a1f0-7aa8a6e2fc2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:16:23.543364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: warnings.warn(msg) Jul 07 07:16:23.543364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: Jul 07 07:16:23.544328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efa3da-1026-4702-a1f0-7aa8a6e2fc2c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:16:23.560406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 744/1500] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:16:23.565448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c4806-87be-46df-9072-cfbcd65a9e33 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:16:23.576047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c4806-87be-46df-9072-cfbcd65a9e33 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:16:23.581141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc7120-923f-4052-981f-34440c2f8288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:16:23.582092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7120-923f-4052-981f-34440c2f8288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.582368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7120-923f-4052-981f-34440c2f8288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.582640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7120-923f-4052-981f-34440c2f8288 admin admin] PATH_INFO: `/v3/projects/82316d35fde140659c90922fdf5491b1/users/3713eb97fd4f43dd92d551200045ee91/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.599799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc7120-923f-4052-981f-34440c2f8288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82316d35fde140659c90922fdf5491b1, user_id=3713eb97fd4f43dd92d551200045ee91, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:16:23.600871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: WARNING py.warnings [None req-addc7120-923f-4052-981f-34440c2f8288 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:16:23.600871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: warnings.warn(msg) Jul 07 07:16:23.600871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: Jul 07 07:16:23.602854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc7120-923f-4052-981f-34440c2f8288 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:16:23.619726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 757/1501] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:16:23 2022] PUT /identity/v3/projects/82316d35fde140659c90922fdf5491b1/users/3713eb97fd4f43dd92d551200045ee91/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:16:23.632559 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7d536-a082-4945-b017-6c26247b158b None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.632847 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7d536-a082-4945-b017-6c26247b158b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.633122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7d536-a082-4945-b017-6c26247b158b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.662962 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-59e7d536-a082-4945-b017-6c26247b158b None None] MFA Rules not processed for user `3713eb97fd4f43dd92d551200045ee91`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:16:23.664201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-59e7d536-a082-4945-b017-6c26247b158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:16:23.735161 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 745/1502] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:16:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:16:23.749144 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5777e48-a554-4874-96bb-bbfe497eefee None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.749453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5777e48-a554-4874-96bb-bbfe497eefee None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.749745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5777e48-a554-4874-96bb-bbfe497eefee None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.751179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 758/1503] 10.222.0.62 () {54 vars in 963 bytes} [Thu Jul 7 07:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:16:23.756311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c405b-dbbc-457c-8bf0-a277a256eb26 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.756597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c405b-dbbc-457c-8bf0-a277a256eb26 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.756874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c405b-dbbc-457c-8bf0-a277a256eb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.775050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-ba1c405b-dbbc-457c-8bf0-a277a256eb26 None None] MFA Rules not processed for user `af7af6f0c53d4c599f5dd80150b4a22e`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:16:23.776257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ba1c405b-dbbc-457c-8bf0-a277a256eb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:16:23.827803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:16:23.840543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 746/1504] 10.222.0.62 () {58 vars in 1060 bytes} [Thu Jul 7 07:16:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:16:23.849070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5777e48-a554-4874-96bb-bbfe497eefee None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:16:23.861557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5777e48-a554-4874-96bb-bbfe497eefee None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:16:23.865155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb52c9-c176-4a52-950a-44bdbf6c243b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:16:23.865842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb52c9-c176-4a52-950a-44bdbf6c243b service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.866131 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb52c9-c176-4a52-950a-44bdbf6c243b service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.866417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb52c9-c176-4a52-950a-44bdbf6c243b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.875772 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb52c9-c176-4a52-950a-44bdbf6c243b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:16:23.877246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb52c9-c176-4a52-950a-44bdbf6c243b service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:16:23.887000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 759/1505] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:16:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:16:23.931345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aa794-eb0a-42f1-bfc3-6aa0f32080b4 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:23.931658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aa794-eb0a-42f1-bfc3-6aa0f32080b4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:23.931947 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aa794-eb0a-42f1-bfc3-6aa0f32080b4 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:23.933367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 747/1506] 10.222.0.62 () {52 vars in 829 bytes} [Thu Jul 7 07:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:16:23.937615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb52c9-c176-4a52-950a-44bdbf6c243b service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:16:24.001394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb52c9-c176-4a52-950a-44bdbf6c243b service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:16:24.009490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:16:24.010430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:24.010713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:24.011010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] PATH_INFO: `/v3/users/3713eb97fd4f43dd92d551200045ee91` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:24.012360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3713eb97fd4f43dd92d551200045ee91)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:16:24.013424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: WARNING py.warnings [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:16:24.013424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: warnings.warn(msg) Jul 07 07:16:24.013424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: Jul 07 07:16:24.014749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:16:24.088846 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3713eb97fd4f43dd92d551200045ee91'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:16:24.089641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3713eb97fd4f43dd92d551200045ee91'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:16:24.090227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3713eb97fd4f43dd92d551200045ee91'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:16:24.104485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3713eb97fd4f43dd92d551200045ee91'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:16:24.115126 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3713eb97fd4f43dd92d551200045ee91'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:16:24.132558 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:16:24.143078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 760/1507] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:16:23 2022] DELETE /identity/v3/users/3713eb97fd4f43dd92d551200045ee91 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:16:24.147725 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d5a84-8a80-4fe3-93b3-bba5beb279b0 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:24.147975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d5a84-8a80-4fe3-93b3-bba5beb279b0 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:24.148381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d5a84-8a80-4fe3-93b3-bba5beb279b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:24.167758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-651d5a84-8a80-4fe3-93b3-bba5beb279b0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:16:24.168970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-651d5a84-8a80-4fe3-93b3-bba5beb279b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:16:24.236201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 748/1508] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:16:24.247253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:16:24.249091 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:16:24.312887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd8d75-792d-45ca-8516-b8316e8c52f4 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:16:24.318774 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7509d-be2c-401e-b5ca-bbeb12851323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:16:24.319868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7509d-be2c-401e-b5ca-bbeb12851323 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:24.320207 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7509d-be2c-401e-b5ca-bbeb12851323 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:24.320561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7509d-be2c-401e-b5ca-bbeb12851323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:24.335696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7509d-be2c-401e-b5ca-bbeb12851323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:16:24.338001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7509d-be2c-401e-b5ca-bbeb12851323 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:16:24.349812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 761/1509] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:16:24.708412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d5a84-8a80-4fe3-93b3-bba5beb279b0 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:16:24.710013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-651d5a84-8a80-4fe3-93b3-bba5beb279b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:16:24.722140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d5a84-8a80-4fe3-93b3-bba5beb279b0 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:16:24.726952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:16:24.727907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:16:24.728197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:16:24.728514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] PATH_INFO: `/v3/projects/82316d35fde140659c90922fdf5491b1` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:16:24.730200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82316d35fde140659c90922fdf5491b1)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:16:24.730776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: WARNING py.warnings [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:16:24.730776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: warnings.warn(msg) Jul 07 07:16:24.730776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: Jul 07 07:16:24.731977 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:16:24.796855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82316d35fde140659c90922fdf5491b1', 'request_id': 'req-34332667-e7fb-4687-8b59-1b4253162198'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:16:24.807737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82316d35fde140659c90922fdf5491b1', 'request_id': 'req-34332667-e7fb-4687-8b59-1b4253162198'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:16:24.815447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82316d35fde140659c90922fdf5491b1', 'request_id': 'req-34332667-e7fb-4687-8b59-1b4253162198'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:16:24.834217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] The token cache is being invalidate because project 82316d35fde140659c90922fdf5491b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:16:24.834430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:16:24.835187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-34332667-e7fb-4687-8b59-1b4253162198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:16:24.836761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 749/1510] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:16:24 2022] DELETE /identity/v3/projects/82316d35fde140659c90922fdf5491b1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:16:34.345006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:16:34.831153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:18:05.104769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa1e4e-4114-4f27-8a12-842aa5ca480d None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:05.105505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa1e4e-4114-4f27-8a12-842aa5ca480d None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:05.105505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa1e4e-4114-4f27-8a12-842aa5ca480d None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:05.106833 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 07:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:18:05.112607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c915734-cade-48ae-81da-4b2a4965f698 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:05.113322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c915734-cade-48ae-81da-4b2a4965f698 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:05.113322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c915734-cade-48ae-81da-4b2a4965f698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:05.135060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0c915734-cade-48ae-81da-4b2a4965f698 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:18:05.136362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0c915734-cade-48ae-81da-4b2a4965f698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:05.212035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 07:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:18:05.370515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa1e4e-4114-4f27-8a12-842aa5ca480d None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:18:05.372423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e3fa1e4e-4114-4f27-8a12-842aa5ca480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:05.453896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa1e4e-4114-4f27-8a12-842aa5ca480d None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:18:05.460146 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f42302-a5e8-4a67-b6cf-603055fe1576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:18:05.460822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f42302-a5e8-4a67-b6cf-603055fe1576 service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:05.461138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f42302-a5e8-4a67-b6cf-603055fe1576 service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:05.461479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f42302-a5e8-4a67-b6cf-603055fe1576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:05.471519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f42302-a5e8-4a67-b6cf-603055fe1576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:18:05.473187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f42302-a5e8-4a67-b6cf-603055fe1576 service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:18:05.484275 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 763/1513] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:18:06.320884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61f976-dd1a-4de9-8c27-5b6b994d1051 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:06.321623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61f976-dd1a-4de9-8c27-5b6b994d1051 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:06.321623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61f976-dd1a-4de9-8c27-5b6b994d1051 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:06.322919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 07:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:18:06.328491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8e266-ac2e-46ba-947b-7ccc0797c6e1 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:06.329037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8e266-ac2e-46ba-947b-7ccc0797c6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:06.329037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8e266-ac2e-46ba-947b-7ccc0797c6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:06.350344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-d7c8e266-ac2e-46ba-947b-7ccc0797c6e1 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:18:06.351605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d7c8e266-ac2e-46ba-947b-7ccc0797c6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:06.359725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 07:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:18:06.509739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61f976-dd1a-4de9-8c27-5b6b994d1051 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:18:06.524733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61f976-dd1a-4de9-8c27-5b6b994d1051 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:18:06.530598 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6590e-b6f1-4134-8045-94d8f0365841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:18:06.531249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6590e-b6f1-4134-8045-94d8f0365841 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:06.531534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6590e-b6f1-4134-8045-94d8f0365841 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:06.531813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6590e-b6f1-4134-8045-94d8f0365841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:06.541137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6590e-b6f1-4134-8045-94d8f0365841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:18:06.542771 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6590e-b6f1-4134-8045-94d8f0365841 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:18:06.553466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 752/1516] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:18:07.044469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764c22d-f79e-4f3e-acac-43ea2bd2baa5 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:07.044742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764c22d-f79e-4f3e-acac-43ea2bd2baa5 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:07.045001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764c22d-f79e-4f3e-acac-43ea2bd2baa5 None None] PATH_INFO: `/v3` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:07.046423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 765/1517] 10.222.0.65 () {54 vars in 925 bytes} [Thu Jul 7 07:18:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:18:07.068382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24d3ed-1821-45a9-9e69-894f2fdade2e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:07.068664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24d3ed-1821-45a9-9e69-894f2fdade2e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:07.068950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24d3ed-1821-45a9-9e69-894f2fdade2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:07.089738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-6e24d3ed-1821-45a9-9e69-894f2fdade2e None None] MFA Rules not processed for user `bd80f27a4499407d8c350f2908638334`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:18:07.090960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6e24d3ed-1821-45a9-9e69-894f2fdade2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:07.158774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 753/1518] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Jul 7 07:18:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:18:16.344736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=37 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:18:16.374191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59542601-71fe-463e-b708-4be34609ba01 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:16.374404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59542601-71fe-463e-b708-4be34609ba01 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:16.374718 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59542601-71fe-463e-b708-4be34609ba01 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:16.376712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 766/1519] 10.222.0.62 () {54 vars in 960 bytes} [Thu Jul 7 07:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:18:16.383242 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030003c0-0118-4e0f-b544-69b5076c3a2f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:16.383703 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030003c0-0118-4e0f-b544-69b5076c3a2f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:16.383814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030003c0-0118-4e0f-b544-69b5076c3a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:16.406184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-030003c0-0118-4e0f-b544-69b5076c3a2f None None] MFA Rules not processed for user `bd80f27a4499407d8c350f2908638334`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:18:16.407425 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-030003c0-0118-4e0f-b544-69b5076c3a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:16.418752 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 754/1520] 10.222.0.62 () {58 vars in 1057 bytes} [Thu Jul 7 07:18:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:18:16.428068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59542601-71fe-463e-b708-4be34609ba01 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:18:16.449141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59542601-71fe-463e-b708-4be34609ba01 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:18:16.457343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fbbb9-c32c-4b55-b9c6-c2a9632769ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:18:16.458249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fbbb9-c32c-4b55-b9c6-c2a9632769ba service placement] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:16.458537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fbbb9-c32c-4b55-b9c6-c2a9632769ba service placement] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:16.458814 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fbbb9-c32c-4b55-b9c6-c2a9632769ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:16.468536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fbbb9-c32c-4b55-b9c6-c2a9632769ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:18:16.470241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fbbb9-c32c-4b55-b9c6-c2a9632769ba service placement] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:18:16.481191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 767/1521] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:18:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:18:17.806255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74112ae5-ff52-4002-83dc-21e83ab0c05b None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:17.806858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74112ae5-ff52-4002-83dc-21e83ab0c05b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:17.806858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74112ae5-ff52-4002-83dc-21e83ab0c05b None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:17.808387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 07:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:18:17.813870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1dcab-8ea8-4006-a6c2-03c8694e5840 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:17.814623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1dcab-8ea8-4006-a6c2-03c8694e5840 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:17.814744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1dcab-8ea8-4006-a6c2-03c8694e5840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:17.836010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-8cf1dcab-8ea8-4006-a6c2-03c8694e5840 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:18:17.837287 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8cf1dcab-8ea8-4006-a6c2-03c8694e5840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:17.847049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 07:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:18:18.000019 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74112ae5-ff52-4002-83dc-21e83ab0c05b None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:18:18.016087 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74112ae5-ff52-4002-83dc-21e83ab0c05b None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:18:18.023744 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07bc8f-b46e-4c40-a04b-b2469432d7e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:18:18.024405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07bc8f-b46e-4c40-a04b-b2469432d7e9 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:18.024688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07bc8f-b46e-4c40-a04b-b2469432d7e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:18.024969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07bc8f-b46e-4c40-a04b-b2469432d7e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:18.034655 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07bc8f-b46e-4c40-a04b-b2469432d7e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:18:18.036257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07bc8f-b46e-4c40-a04b-b2469432d7e9 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:18:18.046394 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 756/1524] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:18:18.894419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565201f-4960-4063-8c05-cdb060195c1b None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:18.895378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565201f-4960-4063-8c05-cdb060195c1b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:18.895378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565201f-4960-4063-8c05-cdb060195c1b None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:18.897858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 07:18:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:18:18.906086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738cbad-af3f-4d61-ac5d-6dab29065dc6 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:18.906517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738cbad-af3f-4d61-ac5d-6dab29065dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:18.906682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738cbad-af3f-4d61-ac5d-6dab29065dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:18.927165 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-8738cbad-af3f-4d61-ac5d-6dab29065dc6 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:18:18.928448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-8738cbad-af3f-4d61-ac5d-6dab29065dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:18.937707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 07:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:18:19.088561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565201f-4960-4063-8c05-cdb060195c1b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:18:19.107053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565201f-4960-4063-8c05-cdb060195c1b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:18:19.112938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb072ab-999a-44d2-899d-2e4bf1a0fc55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:18:19.113671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb072ab-999a-44d2-899d-2e4bf1a0fc55 service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:19.113962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb072ab-999a-44d2-899d-2e4bf1a0fc55 service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:19.114239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb072ab-999a-44d2-899d-2e4bf1a0fc55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:19.124041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb072ab-999a-44d2-899d-2e4bf1a0fc55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:18:19.126784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb072ab-999a-44d2-899d-2e4bf1a0fc55 service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:18:19.140027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 770/1527] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:18:23.183253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74abe6-863e-4c17-811f-0f0be3698c14 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:23.183811 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74abe6-863e-4c17-811f-0f0be3698c14 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:23.183811 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74abe6-863e-4c17-811f-0f0be3698c14 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:23.185269 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:18:23.191694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd3185-1141-4e26-a131-4ff8fdd50ebd None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:23.192277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd3185-1141-4e26-a131-4ff8fdd50ebd None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:23.192277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd3185-1141-4e26-a131-4ff8fdd50ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:23.211227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-d9bd3185-1141-4e26-a131-4ff8fdd50ebd None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:18:23.212478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d9bd3185-1141-4e26-a131-4ff8fdd50ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:23.220740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:18:23.298437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74abe6-863e-4c17-811f-0f0be3698c14 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:18:23.301267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7d74abe6-863e-4c17-811f-0f0be3698c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:23.370336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74abe6-863e-4c17-811f-0f0be3698c14 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:18:23.374229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833e238-43ef-40b8-af0b-f4c4cdfb7df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:18:23.374896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833e238-43ef-40b8-af0b-f4c4cdfb7df6 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:23.375184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833e238-43ef-40b8-af0b-f4c4cdfb7df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:23.375467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833e238-43ef-40b8-af0b-f4c4cdfb7df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:23.385597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833e238-43ef-40b8-af0b-f4c4cdfb7df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:18:23.387069 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833e238-43ef-40b8-af0b-f4c4cdfb7df6 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:18:23.392552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:18:23.398834 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 759/1530] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:18:25.448925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e98cc-f126-4ab4-a566-c1305ab63992 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:25.449511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e98cc-f126-4ab4-a566-c1305ab63992 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:25.449511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e98cc-f126-4ab4-a566-c1305ab63992 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:25.450956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:18:25.456745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f36cf-8cd3-4d33-bcda-1f3a204ed13e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:25.457315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f36cf-8cd3-4d33-bcda-1f3a204ed13e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:25.457439 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f36cf-8cd3-4d33-bcda-1f3a204ed13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:25.476914 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-b90f36cf-8cd3-4d33-bcda-1f3a204ed13e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:18:25.478271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b90f36cf-8cd3-4d33-bcda-1f3a204ed13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:25.488150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:18:25.528651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e98cc-f126-4ab4-a566-c1305ab63992 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:18:25.530596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-778e98cc-f126-4ab4-a566-c1305ab63992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:25.547808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e98cc-f126-4ab4-a566-c1305ab63992 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:18:25.552481 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe1c9f-343e-4893-af77-09f3492da93c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:18:25.553208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe1c9f-343e-4893-af77-09f3492da93c service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:25.553517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe1c9f-343e-4893-af77-09f3492da93c service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:25.553791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe1c9f-343e-4893-af77-09f3492da93c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:25.564846 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe1c9f-343e-4893-af77-09f3492da93c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:18:25.566333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe1c9f-343e-4893-af77-09f3492da93c service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:18:25.576027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 773/1533] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:18:29.083581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48cf19-3eed-4a53-8085-2f8b4d47dde4 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:29.084194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48cf19-3eed-4a53-8085-2f8b4d47dde4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:29.084194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48cf19-3eed-4a53-8085-2f8b4d47dde4 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:29.085569 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:18:29.091453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f66872-7a6f-47e6-98a1-a7e46551434d None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:29.091958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f66872-7a6f-47e6-98a1-a7e46551434d None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:29.092063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f66872-7a6f-47e6-98a1-a7e46551434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:29.112044 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c2f66872-7a6f-47e6-98a1-a7e46551434d None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:18:29.113475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c2f66872-7a6f-47e6-98a1-a7e46551434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:29.123877 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:18:29.438485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48cf19-3eed-4a53-8085-2f8b4d47dde4 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:18:29.441144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-fa48cf19-3eed-4a53-8085-2f8b4d47dde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:29.521792 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48cf19-3eed-4a53-8085-2f8b4d47dde4 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:18:29.528121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207acf39-dbe6-44cd-be29-259653caf332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:18:29.529077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207acf39-dbe6-44cd-be29-259653caf332 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:29.529529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207acf39-dbe6-44cd-be29-259653caf332 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:29.529957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207acf39-dbe6-44cd-be29-259653caf332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:29.542275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207acf39-dbe6-44cd-be29-259653caf332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:18:29.543755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207acf39-dbe6-44cd-be29-259653caf332 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:18:29.553697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 762/1536] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:18:31.586717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1199933-7fe5-408f-809b-4374a5d5c703 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:31.587685 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1199933-7fe5-408f-809b-4374a5d5c703 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:31.587685 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1199933-7fe5-408f-809b-4374a5d5c703 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:31.589945 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 07:18:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:18:31.598216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450bc16-848d-4d7f-82d4-b932c576af82 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:31.598695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450bc16-848d-4d7f-82d4-b932c576af82 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:31.598801 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450bc16-848d-4d7f-82d4-b932c576af82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:31.618185 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-c450bc16-848d-4d7f-82d4-b932c576af82 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:18:31.619442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c450bc16-848d-4d7f-82d4-b932c576af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:31.627656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 07:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:18:31.960722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1199933-7fe5-408f-809b-4374a5d5c703 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:18:31.963374 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f1199933-7fe5-408f-809b-4374a5d5c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:18:31.981601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1199933-7fe5-408f-809b-4374a5d5c703 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:18:31.985398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5282af0-f267-4b9a-981f-499fd5a8ba08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:18:31.986046 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5282af0-f267-4b9a-981f-499fd5a8ba08 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:18:31.986326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5282af0-f267-4b9a-981f-499fd5a8ba08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:18:31.986598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5282af0-f267-4b9a-981f-499fd5a8ba08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:18:31.995831 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5282af0-f267-4b9a-981f-499fd5a8ba08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:18:31.997321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5282af0-f267-4b9a-981f-499fd5a8ba08 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:18:32.006933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 776/1539] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:18:41.612872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=32 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:18:42.002991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=33 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:01.776892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eef8d-33cb-46df-ae2b-a26cf45abb41 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:01.777603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eef8d-33cb-46df-ae2b-a26cf45abb41 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:01.777603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eef8d-33cb-46df-ae2b-a26cf45abb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:01.780241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249fd1-375b-40ce-b47b-60f9248592ef None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:01.780697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249fd1-375b-40ce-b47b-60f9248592ef None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:01.780788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249fd1-375b-40ce-b47b-60f9248592ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:01.805693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-9a4eef8d-33cb-46df-ae2b-a26cf45abb41 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:01.806921 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-9a4eef8d-33cb-46df-ae2b-a26cf45abb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:01.820965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 764/1540] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:20:01.826080 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-df249fd1-375b-40ce-b47b-60f9248592ef None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:01.828383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-df249fd1-375b-40ce-b47b-60f9248592ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:01.832990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25237c-5af1-4ec9-850e-a10746f8ffda None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:01.833316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25237c-5af1-4ec9-850e-a10746f8ffda None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:01.833595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25237c-5af1-4ec9-850e-a10746f8ffda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:01.847646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 777/1541] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:01.864126 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7ba66-fbf6-4555-91eb-1f66233ffce6 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:01.864638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7ba66-fbf6-4555-91eb-1f66233ffce6 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:01.865158 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7ba66-fbf6-4555-91eb-1f66233ffce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:01.866897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-2a25237c-5af1-4ec9-850e-a10746f8ffda None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:01.868163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-2a25237c-5af1-4ec9-850e-a10746f8ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:01.882063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 765/1542] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:20:01.886472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25237c-5af1-4ec9-850e-a10746f8ffda None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:01.901582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25237c-5af1-4ec9-850e-a10746f8ffda None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:01.908455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a7b7ba66-fbf6-4555-91eb-1f66233ffce6 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:01.909472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712640d-3a54-4050-8adc-8caa5e58b51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:01.910200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712640d-3a54-4050-8adc-8caa5e58b51c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:01.911002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712640d-3a54-4050-8adc-8caa5e58b51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:01.911002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712640d-3a54-4050-8adc-8caa5e58b51c admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:01.911505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712640d-3a54-4050-8adc-8caa5e58b51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:01.911806 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712640d-3a54-4050-8adc-8caa5e58b51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:01.912419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a7b7ba66-fbf6-4555-91eb-1f66233ffce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:01.913520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712640d-3a54-4050-8adc-8caa5e58b51c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:01.933474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 766/1543] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:20:01.935900 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 778/1544] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:01.936944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712640d-3a54-4050-8adc-8caa5e58b51c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:01.941527 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7ba66-fbf6-4555-91eb-1f66233ffce6 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:01.956450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7ba66-fbf6-4555-91eb-1f66233ffce6 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:01.959716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712640d-3a54-4050-8adc-8caa5e58b51c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:01.966861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793b56a-752e-46d2-be01-9d36e50e8d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:01.967544 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793b56a-752e-46d2-be01-9d36e50e8d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:01.967877 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793b56a-752e-46d2-be01-9d36e50e8d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:01.968096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793b56a-752e-46d2-be01-9d36e50e8d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:01.969752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793b56a-752e-46d2-be01-9d36e50e8d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:01.970063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793b56a-752e-46d2-be01-9d36e50e8d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:01.971092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: WARNING py.warnings [None req-1793b56a-752e-46d2-be01-9d36e50e8d18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:20:01.971092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: warnings.warn(msg) Jul 07 07:20:01.971092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: Jul 07 07:20:01.971998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793b56a-752e-46d2-be01-9d36e50e8d18 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:01.974346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf4d27-1488-4c03-94f0-bc2410363469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:01.975020 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf4d27-1488-4c03-94f0-bc2410363469 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:01.975296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf4d27-1488-4c03-94f0-bc2410363469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:01.975568 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf4d27-1488-4c03-94f0-bc2410363469 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:01.976268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf4d27-1488-4c03-94f0-bc2410363469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:01.977305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: WARNING py.warnings [None req-ebaf4d27-1488-4c03-94f0-bc2410363469 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:20:01.977305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: warnings.warn(msg) Jul 07 07:20:01.977305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: Jul 07 07:20:01.978486 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf4d27-1488-4c03-94f0-bc2410363469 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.003801 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 779/1545] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:20:02.006645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e4449-5881-40e2-8042-a1ed61985466 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.007154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e4449-5881-40e2-8042-a1ed61985466 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.008477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e4449-5881-40e2-8042-a1ed61985466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.047050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 767/1546] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:01 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:02.047970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf4d27-1488-4c03-94f0-bc2410363469 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.076848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-fa1e4449-5881-40e2-8042-a1ed61985466 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:02.078991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-fa1e4449-5881-40e2-8042-a1ed61985466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:02.168052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf4d27-1488-4c03-94f0-bc2410363469 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.194004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edeb49d-7f25-4dd7-ba39-4c6abe067cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.194707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edeb49d-7f25-4dd7-ba39-4c6abe067cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.194991 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edeb49d-7f25-4dd7-ba39-4c6abe067cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.195266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edeb49d-7f25-4dd7-ba39-4c6abe067cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.195973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edeb49d-7f25-4dd7-ba39-4c6abe067cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.197952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edeb49d-7f25-4dd7-ba39-4c6abe067cd8 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.266883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 780/1547] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:02.268040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e4449-5881-40e2-8042-a1ed61985466 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.288083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 768/1548] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/projects => generated 363 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:02.290310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09475f-c4c9-4856-9256-664293ac2b49 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.290794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09475f-c4c9-4856-9256-664293ac2b49 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.291303 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09475f-c4c9-4856-9256-664293ac2b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.318847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e4449-5881-40e2-8042-a1ed61985466 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.336974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-fa09475f-c4c9-4856-9256-664293ac2b49 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:02.338226 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-fa09475f-c4c9-4856-9256-664293ac2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:02.398143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1823751-3712-4a7e-83c2-dfc809308ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.400057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1823751-3712-4a7e-83c2-dfc809308ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.400354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1823751-3712-4a7e-83c2-dfc809308ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.400634 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1823751-3712-4a7e-83c2-dfc809308ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.405156 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1823751-3712-4a7e-83c2-dfc809308ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.405456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 769/1549] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:02.405456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0007d7-09cb-4d6b-a28c-44af3e240a25 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.405456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0007d7-09cb-4d6b-a28c-44af3e240a25 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.405456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0007d7-09cb-4d6b-a28c-44af3e240a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.408966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: WARNING py.warnings [None req-d1823751-3712-4a7e-83c2-dfc809308ec9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:20:02.408966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: warnings.warn(msg) Jul 07 07:20:02.408966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: Jul 07 07:20:02.410398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1823751-3712-4a7e-83c2-dfc809308ec9 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.429696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-4a0007d7-09cb-4d6b-a28c-44af3e240a25 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:02.431205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4a0007d7-09cb-4d6b-a28c-44af3e240a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:02.441424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 781/1550] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:02.442317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1823751-3712-4a7e-83c2-dfc809308ec9 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.443107 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 770/1551] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:02.444848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf63aa-8bc3-4635-a23b-e1c4e683cf54 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.445334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf63aa-8bc3-4635-a23b-e1c4e683cf54 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.445514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf63aa-8bc3-4635-a23b-e1c4e683cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.454361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1823751-3712-4a7e-83c2-dfc809308ec9 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.459385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ad873-f330-4ebe-9040-7b705e8ccb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.460228 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ad873-f330-4ebe-9040-7b705e8ccb79 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.460522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ad873-f330-4ebe-9040-7b705e8ccb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.460802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ad873-f330-4ebe-9040-7b705e8ccb79 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.461731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ad873-f330-4ebe-9040-7b705e8ccb79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.463752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ad873-f330-4ebe-9040-7b705e8ccb79 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.467461 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-ceaf63aa-8bc3-4635-a23b-e1c4e683cf54 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:02.468827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ceaf63aa-8bc3-4635-a23b-e1c4e683cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:02.484965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 771/1552] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:02.487352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d411d-3060-446a-a74b-8cf255d9f84d None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.487525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d411d-3060-446a-a74b-8cf255d9f84d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.487717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d411d-3060-446a-a74b-8cf255d9f84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.496762 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 782/1553] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/users => generated 282 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:02.496762 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9390666-8702-43b2-81b3-24da898df80e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.496762 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9390666-8702-43b2-81b3-24da898df80e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.496762 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9390666-8702-43b2-81b3-24da898df80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.508077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-f12d411d-3060-446a-a74b-8cf255d9f84d None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:02.509362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f12d411d-3060-446a-a74b-8cf255d9f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:02.514596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e9390666-8702-43b2-81b3-24da898df80e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:02.515889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e9390666-8702-43b2-81b3-24da898df80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:02.517543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 772/1554] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:02.518796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3135-d894-403b-ad22-f9662685e6d8 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.519082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3135-d894-403b-ad22-f9662685e6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.519358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3135-d894-403b-ad22-f9662685e6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.538219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 783/1555] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:02.538813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-ac4e3135-d894-403b-ad22-f9662685e6d8 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:02.538968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9390666-8702-43b2-81b3-24da898df80e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.540032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ac4e3135-d894-403b-ad22-f9662685e6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:02.548555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 773/1556] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:02.549183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9390666-8702-43b2-81b3-24da898df80e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.549497 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e3135-d894-403b-ad22-f9662685e6d8 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.554240 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fe6da-f4c7-4043-9de6-06ba94d71282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.554931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fe6da-f4c7-4043-9de6-06ba94d71282 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.555221 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fe6da-f4c7-4043-9de6-06ba94d71282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.555502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fe6da-f4c7-4043-9de6-06ba94d71282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.556250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fe6da-f4c7-4043-9de6-06ba94d71282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.557917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fe6da-f4c7-4043-9de6-06ba94d71282 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.560108 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e3135-d894-403b-ad22-f9662685e6d8 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.570697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 784/1557] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:02.572070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb878b-2d04-43b7-b072-b595ef5936b8 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.572364 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb878b-2d04-43b7-b072-b595ef5936b8 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.572869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb878b-2d04-43b7-b072-b595ef5936b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.574700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7a9d6-9fa6-404d-947b-a067857aedcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.575455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7a9d6-9fa6-404d-947b-a067857aedcb admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.575745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7a9d6-9fa6-404d-947b-a067857aedcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.576022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7a9d6-9fa6-404d-947b-a067857aedcb admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.576801 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7a9d6-9fa6-404d-947b-a067857aedcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:02.577248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7a9d6-9fa6-404d-947b-a067857aedcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.578914 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7a9d6-9fa6-404d-947b-a067857aedcb admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.587527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:02.592151 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-dcfb878b-2d04-43b7-b072-b595ef5936b8 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:02.593512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-dcfb878b-2d04-43b7-b072-b595ef5936b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:02.602024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 785/1559] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:02.603395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760b222-636c-4bca-afb5-b973a0df1e85 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.603681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760b222-636c-4bca-afb5-b973a0df1e85 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.603960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760b222-636c-4bca-afb5-b973a0df1e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.605453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 774/1559] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:02.606532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7a9d6-9fa6-404d-947b-a067857aedcb admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.621693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7a9d6-9fa6-404d-947b-a067857aedcb admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.627180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-8760b222-636c-4bca-afb5-b973a0df1e85 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:02.627408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea405-ef74-4b8f-bee3-a5f4e9d8eaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.628190 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea405-ef74-4b8f-bee3-a5f4e9d8eaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.628381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea405-ef74-4b8f-bee3-a5f4e9d8eaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.628496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8760b222-636c-4bca-afb5-b973a0df1e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:02.628676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea405-ef74-4b8f-bee3-a5f4e9d8eaf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.629450 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea405-ef74-4b8f-bee3-a5f4e9d8eaf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.631252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea405-ef74-4b8f-bee3-a5f4e9d8eaf0 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.638323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 786/1560] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:02.639451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d62d0a-90f9-4e4f-ac47-67a4c183d4ed None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.639744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d62d0a-90f9-4e4f-ac47-67a4c183d4ed None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.640027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d62d0a-90f9-4e4f-ac47-67a4c183d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.648200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 775/1561] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:02.649523 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95f068-f5bd-46df-bfef-52b6b8bf6584 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.649817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95f068-f5bd-46df-bfef-52b6b8bf6584 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.650098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95f068-f5bd-46df-bfef-52b6b8bf6584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.660208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a1d62d0a-90f9-4e4f-ac47-67a4c183d4ed None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:02.661586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a1d62d0a-90f9-4e4f-ac47-67a4c183d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:02.668430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1e95f068-f5bd-46df-bfef-52b6b8bf6584 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:02.669724 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1e95f068-f5bd-46df-bfef-52b6b8bf6584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:02.669859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 787/1562] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:02.670681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d62d0a-90f9-4e4f-ac47-67a4c183d4ed None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.678239 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 776/1563] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:02.681391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d62d0a-90f9-4e4f-ac47-67a4c183d4ed None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.682374 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95f068-f5bd-46df-bfef-52b6b8bf6584 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.686959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a81f89-ae2a-4134-9a79-5feced240599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.687895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a81f89-ae2a-4134-9a79-5feced240599 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.688171 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a81f89-ae2a-4134-9a79-5feced240599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.688772 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a81f89-ae2a-4134-9a79-5feced240599 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.689544 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a81f89-ae2a-4134-9a79-5feced240599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:02.689849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a81f89-ae2a-4134-9a79-5feced240599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.691488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a81f89-ae2a-4134-9a79-5feced240599 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.693291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95f068-f5bd-46df-bfef-52b6b8bf6584 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.694505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:02.698434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be7b8b-5054-448e-9d14-5bd694328ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.699144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be7b8b-5054-448e-9d14-5bd694328ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.699873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be7b8b-5054-448e-9d14-5bd694328ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.699873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be7b8b-5054-448e-9d14-5bd694328ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.700455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be7b8b-5054-448e-9d14-5bd694328ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.702187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be7b8b-5054-448e-9d14-5bd694328ab0 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.706145 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 788/1564] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:02.707035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a81f89-ae2a-4134-9a79-5feced240599 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.719869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 777/1565] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:02.720072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a81f89-ae2a-4134-9a79-5feced240599 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.720195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3d89-d8f4-4240-8b17-f75dc1a6594a None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.720195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3d89-d8f4-4240-8b17-f75dc1a6594a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.720195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3d89-d8f4-4240-8b17-f75dc1a6594a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.724188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051484a-f292-4d62-a4c0-a89e4e8adac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.724844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051484a-f292-4d62-a4c0-a89e4e8adac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.725129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051484a-f292-4d62-a4c0-a89e4e8adac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.725434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051484a-f292-4d62-a4c0-a89e4e8adac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.726132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051484a-f292-4d62-a4c0-a89e4e8adac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.728062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051484a-f292-4d62-a4c0-a89e4e8adac6 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.739877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-d73f3d89-d8f4-4240-8b17-f75dc1a6594a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:02.741109 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d73f3d89-d8f4-4240-8b17-f75dc1a6594a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:02.750053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 778/1566] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:02.750890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3d89-d8f4-4240-8b17-f75dc1a6594a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.758570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 789/1567] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:02.758570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051484a-f292-4d62-a4c0-a89e4e8adac6 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.761021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3d89-d8f4-4240-8b17-f75dc1a6594a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.818436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa280d-f690-4009-867b-ff5a2ac19381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.819238 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa280d-f690-4009-867b-ff5a2ac19381 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.819486 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa280d-f690-4009-867b-ff5a2ac19381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.819764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa280d-f690-4009-867b-ff5a2ac19381 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.820585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa280d-f690-4009-867b-ff5a2ac19381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:02.820893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa280d-f690-4009-867b-ff5a2ac19381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.821915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051484a-f292-4d62-a4c0-a89e4e8adac6 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.822773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa280d-f690-4009-867b-ff5a2ac19381 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.827622 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a6ccc-f901-4b3c-9f2c-3ae2d3bff67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.828298 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a6ccc-f901-4b3c-9f2c-3ae2d3bff67f admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.828590 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a6ccc-f901-4b3c-9f2c-3ae2d3bff67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.828860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a6ccc-f901-4b3c-9f2c-3ae2d3bff67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.829657 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a6ccc-f901-4b3c-9f2c-3ae2d3bff67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.831450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a6ccc-f901-4b3c-9f2c-3ae2d3bff67f admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.834918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 779/1568] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:02.835831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa280d-f690-4009-867b-ff5a2ac19381 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.846381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa280d-f690-4009-867b-ff5a2ac19381 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.848425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 790/1569] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:02.849404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a6ccc-f901-4b3c-9f2c-3ae2d3bff67f admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.851254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dc131-b970-4c5b-9f32-244700d5c7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.851927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dc131-b970-4c5b-9f32-244700d5c7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.852212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dc131-b970-4c5b-9f32-244700d5c7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.852489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dc131-b970-4c5b-9f32-244700d5c7d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.853241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dc131-b970-4c5b-9f32-244700d5c7d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:02.853623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dc131-b970-4c5b-9f32-244700d5c7d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.855256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dc131-b970-4c5b-9f32-244700d5c7d7 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.861020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a6ccc-f901-4b3c-9f2c-3ae2d3bff67f admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.866029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919cf27-c104-4cbf-823c-ce0041ce2886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.866704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919cf27-c104-4cbf-823c-ce0041ce2886 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.866992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919cf27-c104-4cbf-823c-ce0041ce2886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.867270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919cf27-c104-4cbf-823c-ce0041ce2886 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.868003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919cf27-c104-4cbf-823c-ce0041ce2886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:02.868283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 780/1570] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:02.868381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919cf27-c104-4cbf-823c-ce0041ce2886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.869199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dc131-b970-4c5b-9f32-244700d5c7d7 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.870240 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919cf27-c104-4cbf-823c-ce0041ce2886 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.889577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 791/1571] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:02.889577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919cf27-c104-4cbf-823c-ce0041ce2886 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.889920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dc131-b970-4c5b-9f32-244700d5c7d7 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.894811 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6b9ee-e29d-46a6-b1cc-6f61a486f2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.896360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6b9ee-e29d-46a6-b1cc-6f61a486f2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.896691 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6b9ee-e29d-46a6-b1cc-6f61a486f2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.896974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6b9ee-e29d-46a6-b1cc-6f61a486f2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.897740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6b9ee-e29d-46a6-b1cc-6f61a486f2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.899738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6b9ee-e29d-46a6-b1cc-6f61a486f2d1 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.900088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919cf27-c104-4cbf-823c-ce0041ce2886 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:02.905809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedba78-ddd3-4425-a81d-5b8030b5d723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:02.906722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedba78-ddd3-4425-a81d-5b8030b5d723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:02.907000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedba78-ddd3-4425-a81d-5b8030b5d723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:02.907277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedba78-ddd3-4425-a81d-5b8030b5d723 admin admin] PATH_INFO: `/v3/projects/93f50f24f7ca48a09dfc96343450dc53/users/00ccad5420c643d5a2156f83eaf508c9/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:02.923681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedba78-ddd3-4425-a81d-5b8030b5d723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f50f24f7ca48a09dfc96343450dc53, user_id=00ccad5420c643d5a2156f83eaf508c9, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:02.926432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedba78-ddd3-4425-a81d-5b8030b5d723 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:02.927004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 781/1572] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:02.927849 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6b9ee-e29d-46a6-b1cc-6f61a486f2d1 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.945943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 792/1573] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:02 2022] PUT /identity/v3/projects/93f50f24f7ca48a09dfc96343450dc53/users/00ccad5420c643d5a2156f83eaf508c9/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:02.947939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedba78-ddd3-4425-a81d-5b8030b5d723 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:02.995227 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6b9ee-e29d-46a6-b1cc-6f61a486f2d1 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.023705 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:03.032420 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedba78-ddd3-4425-a81d-5b8030b5d723 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.037052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd75272-23d5-407e-b4bd-0442fdec90b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.037808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd75272-23d5-407e-b4bd-0442fdec90b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.038101 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd75272-23d5-407e-b4bd-0442fdec90b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.038372 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd75272-23d5-407e-b4bd-0442fdec90b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.039083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd75272-23d5-407e-b4bd-0442fdec90b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.041031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd75272-23d5-407e-b4bd-0442fdec90b2 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.054874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc9bc6-c890-4546-ab3c-dd64b8260e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.055630 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc9bc6-c890-4546-ab3c-dd64b8260e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.055919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc9bc6-c890-4546-ab3c-dd64b8260e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.056198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc9bc6-c890-4546-ab3c-dd64b8260e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.056934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc9bc6-c890-4546-ab3c-dd64b8260e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:03.057259 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc9bc6-c890-4546-ab3c-dd64b8260e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.059066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc9bc6-c890-4546-ab3c-dd64b8260e48 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.064847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 793/1574] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:02 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:03.065967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd75272-23d5-407e-b4bd-0442fdec90b2 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.083515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 782/1575] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:03.083515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc9bc6-c890-4546-ab3c-dd64b8260e48 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.083833 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd75272-23d5-407e-b4bd-0442fdec90b2 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.083935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3218195-ccdb-4dfc-893f-da6197792752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.084692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3218195-ccdb-4dfc-893f-da6197792752 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.084912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3218195-ccdb-4dfc-893f-da6197792752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.085190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3218195-ccdb-4dfc-893f-da6197792752 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.085940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3218195-ccdb-4dfc-893f-da6197792752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.087950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3218195-ccdb-4dfc-893f-da6197792752 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.089795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc9bc6-c890-4546-ab3c-dd64b8260e48 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.095026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9a59d-fda8-4189-ba18-da648d4b461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.096041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9a59d-fda8-4189-ba18-da648d4b461f admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.096324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9a59d-fda8-4189-ba18-da648d4b461f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.096629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9a59d-fda8-4189-ba18-da648d4b461f admin admin] PATH_INFO: `/v3/projects/acccc27a3c114d6c9850eff61d3c4362/users/a0dd769a6a274608b688474ec38bc24e/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.113142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:03.114561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9a59d-fda8-4189-ba18-da648d4b461f admin admin] RBAC: Authorizing `identity:create_grant(project_id=acccc27a3c114d6c9850eff61d3c4362, user_id=a0dd769a6a274608b688474ec38bc24e, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.115714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: WARNING py.warnings [None req-c6d9a59d-fda8-4189-ba18-da648d4b461f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:20:03.115714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: warnings.warn(msg) Jul 07 07:20:03.115714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: Jul 07 07:20:03.117791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9a59d-fda8-4189-ba18-da648d4b461f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.122141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 794/1576] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:03.123046 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3218195-ccdb-4dfc-893f-da6197792752 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.133469 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 783/1577] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:03 2022] PUT /identity/v3/projects/acccc27a3c114d6c9850eff61d3c4362/users/a0dd769a6a274608b688474ec38bc24e/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:03.145477 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9a59d-fda8-4189-ba18-da648d4b461f admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.193502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3218195-ccdb-4dfc-893f-da6197792752 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.198455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed9139-b49a-4593-bf4f-246dae32931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.199122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed9139-b49a-4593-bf4f-246dae32931f admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.199405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed9139-b49a-4593-bf4f-246dae32931f admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.199679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed9139-b49a-4593-bf4f-246dae32931f admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.200314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9a59d-fda8-4189-ba18-da648d4b461f admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.200513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed9139-b49a-4593-bf4f-246dae32931f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.202489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed9139-b49a-4593-bf4f-246dae32931f admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.205424 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdf59b-30bd-4500-9df4-1ae68109021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.206155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdf59b-30bd-4500-9df4-1ae68109021b admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.206446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdf59b-30bd-4500-9df4-1ae68109021b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.206728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdf59b-30bd-4500-9df4-1ae68109021b admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.207492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdf59b-30bd-4500-9df4-1ae68109021b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.209447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdf59b-30bd-4500-9df4-1ae68109021b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.233739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 795/1578] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:03.233739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed9139-b49a-4593-bf4f-246dae32931f admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.237976 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 784/1579] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:03.239389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6ad99-f29a-4aec-b139-2f83823fdfd4 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.239688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6ad99-f29a-4aec-b139-2f83823fdfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.239973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6ad99-f29a-4aec-b139-2f83823fdfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.266400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-83d6ad99-f29a-4aec-b139-2f83823fdfd4 None None] MFA Rules not processed for user `00ccad5420c643d5a2156f83eaf508c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:03.267621 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-83d6ad99-f29a-4aec-b139-2f83823fdfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:03.295671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed9139-b49a-4593-bf4f-246dae32931f admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.334065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 785/1580] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:03.334816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6ad99-f29a-4aec-b139-2f83823fdfd4 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.348016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:03.359564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d17264-abb9-4bb0-8fd5-c96b8596d24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.360281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d17264-abb9-4bb0-8fd5-c96b8596d24b admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.360562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d17264-abb9-4bb0-8fd5-c96b8596d24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.360837 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d17264-abb9-4bb0-8fd5-c96b8596d24b admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.361561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d17264-abb9-4bb0-8fd5-c96b8596d24b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.364143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d17264-abb9-4bb0-8fd5-c96b8596d24b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.392212 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 796/1581] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:03.393195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d17264-abb9-4bb0-8fd5-c96b8596d24b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.403560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d17264-abb9-4bb0-8fd5-c96b8596d24b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.408354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedfd02-6980-431c-9900-ceb2820b7525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.409118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedfd02-6980-431c-9900-ceb2820b7525 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.409500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedfd02-6980-431c-9900-ceb2820b7525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.409846 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedfd02-6980-431c-9900-ceb2820b7525 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.410453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6ad99-f29a-4aec-b139-2f83823fdfd4 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.410669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedfd02-6980-431c-9900-ceb2820b7525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.412669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedfd02-6980-431c-9900-ceb2820b7525 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.414931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643e462-9f07-42fa-9958-fed1310a69af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.415783 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643e462-9f07-42fa-9958-fed1310a69af admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.416064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643e462-9f07-42fa-9958-fed1310a69af admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.416339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643e462-9f07-42fa-9958-fed1310a69af admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.417079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643e462-9f07-42fa-9958-fed1310a69af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.418725 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643e462-9f07-42fa-9958-fed1310a69af admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.429530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 786/1582] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:03.430249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643e462-9f07-42fa-9958-fed1310a69af admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.435757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:03.440818 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643e462-9f07-42fa-9958-fed1310a69af admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.443639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 797/1583] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:03.445207 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d5bd5-728c-46bd-83cb-20c80f62e10b None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.445899 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d5bd5-728c-46bd-83cb-20c80f62e10b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.446540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d5bd5-728c-46bd-83cb-20c80f62e10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.449192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de2e88-4581-465e-8bbf-05c7257857e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.449957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de2e88-4581-465e-8bbf-05c7257857e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.450619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de2e88-4581-465e-8bbf-05c7257857e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.450619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de2e88-4581-465e-8bbf-05c7257857e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.451244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de2e88-4581-465e-8bbf-05c7257857e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.453243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de2e88-4581-465e-8bbf-05c7257857e8 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.473624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-818d5bd5-728c-46bd-83cb-20c80f62e10b None None] MFA Rules not processed for user `a0dd769a6a274608b688474ec38bc24e`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:03.475028 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-818d5bd5-728c-46bd-83cb-20c80f62e10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:03.475933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 787/1584] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:03.476654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de2e88-4581-465e-8bbf-05c7257857e8 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.487435 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de2e88-4581-465e-8bbf-05c7257857e8 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.542380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 798/1585] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:03.543423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d5bd5-728c-46bd-83cb-20c80f62e10b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.548935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efa4cf-2bbd-415a-b789-47e4b2a2033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.549658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efa4cf-2bbd-415a-b789-47e4b2a2033c admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.549971 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efa4cf-2bbd-415a-b789-47e4b2a2033c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.550252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efa4cf-2bbd-415a-b789-47e4b2a2033c admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.550950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efa4cf-2bbd-415a-b789-47e4b2a2033c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.552908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efa4cf-2bbd-415a-b789-47e4b2a2033c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.556635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d5bd5-728c-46bd-83cb-20c80f62e10b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.561821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30dc57-78cc-4661-96b4-34108212bebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.562685 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30dc57-78cc-4661-96b4-34108212bebf admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.563043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30dc57-78cc-4661-96b4-34108212bebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.563705 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30dc57-78cc-4661-96b4-34108212bebf admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.564478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30dc57-78cc-4661-96b4-34108212bebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.566781 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30dc57-78cc-4661-96b4-34108212bebf admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.574200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 788/1586] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:03.578977 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d3c1-fcda-4b05-980a-c9555744c52d None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.579350 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d3c1-fcda-4b05-980a-c9555744c52d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.579660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d3c1-fcda-4b05-980a-c9555744c52d None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.580912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 789/1587] 10.222.0.62 () {54 vars in 961 bytes} [Thu Jul 7 07:20:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:20:03.581729 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6d3c1-fcda-4b05-980a-c9555744c52d None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.593038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 799/1588] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:03.593038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30dc57-78cc-4661-96b4-34108212bebf admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.594908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6d3c1-fcda-4b05-980a-c9555744c52d None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.599960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428269c1-f23e-4262-a851-47f8cf38e185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.600776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428269c1-f23e-4262-a851-47f8cf38e185 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.601135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428269c1-f23e-4262-a851-47f8cf38e185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.601533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428269c1-f23e-4262-a851-47f8cf38e185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.602367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428269c1-f23e-4262-a851-47f8cf38e185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.603138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30dc57-78cc-4661-96b4-34108212bebf admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.604199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428269c1-f23e-4262-a851-47f8cf38e185 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.607946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13bb4c-f9fe-4e0e-9cf4-5a54d56078c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.608625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13bb4c-f9fe-4e0e-9cf4-5a54d56078c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.608908 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13bb4c-f9fe-4e0e-9cf4-5a54d56078c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.609185 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13bb4c-f9fe-4e0e-9cf4-5a54d56078c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.609957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13bb4c-f9fe-4e0e-9cf4-5a54d56078c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.611564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13bb4c-f9fe-4e0e-9cf4-5a54d56078c7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.620095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 790/1589] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:03.620095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428269c1-f23e-4262-a851-47f8cf38e185 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.625443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 800/1590] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:03.625443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13bb4c-f9fe-4e0e-9cf4-5a54d56078c7 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.629115 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428269c1-f23e-4262-a851-47f8cf38e185 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.635146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c507d-8f77-4167-a196-8b147130313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.635643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13bb4c-f9fe-4e0e-9cf4-5a54d56078c7 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.635842 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c507d-8f77-4167-a196-8b147130313a admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.636122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c507d-8f77-4167-a196-8b147130313a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.636399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c507d-8f77-4167-a196-8b147130313a admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.637099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c507d-8f77-4167-a196-8b147130313a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.639445 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c507d-8f77-4167-a196-8b147130313a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.640559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca7065-af0b-45f8-b55d-0f57507a84ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.641269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca7065-af0b-45f8-b55d-0f57507a84ce admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.641548 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca7065-af0b-45f8-b55d-0f57507a84ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.641809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca7065-af0b-45f8-b55d-0f57507a84ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.642545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca7065-af0b-45f8-b55d-0f57507a84ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.644232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca7065-af0b-45f8-b55d-0f57507a84ce admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.662957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 791/1591] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:03.663891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c507d-8f77-4167-a196-8b147130313a admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.665854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 801/1592] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:03.667578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca7065-af0b-45f8-b55d-0f57507a84ce admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.679514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c507d-8f77-4167-a196-8b147130313a admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.684546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca7065-af0b-45f8-b55d-0f57507a84ce admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.684786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf5590-f21c-442e-a394-26a062490315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.685339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf5590-f21c-442e-a394-26a062490315 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.685642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf5590-f21c-442e-a394-26a062490315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.685896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf5590-f21c-442e-a394-26a062490315 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.686600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf5590-f21c-442e-a394-26a062490315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.688880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf5590-f21c-442e-a394-26a062490315 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.691971 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129cab8-66bf-4274-ad0e-4d080193201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.692995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129cab8-66bf-4274-ad0e-4d080193201b admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.693484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129cab8-66bf-4274-ad0e-4d080193201b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.693908 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129cab8-66bf-4274-ad0e-4d080193201b admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.695058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129cab8-66bf-4274-ad0e-4d080193201b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.697741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129cab8-66bf-4274-ad0e-4d080193201b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.716083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 802/1593] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:03.718292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f18af-4de4-4430-bd7e-6163e4349635 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.718741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f18af-4de4-4430-bd7e-6163e4349635 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.720053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f18af-4de4-4430-bd7e-6163e4349635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.725010 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 792/1594] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:03.725010 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf5590-f21c-442e-a394-26a062490315 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.742286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e96f18af-4de4-4430-bd7e-6163e4349635 None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:03.743552 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e96f18af-4de4-4430-bd7e-6163e4349635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:03.763534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:03.794579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf5590-f21c-442e-a394-26a062490315 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.799770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a52ccf-0157-4780-8a86-0b761786cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.800460 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a52ccf-0157-4780-8a86-0b761786cef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.800738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a52ccf-0157-4780-8a86-0b761786cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.801012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a52ccf-0157-4780-8a86-0b761786cef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.801782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a52ccf-0157-4780-8a86-0b761786cef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.803398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a52ccf-0157-4780-8a86-0b761786cef3 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.814518 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 793/1595] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:03.815467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a52ccf-0157-4780-8a86-0b761786cef3 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.819927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 803/1596] 10.222.0.62 () {58 vars in 1058 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:03.821383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f18af-4de4-4430-bd7e-6163e4349635 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.827600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a52ccf-0157-4780-8a86-0b761786cef3 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.832696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0a9f1-c2b5-4800-9cd0-014dd8d612ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.833414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0a9f1-c2b5-4800-9cd0-014dd8d612ad admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.833700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0a9f1-c2b5-4800-9cd0-014dd8d612ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.833972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0a9f1-c2b5-4800-9cd0-014dd8d612ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.834081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f18af-4de4-4430-bd7e-6163e4349635 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.834727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0a9f1-c2b5-4800-9cd0-014dd8d612ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.836611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0a9f1-c2b5-4800-9cd0-014dd8d612ad admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.843256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda23aa-498c-4572-9009-9f21d8020c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.844839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda23aa-498c-4572-9009-9f21d8020c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.845330 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda23aa-498c-4572-9009-9f21d8020c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.845838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda23aa-498c-4572-9009-9f21d8020c33 admin admin] PATH_INFO: `/v3/projects/35c14f84eaf04060acc489e77027c824/users/16293fa03ced44cc994a0b8ad19ebb89/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.848641 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 794/1597] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:03.849646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0a9f1-c2b5-4800-9cd0-014dd8d612ad admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.860736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0a9f1-c2b5-4800-9cd0-014dd8d612ad admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.867444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3d119-c5f7-491d-bb75-8fc2f25434be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.868043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda23aa-498c-4572-9009-9f21d8020c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c14f84eaf04060acc489e77027c824, user_id=16293fa03ced44cc994a0b8ad19ebb89, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.868154 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3d119-c5f7-491d-bb75-8fc2f25434be admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.868399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3d119-c5f7-491d-bb75-8fc2f25434be admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.868683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3d119-c5f7-491d-bb75-8fc2f25434be admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.869475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3d119-c5f7-491d-bb75-8fc2f25434be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.870786 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda23aa-498c-4572-9009-9f21d8020c33 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.871080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3d119-c5f7-491d-bb75-8fc2f25434be admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.887389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 795/1598] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:03.888872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3d119-c5f7-491d-bb75-8fc2f25434be admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.891158 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 804/1599] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:03 2022] PUT /identity/v3/projects/35c14f84eaf04060acc489e77027c824/users/16293fa03ced44cc994a0b8ad19ebb89/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:03.894424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda23aa-498c-4572-9009-9f21d8020c33 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.901337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3d119-c5f7-491d-bb75-8fc2f25434be admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.904246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:03.962059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda23aa-498c-4572-9009-9f21d8020c33 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.962355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f24beb-8b37-4ef3-852d-71d999f3edfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.963047 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f24beb-8b37-4ef3-852d-71d999f3edfc admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.963333 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f24beb-8b37-4ef3-852d-71d999f3edfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.963618 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f24beb-8b37-4ef3-852d-71d999f3edfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.964492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f24beb-8b37-4ef3-852d-71d999f3edfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.966195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f24beb-8b37-4ef3-852d-71d999f3edfc admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.966851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c57c83-20fa-4a8f-8de2-ed55e2e8fc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.967532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c57c83-20fa-4a8f-8de2-ed55e2e8fc3b admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.967815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c57c83-20fa-4a8f-8de2-ed55e2e8fc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.968092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c57c83-20fa-4a8f-8de2-ed55e2e8fc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.968825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c57c83-20fa-4a8f-8de2-ed55e2e8fc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.970469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c57c83-20fa-4a8f-8de2-ed55e2e8fc3b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.976755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 796/1600] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:03.977736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f24beb-8b37-4ef3-852d-71d999f3edfc admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.984403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 805/1601] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:03.984403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c57c83-20fa-4a8f-8de2-ed55e2e8fc3b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:03.988166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f24beb-8b37-4ef3-852d-71d999f3edfc admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.993413 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c57c83-20fa-4a8f-8de2-ed55e2e8fc3b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:03.993574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82a7ad-d70c-4193-bc93-1573d8a43dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.994183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82a7ad-d70c-4193-bc93-1573d8a43dee admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.994515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82a7ad-d70c-4193-bc93-1573d8a43dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.994831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82a7ad-d70c-4193-bc93-1573d8a43dee admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:03.995626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82a7ad-d70c-4193-bc93-1573d8a43dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:03.997797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82a7ad-d70c-4193-bc93-1573d8a43dee admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:03.998303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff5732-9c30-4453-844d-a4c14efebf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:03.998985 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff5732-9c30-4453-844d-a4c14efebf00 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:03.999268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff5732-9c30-4453-844d-a4c14efebf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:03.999554 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff5732-9c30-4453-844d-a4c14efebf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.000279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff5732-9c30-4453-844d-a4c14efebf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:04.001927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff5732-9c30-4453-844d-a4c14efebf00 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:04.017320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 806/1602] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:04.017320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff5732-9c30-4453-844d-a4c14efebf00 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:04.020700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 797/1603] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:03 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:04.021867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82a7ad-d70c-4193-bc93-1573d8a43dee admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:04.033149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82a7ad-d70c-4193-bc93-1573d8a43dee admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:04.038123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dde0be-6205-46b3-aa5f-7ad3781c4834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:04.039007 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dde0be-6205-46b3-aa5f-7ad3781c4834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.039287 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dde0be-6205-46b3-aa5f-7ad3781c4834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.039555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dde0be-6205-46b3-aa5f-7ad3781c4834 admin admin] PATH_INFO: `/v3/projects/84b6bc8d4371469ebb4ce41341edd578/users/f60ff411561f4519ace8155eab74ede5/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.054470 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dde0be-6205-46b3-aa5f-7ad3781c4834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b6bc8d4371469ebb4ce41341edd578, user_id=f60ff411561f4519ace8155eab74ede5, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:04.057135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dde0be-6205-46b3-aa5f-7ad3781c4834 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:04.073142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 798/1604] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:04 2022] PUT /identity/v3/projects/84b6bc8d4371469ebb4ce41341edd578/users/f60ff411561f4519ace8155eab74ede5/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:04.074008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dde0be-6205-46b3-aa5f-7ad3781c4834 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:04.089796 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff5732-9c30-4453-844d-a4c14efebf00 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:04.152024 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dde0be-6205-46b3-aa5f-7ad3781c4834 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:04.154903 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdca77-4c49-4de1-afdb-50cbe93806c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:04.155574 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdca77-4c49-4de1-afdb-50cbe93806c7 service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.155852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdca77-4c49-4de1-afdb-50cbe93806c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.156125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdca77-4c49-4de1-afdb-50cbe93806c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.157300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df95b2-5cc2-4a7d-a477-fd6488958cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:04.157970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df95b2-5cc2-4a7d-a477-fd6488958cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.158251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df95b2-5cc2-4a7d-a477-fd6488958cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.158556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df95b2-5cc2-4a7d-a477-fd6488958cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.159246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df95b2-5cc2-4a7d-a477-fd6488958cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:04.160851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df95b2-5cc2-4a7d-a477-fd6488958cb2 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:04.162370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:04.173741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 799/1605] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:04.175260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fa714-57ed-4753-9c00-4251fed52c1f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.175641 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fa714-57ed-4753-9c00-4251fed52c1f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.175910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fa714-57ed-4753-9c00-4251fed52c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.186788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:04.196334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-6b3fa714-57ed-4753-9c00-4251fed52c1f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:04.197600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6b3fa714-57ed-4753-9c00-4251fed52c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:04.205485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 800/1606] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:04.206298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fa714-57ed-4753-9c00-4251fed52c1f None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:04.216573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fa714-57ed-4753-9c00-4251fed52c1f None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:04.220723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdca77-4c49-4de1-afdb-50cbe93806c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:04.222365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdca77-4c49-4de1-afdb-50cbe93806c7 service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:04.222973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830def9d-52b8-48e5-81ce-9a6b84f6cfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:04.223896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830def9d-52b8-48e5-81ce-9a6b84f6cfd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.224212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830def9d-52b8-48e5-81ce-9a6b84f6cfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.224490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830def9d-52b8-48e5-81ce-9a6b84f6cfd4 admin admin] PATH_INFO: `/v3/projects/098a9c621a0141008576a42ffd36036f/users/32aec824297f4c38ab0af1630974cdf7/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.231659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 807/1607] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:04.232264 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdca77-4c49-4de1-afdb-50cbe93806c7 service nova] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:04.240270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830def9d-52b8-48e5-81ce-9a6b84f6cfd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098a9c621a0141008576a42ffd36036f, user_id=32aec824297f4c38ab0af1630974cdf7, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:04.242361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdca77-4c49-4de1-afdb-50cbe93806c7 service nova] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:04.243053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830def9d-52b8-48e5-81ce-9a6b84f6cfd4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:04.247819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088ac0f-4221-4614-93c7-e0156328168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:04.248846 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088ac0f-4221-4614-93c7-e0156328168d admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.249159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088ac0f-4221-4614-93c7-e0156328168d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.249495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088ac0f-4221-4614-93c7-e0156328168d admin admin] PATH_INFO: `/v3/projects/7e48122318d446438ef9974475c3f6ca/users/d6db138644b14a20a43b3b1b3fa63314/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.260333 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 801/1608] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:04 2022] PUT /identity/v3/projects/098a9c621a0141008576a42ffd36036f/users/32aec824297f4c38ab0af1630974cdf7/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:04.261949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830def9d-52b8-48e5-81ce-9a6b84f6cfd4 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:04.272094 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088ac0f-4221-4614-93c7-e0156328168d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e48122318d446438ef9974475c3f6ca, user_id=d6db138644b14a20a43b3b1b3fa63314, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:04.275192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088ac0f-4221-4614-93c7-e0156328168d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:04.291865 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 808/1609] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:04 2022] PUT /identity/v3/projects/7e48122318d446438ef9974475c3f6ca/users/d6db138644b14a20a43b3b1b3fa63314/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:04.293033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088ac0f-4221-4614-93c7-e0156328168d admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:04.341201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830def9d-52b8-48e5-81ce-9a6b84f6cfd4 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:04.361658 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088ac0f-4221-4614-93c7-e0156328168d admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:04.367274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8694c-0afe-4b68-ad96-062861a3a681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:04.368202 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8694c-0afe-4b68-ad96-062861a3a681 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.368681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8694c-0afe-4b68-ad96-062861a3a681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.368952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8694c-0afe-4b68-ad96-062861a3a681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.369740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8694c-0afe-4b68-ad96-062861a3a681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:04.371374 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8694c-0afe-4b68-ad96-062861a3a681 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:04.382636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 809/1610] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:04.387128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bec98-d4eb-4749-be05-4e7cc3efcb44 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.387429 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bec98-d4eb-4749-be05-4e7cc3efcb44 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.388227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bec98-d4eb-4749-be05-4e7cc3efcb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.409837 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99330f-93e8-4143-9ce9-9eede5b641a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:04.410865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99330f-93e8-4143-9ce9-9eede5b641a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.411248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99330f-93e8-4143-9ce9-9eede5b641a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.411561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99330f-93e8-4143-9ce9-9eede5b641a6 admin admin] PATH_INFO: `/v3/projects/883f7310b404427fa3ddda37a8d04acc/users/58366850e234491cafe268bb56e9e3a1/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.426587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-de0bec98-d4eb-4749-be05-4e7cc3efcb44 None None] MFA Rules not processed for user `f60ff411561f4519ace8155eab74ede5`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:04.427241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99330f-93e8-4143-9ce9-9eede5b641a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=883f7310b404427fa3ddda37a8d04acc, user_id=58366850e234491cafe268bb56e9e3a1, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:04.427824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-de0bec98-d4eb-4749-be05-4e7cc3efcb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:04.430088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99330f-93e8-4143-9ce9-9eede5b641a6 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:04.446199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 802/1611] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:04 2022] PUT /identity/v3/projects/883f7310b404427fa3ddda37a8d04acc/users/58366850e234491cafe268bb56e9e3a1/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:04.447095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99330f-93e8-4143-9ce9-9eede5b641a6 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:04.513645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 810/1612] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:04.515466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bec98-d4eb-4749-be05-4e7cc3efcb44 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:04.530193 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:04.535748 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99330f-93e8-4143-9ce9-9eede5b641a6 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:04.548352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1882f5e-4478-44fc-ba2f-5f14a7341cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:04.549637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1882f5e-4478-44fc-ba2f-5f14a7341cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.550536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1882f5e-4478-44fc-ba2f-5f14a7341cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.550536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1882f5e-4478-44fc-ba2f-5f14a7341cdf admin admin] PATH_INFO: `/v3/projects/6b6345958b424ceeb06285db0fc8d877/users/3401cbd655eb4dffb2acb46cfbdd9259/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.558730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:04.568951 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1882f5e-4478-44fc-ba2f-5f14a7341cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6345958b424ceeb06285db0fc8d877, user_id=3401cbd655eb4dffb2acb46cfbdd9259, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:04.571821 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1882f5e-4478-44fc-ba2f-5f14a7341cdf admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:04.589420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 803/1613] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:04 2022] PUT /identity/v3/projects/6b6345958b424ceeb06285db0fc8d877/users/3401cbd655eb4dffb2acb46cfbdd9259/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:04.591317 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276881c0-953f-44b3-aa1e-4df34e5c7e36 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.591782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276881c0-953f-44b3-aa1e-4df34e5c7e36 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.592332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276881c0-953f-44b3-aa1e-4df34e5c7e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.594952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bec98-d4eb-4749-be05-4e7cc3efcb44 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:04.622911 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-276881c0-953f-44b3-aa1e-4df34e5c7e36 None None] MFA Rules not processed for user `32aec824297f4c38ab0af1630974cdf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:04.624426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-276881c0-953f-44b3-aa1e-4df34e5c7e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:04.650711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc34fb-7df9-491f-a2f0-1de8570ce538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:04.651627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc34fb-7df9-491f-a2f0-1de8570ce538 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.651994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc34fb-7df9-491f-a2f0-1de8570ce538 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.652341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc34fb-7df9-491f-a2f0-1de8570ce538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.708473 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 804/1614] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:04.710055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982fd2d-37a3-4864-9d81-84266c5265ba None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.710464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982fd2d-37a3-4864-9d81-84266c5265ba None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.710846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982fd2d-37a3-4864-9d81-84266c5265ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.729051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc34fb-7df9-491f-a2f0-1de8570ce538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:04.730712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc34fb-7df9-491f-a2f0-1de8570ce538 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:04.737537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1982fd2d-37a3-4864-9d81-84266c5265ba None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:04.738766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1982fd2d-37a3-4864-9d81-84266c5265ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:04.742176 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 811/1615] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:04.743148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc34fb-7df9-491f-a2f0-1de8570ce538 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:04.747824 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 805/1616] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:04.749163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac1dbb-3950-4327-b5a6-88d78df94989 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.749526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac1dbb-3950-4327-b5a6-88d78df94989 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.749776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac1dbb-3950-4327-b5a6-88d78df94989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.760482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc34fb-7df9-491f-a2f0-1de8570ce538 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:04.769776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-22ac1dbb-3950-4327-b5a6-88d78df94989 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:04.771133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-22ac1dbb-3950-4327-b5a6-88d78df94989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:04.773915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fb2fa-a8bd-458c-96e6-03256b8458fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:04.774982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fb2fa-a8bd-458c-96e6-03256b8458fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.775271 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fb2fa-a8bd-458c-96e6-03256b8458fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.775580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fb2fa-a8bd-458c-96e6-03256b8458fd admin admin] PATH_INFO: `/v3/projects/124f2279aa644b7ea0155a0ac58a001c/users/50364b4a488843d7824b707fc2a6e0b6/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.786933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 806/1617] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:04.786933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac1dbb-3950-4327-b5a6-88d78df94989 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:04.805017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fb2fa-a8bd-458c-96e6-03256b8458fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=124f2279aa644b7ea0155a0ac58a001c, user_id=50364b4a488843d7824b707fc2a6e0b6, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:04.808448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fb2fa-a8bd-458c-96e6-03256b8458fd admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:04.830723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 812/1618] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:04 2022] PUT /identity/v3/projects/124f2279aa644b7ea0155a0ac58a001c/users/50364b4a488843d7824b707fc2a6e0b6/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:04.834682 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c57a-09ec-4339-8fc3-75833d969fe1 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.835463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c57a-09ec-4339-8fc3-75833d969fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.835752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c57a-09ec-4339-8fc3-75833d969fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.859720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-d742c57a-09ec-4339-8fc3-75833d969fe1 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:04.861298 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d742c57a-09ec-4339-8fc3-75833d969fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:04.915725 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac1dbb-3950-4327-b5a6-88d78df94989 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:04.951522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 813/1619] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:04.952524 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c57a-09ec-4339-8fc3-75833d969fe1 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:04.973420 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c57a-09ec-4339-8fc3-75833d969fe1 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:04.978147 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:04.981739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea9c3d-6d20-439b-a2bc-f568d4644ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:04.983166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea9c3d-6d20-439b-a2bc-f568d4644ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:04.983790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea9c3d-6d20-439b-a2bc-f568d4644ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:04.984509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea9c3d-6d20-439b-a2bc-f568d4644ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:04.986440 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea9c3d-6d20-439b-a2bc-f568d4644ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:04.991218 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea9c3d-6d20-439b-a2bc-f568d4644ef0 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:05.002987 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f60c49-8da9-4b4d-bbd9-12065154b413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:05.003740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f60c49-8da9-4b4d-bbd9-12065154b413 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.004032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f60c49-8da9-4b4d-bbd9-12065154b413 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.004313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f60c49-8da9-4b4d-bbd9-12065154b413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.005610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:05.031949 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 814/1620] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:04 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:05.033014 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea9c3d-6d20-439b-a2bc-f568d4644ef0 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:05.075962 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f60c49-8da9-4b4d-bbd9-12065154b413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:05.077877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f60c49-8da9-4b4d-bbd9-12065154b413 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:05.089177 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 807/1621] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:05.096065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef9f79-e6e6-4379-852d-80c28ab47ade None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.096769 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef9f79-e6e6-4379-852d-80c28ab47ade None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.097159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef9f79-e6e6-4379-852d-80c28ab47ade None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.099925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 808/1622] 10.222.0.62 () {54 vars in 961 bytes} [Thu Jul 7 07:20:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:20:05.101708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef9f79-e6e6-4379-852d-80c28ab47ade None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:05.106400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea9c3d-6d20-439b-a2bc-f568d4644ef0 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:05.111206 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85de79-972e-44b3-b5b4-a9b9f66ff8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:05.112646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85de79-972e-44b3-b5b4-a9b9f66ff8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.112973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85de79-972e-44b3-b5b4-a9b9f66ff8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.113287 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85de79-972e-44b3-b5b4-a9b9f66ff8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.117531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef9f79-e6e6-4379-852d-80c28ab47ade None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:05.124608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6433db0-7bc4-4e8c-8b52-5affb6181151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:05.126106 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6433db0-7bc4-4e8c-8b52-5affb6181151 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.126830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6433db0-7bc4-4e8c-8b52-5affb6181151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.127405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6433db0-7bc4-4e8c-8b52-5affb6181151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.200042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85de79-972e-44b3-b5b4-a9b9f66ff8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:05.202870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85de79-972e-44b3-b5b4-a9b9f66ff8a7 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:05.205448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6433db0-7bc4-4e8c-8b52-5affb6181151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:05.207151 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6433db0-7bc4-4e8c-8b52-5affb6181151 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:05.214452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 815/1623] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:05.215328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85de79-972e-44b3-b5b4-a9b9f66ff8a7 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:05.225296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85de79-972e-44b3-b5b4-a9b9f66ff8a7 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:05.231598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac56bd-9b95-4877-a777-111939d98b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:05.232515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac56bd-9b95-4877-a777-111939d98b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.232658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 809/1624] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:05.233142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac56bd-9b95-4877-a777-111939d98b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.233610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac56bd-9b95-4877-a777-111939d98b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.233736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6433db0-7bc4-4e8c-8b52-5affb6181151 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:05.235370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac56bd-9b95-4877-a777-111939d98b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:05.250920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac56bd-9b95-4877-a777-111939d98b37 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:05.251080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6433db0-7bc4-4e8c-8b52-5affb6181151 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:05.256417 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dc23e-8dbb-4c64-bdd1-d2d04439f06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:05.257129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc23e-8dbb-4c64-bdd1-d2d04439f06c service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.257444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc23e-8dbb-4c64-bdd1-d2d04439f06c service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.257725 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc23e-8dbb-4c64-bdd1-d2d04439f06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.269315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dc23e-8dbb-4c64-bdd1-d2d04439f06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:05.272043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dc23e-8dbb-4c64-bdd1-d2d04439f06c service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:05.284126 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 816/1625] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:05.285700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 810/1626] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:05.287401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfeb33-619d-42a4-a25a-2e2c0e63183f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.287740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfeb33-619d-42a4-a25a-2e2c0e63183f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.288156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfeb33-619d-42a4-a25a-2e2c0e63183f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.291444 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac56bd-9b95-4877-a777-111939d98b37 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:05.309909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-15bfeb33-619d-42a4-a25a-2e2c0e63183f None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:05.311236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-15bfeb33-619d-42a4-a25a-2e2c0e63183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:05.317323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac56bd-9b95-4877-a777-111939d98b37 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:05.334701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb4386-2959-4b4c-aebb-40da9b1c7f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:05.336081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4386-2959-4b4c-aebb-40da9b1c7f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.336374 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4386-2959-4b4c-aebb-40da9b1c7f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.338770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4386-2959-4b4c-aebb-40da9b1c7f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.339551 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb4386-2959-4b4c-aebb-40da9b1c7f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:05.348136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb4386-2959-4b4c-aebb-40da9b1c7f88 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:05.402157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 817/1627] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:05 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:05.407350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd999b9-df3b-4d20-9a44-43b19e7abf33 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.408430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd999b9-df3b-4d20-9a44-43b19e7abf33 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.408771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd999b9-df3b-4d20-9a44-43b19e7abf33 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.411244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 818/1628] 10.222.0.62 () {54 vars in 912 bytes} [Thu Jul 7 07:20:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:20:05.414402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd999b9-df3b-4d20-9a44-43b19e7abf33 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:05.451741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd999b9-df3b-4d20-9a44-43b19e7abf33 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:05.458974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba2929-5fbe-41b9-8b8f-4bfc4c1e3de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:05.460153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba2929-5fbe-41b9-8b8f-4bfc4c1e3de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.460517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba2929-5fbe-41b9-8b8f-4bfc4c1e3de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.460914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba2929-5fbe-41b9-8b8f-4bfc4c1e3de6 admin admin] PATH_INFO: `/v3/projects/124f2279aa644b7ea0155a0ac58a001c/users/50364b4a488843d7824b707fc2a6e0b6/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.462919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 811/1629] 10.222.0.62 () {58 vars in 1058 bytes} [Thu Jul 7 07:20:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:05.465430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba2929-5fbe-41b9-8b8f-4bfc4c1e3de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124f2279aa644b7ea0155a0ac58a001c, user_id=50364b4a488843d7824b707fc2a6e0b6, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:05.468716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba2929-5fbe-41b9-8b8f-4bfc4c1e3de6 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:05.468957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfeb33-619d-42a4-a25a-2e2c0e63183f None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:05.474996 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:05.486197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfeb33-619d-42a4-a25a-2e2c0e63183f None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:05.488303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 819/1630] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:05 2022] PUT /identity/v3/projects/124f2279aa644b7ea0155a0ac58a001c/users/50364b4a488843d7824b707fc2a6e0b6/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:05.503296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563be74-cb9a-4847-80a6-4b3e2775e22e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.503678 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563be74-cb9a-4847-80a6-4b3e2775e22e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.503901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563be74-cb9a-4847-80a6-4b3e2775e22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.535741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-f563be74-cb9a-4847-80a6-4b3e2775e22e None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:05.537387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f563be74-cb9a-4847-80a6-4b3e2775e22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:05.573977 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cde9bd-39b7-4723-bdb4-6bd91df2055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:05.574877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cde9bd-39b7-4723-bdb4-6bd91df2055c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.575303 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cde9bd-39b7-4723-bdb4-6bd91df2055c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.575671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cde9bd-39b7-4723-bdb4-6bd91df2055c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.576556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cde9bd-39b7-4723-bdb4-6bd91df2055c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:05.578391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cde9bd-39b7-4723-bdb4-6bd91df2055c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:05.591672 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 812/1631] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:05.593799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205d88d-dd52-41cb-acb1-e1c28cfbb878 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.594564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205d88d-dd52-41cb-acb1-e1c28cfbb878 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.595270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205d88d-dd52-41cb-acb1-e1c28cfbb878 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.596879 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 813/1632] 10.222.0.62 () {54 vars in 912 bytes} [Thu Jul 7 07:20:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:20:05.598243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ff6e2-e574-4bcd-9d77-a66ac2369033 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.598607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ff6e2-e574-4bcd-9d77-a66ac2369033 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.598992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ff6e2-e574-4bcd-9d77-a66ac2369033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.612074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:05.640381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 820/1633] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:20:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:05.640605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-3e2ff6e2-e574-4bcd-9d77-a66ac2369033 None None] MFA Rules not processed for user `50364b4a488843d7824b707fc2a6e0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:05.641541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563be74-cb9a-4847-80a6-4b3e2775e22e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:05.642324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3e2ff6e2-e574-4bcd-9d77-a66ac2369033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:05.655856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563be74-cb9a-4847-80a6-4b3e2775e22e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:05.662009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398d746-fdc4-42a9-b390-b44714b5919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:05.663632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398d746-fdc4-42a9-b390-b44714b5919a admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.664198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398d746-fdc4-42a9-b390-b44714b5919a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.664680 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398d746-fdc4-42a9-b390-b44714b5919a admin admin] PATH_INFO: `/v3/projects/734172f850304fa4a93c1530f8016c18/users/6801bd593c844dbd81b951bc8a7d5a0f/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.687562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398d746-fdc4-42a9-b390-b44714b5919a admin admin] RBAC: Authorizing `identity:create_grant(project_id=734172f850304fa4a93c1530f8016c18, user_id=6801bd593c844dbd81b951bc8a7d5a0f, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:05.693559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398d746-fdc4-42a9-b390-b44714b5919a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:05.720513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 821/1634] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:05 2022] PUT /identity/v3/projects/734172f850304fa4a93c1530f8016c18/users/6801bd593c844dbd81b951bc8a7d5a0f/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:05.726186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27147d4e-8d01-41bb-80d1-bcaeb96004e6 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:05.726761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27147d4e-8d01-41bb-80d1-bcaeb96004e6 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:05.727264 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27147d4e-8d01-41bb-80d1-bcaeb96004e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:05.763696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-27147d4e-8d01-41bb-80d1-bcaeb96004e6 None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:05.765628 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-27147d4e-8d01-41bb-80d1-bcaeb96004e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:05.823814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 814/1635] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:05 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:05.830388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ff6e2-e574-4bcd-9d77-a66ac2369033 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:05.950982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 822/1636] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:20:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:05.951998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27147d4e-8d01-41bb-80d1-bcaeb96004e6 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:05.970193 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ff6e2-e574-4bcd-9d77-a66ac2369033 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:06.022166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:06.037617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0bde-b8d6-4180-90e2-f0e8c0db7767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:06.038359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0bde-b8d6-4180-90e2-f0e8c0db7767 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:06.038681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0bde-b8d6-4180-90e2-f0e8c0db7767 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:06.039097 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0bde-b8d6-4180-90e2-f0e8c0db7767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:06.052393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc0bde-b8d6-4180-90e2-f0e8c0db7767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:06.053990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc0bde-b8d6-4180-90e2-f0e8c0db7767 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:06.068700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 815/1637] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:06.070270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0bde-b8d6-4180-90e2-f0e8c0db7767 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:06.087376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0bde-b8d6-4180-90e2-f0e8c0db7767 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:06.092024 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5c5db-a48d-473d-9a88-ac1d302f2de5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:06.093635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5c5db-a48d-473d-9a88-ac1d302f2de5 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:06.093635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5c5db-a48d-473d-9a88-ac1d302f2de5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:06.093850 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5c5db-a48d-473d-9a88-ac1d302f2de5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:06.106701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27147d4e-8d01-41bb-80d1-bcaeb96004e6 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:06.118323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f9e40-ec0f-4cc6-a2e7-aab2a6ad40eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:06.120742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f9e40-ec0f-4cc6-a2e7-aab2a6ad40eb admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:06.121168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f9e40-ec0f-4cc6-a2e7-aab2a6ad40eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:06.122121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f9e40-ec0f-4cc6-a2e7-aab2a6ad40eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:06.123904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f9e40-ec0f-4cc6-a2e7-aab2a6ad40eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:06.128171 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f9e40-ec0f-4cc6-a2e7-aab2a6ad40eb admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:06.149768 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 823/1638] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:06.153618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f9e40-ec0f-4cc6-a2e7-aab2a6ad40eb admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:06.166991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f9e40-ec0f-4cc6-a2e7-aab2a6ad40eb admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:06.173075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f833c-3221-4769-8895-e9875b13cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:06.175655 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f833c-3221-4769-8895-e9875b13cdb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:06.175996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f833c-3221-4769-8895-e9875b13cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:06.176380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f833c-3221-4769-8895-e9875b13cdb5 admin admin] PATH_INFO: `/v3/projects/734172f850304fa4a93c1530f8016c18/users/6801bd593c844dbd81b951bc8a7d5a0f/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:06.179500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f833c-3221-4769-8895-e9875b13cdb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734172f850304fa4a93c1530f8016c18, user_id=6801bd593c844dbd81b951bc8a7d5a0f, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:06.182448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f833c-3221-4769-8895-e9875b13cdb5 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:06.199309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 824/1639] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:06 2022] PUT /identity/v3/projects/734172f850304fa4a93c1530f8016c18/users/6801bd593c844dbd81b951bc8a7d5a0f/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:06.208012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5c5db-a48d-473d-9a88-ac1d302f2de5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:06.210029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662b9c-b24f-493f-91b8-8b9333b401a1 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:06.210429 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662b9c-b24f-493f-91b8-8b9333b401a1 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:06.210895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662b9c-b24f-493f-91b8-8b9333b401a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:06.218419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5c5db-a48d-473d-9a88-ac1d302f2de5 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:06.247851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-12662b9c-b24f-493f-91b8-8b9333b401a1 None None] MFA Rules not processed for user `6801bd593c844dbd81b951bc8a7d5a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:06.250254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-12662b9c-b24f-493f-91b8-8b9333b401a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:06.250439 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 816/1640] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:06.311154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:06.370267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5c5db-a48d-473d-9a88-ac1d302f2de5 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:06.382814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5c5db-a48d-473d-9a88-ac1d302f2de5 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:06.451284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 825/1641] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:06.513261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d77b6-f8cf-4268-8a73-7342bc79125f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:06.514011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d77b6-f8cf-4268-8a73-7342bc79125f service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:06.514407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d77b6-f8cf-4268-8a73-7342bc79125f service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:06.514781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d77b6-f8cf-4268-8a73-7342bc79125f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:06.680786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d77b6-f8cf-4268-8a73-7342bc79125f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:06.685135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d77b6-f8cf-4268-8a73-7342bc79125f service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:06.713057 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 817/1642] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:20:06.905077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12662b9c-b24f-493f-91b8-8b9333b401a1 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:06.925434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12662b9c-b24f-493f-91b8-8b9333b401a1 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:06.936737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca826-bb43-4e60-9deb-d8dd6883a533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:06.939593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca826-bb43-4e60-9deb-d8dd6883a533 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:06.939796 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca826-bb43-4e60-9deb-d8dd6883a533 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:06.940691 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca826-bb43-4e60-9deb-d8dd6883a533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:06.972029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ca826-bb43-4e60-9deb-d8dd6883a533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:06.975852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ca826-bb43-4e60-9deb-d8dd6883a533 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:07.006353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 826/1643] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:07.124270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d77b6-f8cf-4268-8a73-7342bc79125f service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:07.139926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d77b6-f8cf-4268-8a73-7342bc79125f service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:07.151738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a5f12-a3de-459c-bd64-1d1180bb7ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:07.152874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a5f12-a3de-459c-bd64-1d1180bb7ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:07.153315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a5f12-a3de-459c-bd64-1d1180bb7ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:07.153641 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a5f12-a3de-459c-bd64-1d1180bb7ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:07.188192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:07.321094 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a5f12-a3de-459c-bd64-1d1180bb7ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:07.324087 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a5f12-a3de-459c-bd64-1d1180bb7ed0 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:07.360799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 818/1644] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:07 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:07.490641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca826-bb43-4e60-9deb-d8dd6883a533 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:07.658198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca826-bb43-4e60-9deb-d8dd6883a533 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:07.743359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:07.743359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:07.743359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:07.743359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] PATH_INFO: `/v3/users/00ccad5420c643d5a2156f83eaf508c9` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:07.758493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00ccad5420c643d5a2156f83eaf508c9)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:07.758493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:07.840187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ccad5420c643d5a2156f83eaf508c9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:07.840852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ccad5420c643d5a2156f83eaf508c9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:07.843138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ccad5420c643d5a2156f83eaf508c9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:07.862451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ccad5420c643d5a2156f83eaf508c9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:07.883754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ccad5420c643d5a2156f83eaf508c9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:07.946198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 827/1645] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:07 2022] DELETE /identity/v3/users/00ccad5420c643d5a2156f83eaf508c9 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:07.946530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8db48-50e6-4980-8550-83289eecec59 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:07.946701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8db48-50e6-4980-8550-83289eecec59 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:07.947144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8db48-50e6-4980-8550-83289eecec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:08.017502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-73d8db48-50e6-4980-8550-83289eecec59 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:08.028484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-73d8db48-50e6-4980-8550-83289eecec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:08.178213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:08.180579 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:08.213506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 819/1646] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:08.232460 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8db48-50e6-4980-8550-83289eecec59 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:08.237985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-73d8db48-50e6-4980-8550-83289eecec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:08.261535 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:08.311827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9d6a5-031a-470b-8054-5aed3934e862 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:08.320058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:08.323342 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:08.325717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:08.326211 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] PATH_INFO: `/v3/users/32aec824297f4c38ab0af1630974cdf7` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:08.328390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32aec824297f4c38ab0af1630974cdf7)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:08.331168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:08.415161 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8db48-50e6-4980-8550-83289eecec59 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:08.444677 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4de655-a999-4840-9fef-81f0bc27ba66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:08.446430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4de655-a999-4840-9fef-81f0bc27ba66 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:08.446904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4de655-a999-4840-9fef-81f0bc27ba66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:08.447693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4de655-a999-4840-9fef-81f0bc27ba66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:08.471973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32aec824297f4c38ab0af1630974cdf7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:08.474004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32aec824297f4c38ab0af1630974cdf7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:08.474988 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32aec824297f4c38ab0af1630974cdf7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:08.503256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4de655-a999-4840-9fef-81f0bc27ba66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:08.506010 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4de655-a999-4840-9fef-81f0bc27ba66 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:08.506491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32aec824297f4c38ab0af1630974cdf7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:08.531528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32aec824297f4c38ab0af1630974cdf7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:08.565058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 820/1647] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:08.589729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 828/1648] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:08 2022] DELETE /identity/v3/users/32aec824297f4c38ab0af1630974cdf7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:08.593541 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f5ea-af1e-4175-bc71-6a873f593ea1 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:08.594060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f5ea-af1e-4175-bc71-6a873f593ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:08.594584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f5ea-af1e-4175-bc71-6a873f593ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:08.649728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a348f5ea-af1e-4175-bc71-6a873f593ea1 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:08.651104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a348f5ea-af1e-4175-bc71-6a873f593ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:08.861045 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:08.946775 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 821/1649] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:08.960371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:08.969389 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:09.216409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6ae6-d21c-41d7-aa1d-a2d010f32796 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:09.232623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9ed8-f6d8-4660-b30a-53e7f5363356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:09.233725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9ed8-f6d8-4660-b30a-53e7f5363356 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:09.234232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9ed8-f6d8-4660-b30a-53e7f5363356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:09.234809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9ed8-f6d8-4660-b30a-53e7f5363356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:09.276184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee9ed8-f6d8-4660-b30a-53e7f5363356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:09.283746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee9ed8-f6d8-4660-b30a-53e7f5363356 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:09.329512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 829/1650] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:10.122992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f5ea-af1e-4175-bc71-6a873f593ea1 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:10.124775 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a348f5ea-af1e-4175-bc71-6a873f593ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:10.150631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f5ea-af1e-4175-bc71-6a873f593ea1 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:10.168235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:10.169525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:10.169916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:10.170323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] PATH_INFO: `/v3/users/f60ff411561f4519ace8155eab74ede5` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:10.174121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60ff411561f4519ace8155eab74ede5)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:10.177642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: WARNING py.warnings [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:20:10.177642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: warnings.warn(msg) Jul 07 07:20:10.177642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: Jul 07 07:20:10.183929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:10.366271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60ff411561f4519ace8155eab74ede5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:10.367485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60ff411561f4519ace8155eab74ede5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:10.369139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60ff411561f4519ace8155eab74ede5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:10.393356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60ff411561f4519ace8155eab74ede5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:10.418660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60ff411561f4519ace8155eab74ede5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:10.504683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25804d5-50a9-4a26-9e31-5abb074f35d1 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:10.505087 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25804d5-50a9-4a26-9e31-5abb074f35d1 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:10.505281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25804d5-50a9-4a26-9e31-5abb074f35d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:10.512110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 822/1651] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:10 2022] DELETE /identity/v3/users/f60ff411561f4519ace8155eab74ede5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:10.548811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-f25804d5-50a9-4a26-9e31-5abb074f35d1 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:10.550132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f25804d5-50a9-4a26-9e31-5abb074f35d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:10.618614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:10.620420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:10.674704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:10.706526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 830/1652] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:10.707759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25804d5-50a9-4a26-9e31-5abb074f35d1 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:10.714956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f25804d5-50a9-4a26-9e31-5abb074f35d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:10.752601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25804d5-50a9-4a26-9e31-5abb074f35d1 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:10.765776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:10.767928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:10.768226 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:10.768507 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] PATH_INFO: `/v3/projects/93f50f24f7ca48a09dfc96343450dc53` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:10.776652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f50f24f7ca48a09dfc96343450dc53)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:10.778229 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: WARNING py.warnings [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:20:10.778229 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: warnings.warn(msg) Jul 07 07:20:10.778229 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: Jul 07 07:20:10.779973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:10.790612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e0ec4-9b06-4dca-9d53-87b6b2027bd0 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:10.808017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:10.809196 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:10.809681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:10.810068 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] PATH_INFO: `/v3/projects/098a9c621a0141008576a42ffd36036f` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:10.812657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098a9c621a0141008576a42ffd36036f)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:10.819656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:10.930300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f50f24f7ca48a09dfc96343450dc53', 'request_id': 'req-7e1c4bdf-a930-4ec8-8914-18d76c3867df'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:10.946399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f50f24f7ca48a09dfc96343450dc53', 'request_id': 'req-7e1c4bdf-a930-4ec8-8914-18d76c3867df'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:10.960094 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098a9c621a0141008576a42ffd36036f', 'request_id': 'req-ed664f35-d518-4300-ba43-25f346cfb213'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:10.966255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f50f24f7ca48a09dfc96343450dc53', 'request_id': 'req-7e1c4bdf-a930-4ec8-8914-18d76c3867df'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:10.977031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098a9c621a0141008576a42ffd36036f', 'request_id': 'req-ed664f35-d518-4300-ba43-25f346cfb213'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:10.990441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098a9c621a0141008576a42ffd36036f', 'request_id': 'req-ed664f35-d518-4300-ba43-25f346cfb213'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:11.011402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] The token cache is being invalidate because project 098a9c621a0141008576a42ffd36036f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:11.012072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:11.013640 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:11.018770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 823/1653] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:10 2022] DELETE /identity/v3/projects/098a9c621a0141008576a42ffd36036f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:11.020110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:11.026364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:11.029597 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] The token cache is being invalidate because project 93f50f24f7ca48a09dfc96343450dc53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:11.030917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:11.032508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:11.036333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 831/1654] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:10 2022] DELETE /identity/v3/projects/93f50f24f7ca48a09dfc96343450dc53 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:11.041674 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:11.044929 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:11.049530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:11.184996 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed664f35-d518-4300-ba43-25f346cfb213 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:11.196574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3595490-3750-4b98-8d25-69d7d2505e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:11.208969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3595490-3750-4b98-8d25-69d7d2505e7f service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:11.209757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3595490-3750-4b98-8d25-69d7d2505e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:11.210565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3595490-3750-4b98-8d25-69d7d2505e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:11.217888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d3595490-3750-4b98-8d25-69d7d2505e7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:11.259950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c4bdf-a930-4ec8-8914-18d76c3867df admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:11.378243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3595490-3750-4b98-8d25-69d7d2505e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:11.379853 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3595490-3750-4b98-8d25-69d7d2505e7f service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:11.401413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 824/1655] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:11.409646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a2e13-df8f-4f63-830e-417963627daa None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:11.409646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a2e13-df8f-4f63-830e-417963627daa None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:11.409646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a2e13-df8f-4f63-830e-417963627daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:11.452977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:11.454077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:11.454430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:11.454773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] PATH_INFO: `/v3/users/6801bd593c844dbd81b951bc8a7d5a0f` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:11.456727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6801bd593c844dbd81b951bc8a7d5a0f)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:11.460467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:11.481098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-5b1a2e13-df8f-4f63-830e-417963627daa None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:11.486651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5b1a2e13-df8f-4f63-830e-417963627daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:11.514390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 825/1656] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:11.522305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8433c8-6627-4de2-881e-d551f6b1ee51 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:11.523089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8433c8-6627-4de2-881e-d551f6b1ee51 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:11.523593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8433c8-6627-4de2-881e-d551f6b1ee51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:11.525487 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:11.569446 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6801bd593c844dbd81b951bc8a7d5a0f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:11.570178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6801bd593c844dbd81b951bc8a7d5a0f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:11.571165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6801bd593c844dbd81b951bc8a7d5a0f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:11.582085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6801bd593c844dbd81b951bc8a7d5a0f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:11.585687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-ab8433c8-6627-4de2-881e-d551f6b1ee51 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:11.591449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ab8433c8-6627-4de2-881e-d551f6b1ee51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:11.594032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6801bd593c844dbd81b951bc8a7d5a0f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:11.622931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 826/1657] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:11.624990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8433c8-6627-4de2-881e-d551f6b1ee51 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:11.627863 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 832/1658] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:11 2022] DELETE /identity/v3/users/6801bd593c844dbd81b951bc8a7d5a0f => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:11.640467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8433c8-6627-4de2-881e-d551f6b1ee51 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:11.752413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ee7c4-b916-4558-bb41-1e3037415b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:11.753428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ee7c4-b916-4558-bb41-1e3037415b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:11.754032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ee7c4-b916-4558-bb41-1e3037415b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:11.754983 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ee7c4-b916-4558-bb41-1e3037415b0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:11.756145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ee7c4-b916-4558-bb41-1e3037415b0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:11.756465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ee7c4-b916-4558-bb41-1e3037415b0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:11.758483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ee7c4-b916-4558-bb41-1e3037415b0f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:11.793265 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 827/1659] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:20:11.796291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:11.813885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda7979-1964-4304-aafc-94c3bc46f0b5 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:11.821406 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d0e30-ea3c-4018-84ff-ba37cecdc272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:11.823800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d0e30-ea3c-4018-84ff-ba37cecdc272 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:11.824517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d0e30-ea3c-4018-84ff-ba37cecdc272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:11.825253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d0e30-ea3c-4018-84ff-ba37cecdc272 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:11.826782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d0e30-ea3c-4018-84ff-ba37cecdc272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:11.830407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d0e30-ea3c-4018-84ff-ba37cecdc272 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:11.894733 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 833/1660] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:11 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:11.897705 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ee7c4-b916-4558-bb41-1e3037415b0f admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:11.917874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ee7c4-b916-4558-bb41-1e3037415b0f admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:11.925748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d0e30-ea3c-4018-84ff-ba37cecdc272 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:11.930438 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-fe0d0e30-ea3c-4018-84ff-ba37cecdc272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:12.019292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:12.099130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bcb38-c218-4814-bae6-63e391ff92b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:12.100623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bcb38-c218-4814-bae6-63e391ff92b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:12.101710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bcb38-c218-4814-bae6-63e391ff92b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:12.102447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bcb38-c218-4814-bae6-63e391ff92b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:12.104780 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bcb38-c218-4814-bae6-63e391ff92b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:12.112634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bcb38-c218-4814-bae6-63e391ff92b9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:12.114735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d0e30-ea3c-4018-84ff-ba37cecdc272 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:12.125557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d91e7-91e5-4544-8cfb-3e917ed1981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:12.129456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d91e7-91e5-4544-8cfb-3e917ed1981e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:12.130326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d91e7-91e5-4544-8cfb-3e917ed1981e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:12.131191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d91e7-91e5-4544-8cfb-3e917ed1981e admin admin] PATH_INFO: `/v3/users/a0dd769a6a274608b688474ec38bc24e` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:12.134106 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d91e7-91e5-4544-8cfb-3e917ed1981e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0dd769a6a274608b688474ec38bc24e)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:12.141978 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d91e7-91e5-4544-8cfb-3e917ed1981e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:12.160518 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 828/1661] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:11 2022] POST /identity/v3/users => generated 291 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:20:12.169037 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bcb38-c218-4814-bae6-63e391ff92b9 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:12.187456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bcb38-c218-4814-bae6-63e391ff92b9 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:12.200991 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77376a-5ae6-4eb9-9fe4-5d4db19c3fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:12.202886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77376a-5ae6-4eb9-9fe4-5d4db19c3fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:12.203186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77376a-5ae6-4eb9-9fe4-5d4db19c3fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:12.203470 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77376a-5ae6-4eb9-9fe4-5d4db19c3fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:12.205326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77376a-5ae6-4eb9-9fe4-5d4db19c3fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:12.209064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77376a-5ae6-4eb9-9fe4-5d4db19c3fd9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:12.245456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 829/1662] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:20:12.248627 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77376a-5ae6-4eb9-9fe4-5d4db19c3fd9 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:12.266047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-314d91e7-91e5-4544-8cfb-3e917ed1981e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0dd769a6a274608b688474ec38bc24e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:12.266909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-314d91e7-91e5-4544-8cfb-3e917ed1981e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0dd769a6a274608b688474ec38bc24e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:12.269990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-314d91e7-91e5-4544-8cfb-3e917ed1981e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0dd769a6a274608b688474ec38bc24e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:12.281652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77376a-5ae6-4eb9-9fe4-5d4db19c3fd9 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:12.288810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-314d91e7-91e5-4544-8cfb-3e917ed1981e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0dd769a6a274608b688474ec38bc24e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:12.293048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387c43e-5ee6-47c6-b341-31a9529b6e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:12.295803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387c43e-5ee6-47c6-b341-31a9529b6e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:12.296899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387c43e-5ee6-47c6-b341-31a9529b6e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:12.296899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387c43e-5ee6-47c6-b341-31a9529b6e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:12.298957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387c43e-5ee6-47c6-b341-31a9529b6e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:12.303462 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387c43e-5ee6-47c6-b341-31a9529b6e99 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:12.310650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-314d91e7-91e5-4544-8cfb-3e917ed1981e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0dd769a6a274608b688474ec38bc24e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:12.329249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:12.340487 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 834/1663] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:11 2022] DELETE /identity/v3/users/a0dd769a6a274608b688474ec38bc24e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:12.342823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d17d0-a8b4-4fad-bea8-12e2b6c493b8 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:12.343222 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d17d0-a8b4-4fad-bea8-12e2b6c493b8 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:12.343617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d17d0-a8b4-4fad-bea8-12e2b6c493b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:12.365924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 830/1664] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:12.367595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387c43e-5ee6-47c6-b341-31a9529b6e99 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:12.375808 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3387c43e-5ee6-47c6-b341-31a9529b6e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:12.384284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-521d17d0-a8b4-4fad-bea8-12e2b6c493b8 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:12.385880 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-521d17d0-a8b4-4fad-bea8-12e2b6c493b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:12.445110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387c43e-5ee6-47c6-b341-31a9529b6e99 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:12.498974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 835/1665] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:12.537717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d17d0-a8b4-4fad-bea8-12e2b6c493b8 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:12.539946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-521d17d0-a8b4-4fad-bea8-12e2b6c493b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:12.573805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31ed03-3b88-49a8-b07e-322bb851ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:12.574849 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31ed03-3b88-49a8-b07e-322bb851ad6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:12.576407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31ed03-3b88-49a8-b07e-322bb851ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:12.577006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31ed03-3b88-49a8-b07e-322bb851ad6c admin admin] PATH_INFO: `/v3/projects/11e17b26a237484f9841e2a5093551da/users/cd412cb2f08b4fd597fb5638bbb7f32e/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:12.619701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31ed03-3b88-49a8-b07e-322bb851ad6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e17b26a237484f9841e2a5093551da, user_id=cd412cb2f08b4fd597fb5638bbb7f32e, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:12.626757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31ed03-3b88-49a8-b07e-322bb851ad6c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:12.661827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 831/1666] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:12 2022] PUT /identity/v3/projects/11e17b26a237484f9841e2a5093551da/users/cd412cb2f08b4fd597fb5638bbb7f32e/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:12.672998 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac22121-6f9e-46e5-95f5-f3e820ab5447 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:12.673654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac22121-6f9e-46e5-95f5-f3e820ab5447 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:12.674131 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac22121-6f9e-46e5-95f5-f3e820ab5447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:12.706073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d17d0-a8b4-4fad-bea8-12e2b6c493b8 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:12.742805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-eac22121-6f9e-46e5-95f5-f3e820ab5447 None None] MFA Rules not processed for user `cd412cb2f08b4fd597fb5638bbb7f32e`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:12.744757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-eac22121-6f9e-46e5-95f5-f3e820ab5447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:12.806054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd00c1b-e3b3-4a03-b7e3-01f166017c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:12.807963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd00c1b-e3b3-4a03-b7e3-01f166017c8a service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:12.808770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd00c1b-e3b3-4a03-b7e3-01f166017c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:12.809108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd00c1b-e3b3-4a03-b7e3-01f166017c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:12.955455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 832/1667] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:12.956457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac22121-6f9e-46e5-95f5-f3e820ab5447 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:13.021964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:13.059123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd00c1b-e3b3-4a03-b7e3-01f166017c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:13.060931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd00c1b-e3b3-4a03-b7e3-01f166017c8a service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:13.093270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 836/1668] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:20:13.093270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd00c1b-e3b3-4a03-b7e3-01f166017c8a service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:13.093270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-cbd00c1b-e3b3-4a03-b7e3-01f166017c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:13.122045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd00c1b-e3b3-4a03-b7e3-01f166017c8a service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:13.142380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca28d1a-226a-4e85-b3d9-ce924d61c133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:13.143317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca28d1a-226a-4e85-b3d9-ce924d61c133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:13.143602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca28d1a-226a-4e85-b3d9-ce924d61c133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:13.143882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca28d1a-226a-4e85-b3d9-ce924d61c133 admin admin] PATH_INFO: `/v3/projects/84b6bc8d4371469ebb4ce41341edd578` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:13.146893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca28d1a-226a-4e85-b3d9-ce924d61c133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b6bc8d4371469ebb4ce41341edd578)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:13.150659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca28d1a-226a-4e85-b3d9-ce924d61c133 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:13.152576 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac22121-6f9e-46e5-95f5-f3e820ab5447 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:13.153312 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:13.163757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8251d72-4d08-4d72-8762-2e103a83dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:13.164708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8251d72-4d08-4d72-8762-2e103a83dbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:13.164994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8251d72-4d08-4d72-8762-2e103a83dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:13.165452 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8251d72-4d08-4d72-8762-2e103a83dbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:13.166613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8251d72-4d08-4d72-8762-2e103a83dbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:13.170530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8251d72-4d08-4d72-8762-2e103a83dbe4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:13.235495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 833/1669] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:12 2022] POST /identity/v3/projects => generated 381 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:13.239823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8251d72-4d08-4d72-8762-2e103a83dbe4 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:13.278806 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6ca28d1a-226a-4e85-b3d9-ce924d61c133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b6bc8d4371469ebb4ce41341edd578', 'request_id': 'req-6ca28d1a-226a-4e85-b3d9-ce924d61c133'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:13.295704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6ca28d1a-226a-4e85-b3d9-ce924d61c133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b6bc8d4371469ebb4ce41341edd578', 'request_id': 'req-6ca28d1a-226a-4e85-b3d9-ce924d61c133'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:13.311769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6ca28d1a-226a-4e85-b3d9-ce924d61c133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b6bc8d4371469ebb4ce41341edd578', 'request_id': 'req-6ca28d1a-226a-4e85-b3d9-ce924d61c133'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:13.334358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6ca28d1a-226a-4e85-b3d9-ce924d61c133 admin admin] The token cache is being invalidate because project 84b6bc8d4371469ebb4ce41341edd578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:13.334661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6ca28d1a-226a-4e85-b3d9-ce924d61c133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:13.341469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6ca28d1a-226a-4e85-b3d9-ce924d61c133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:13.348188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 837/1670] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:13 2022] DELETE /identity/v3/projects/84b6bc8d4371469ebb4ce41341edd578 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:13.350784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e633f-d3af-4e87-9970-b04865854ada None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:13.351036 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e633f-d3af-4e87-9970-b04865854ada None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:13.351323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e633f-d3af-4e87-9970-b04865854ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:13.413512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-7a3e633f-d3af-4e87-9970-b04865854ada None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:13.414776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7a3e633f-d3af-4e87-9970-b04865854ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:13.417071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8251d72-4d08-4d72-8762-2e103a83dbe4 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:13.426833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b627b0-853a-4ae5-b155-a604b53a76a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:13.427593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b627b0-853a-4ae5-b155-a604b53a76a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:13.427880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b627b0-853a-4ae5-b155-a604b53a76a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:13.428344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b627b0-853a-4ae5-b155-a604b53a76a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:13.428859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b627b0-853a-4ae5-b155-a604b53a76a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:13.433725 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b627b0-853a-4ae5-b155-a604b53a76a0 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:13.445836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 838/1671] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:13.448299 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361441f-8393-41a8-bc82-efe906ce8ad5 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:13.448590 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361441f-8393-41a8-bc82-efe906ce8ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:13.449576 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361441f-8393-41a8-bc82-efe906ce8ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:13.492674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-0361441f-8393-41a8-bc82-efe906ce8ad5 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:13.494351 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0361441f-8393-41a8-bc82-efe906ce8ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:13.499785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 834/1672] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:13 2022] POST /identity/v3/users => generated 297 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:13.504128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b627b0-853a-4ae5-b155-a604b53a76a0 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:13.512586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e6b627b0-853a-4ae5-b155-a604b53a76a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:13.522686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 839/1673] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:13.541598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361441f-8393-41a8-bc82-efe906ce8ad5 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:13.544366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b627b0-853a-4ae5-b155-a604b53a76a0 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:13.560832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bec63-ef5b-4e49-bbcf-96130a246b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:13.561586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bec63-ef5b-4e49-bbcf-96130a246b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:13.561874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bec63-ef5b-4e49-bbcf-96130a246b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:13.561993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361441f-8393-41a8-bc82-efe906ce8ad5 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:13.562168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bec63-ef5b-4e49-bbcf-96130a246b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:13.562927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bec63-ef5b-4e49-bbcf-96130a246b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:13.565132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bec63-ef5b-4e49-bbcf-96130a246b7b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:13.569327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e003c2-14e7-438f-8a2b-20b53ac2398e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:13.570174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e003c2-14e7-438f-8a2b-20b53ac2398e admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:13.570645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e003c2-14e7-438f-8a2b-20b53ac2398e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:13.571039 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e003c2-14e7-438f-8a2b-20b53ac2398e admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:13.571999 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e003c2-14e7-438f-8a2b-20b53ac2398e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:13.572409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e003c2-14e7-438f-8a2b-20b53ac2398e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:13.574456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e003c2-14e7-438f-8a2b-20b53ac2398e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:13.592773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 840/1674] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:13.606469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e003c2-14e7-438f-8a2b-20b53ac2398e admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:13.607965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 835/1675] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:13.609505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bec63-ef5b-4e49-bbcf-96130a246b7b admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:13.620236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e003c2-14e7-438f-8a2b-20b53ac2398e admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:13.628630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8601e-a792-4ca5-b1f3-cf3ee17cc957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:13.629489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8601e-a792-4ca5-b1f3-cf3ee17cc957 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:13.632443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8601e-a792-4ca5-b1f3-cf3ee17cc957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:13.632875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8601e-a792-4ca5-b1f3-cf3ee17cc957 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:13.634644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8601e-a792-4ca5-b1f3-cf3ee17cc957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:13.635268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bec63-ef5b-4e49-bbcf-96130a246b7b admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:13.637184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8601e-a792-4ca5-b1f3-cf3ee17cc957 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:13.652583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d7b74-193b-43ad-9b58-4f1aef78d8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:13.653871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d7b74-193b-43ad-9b58-4f1aef78d8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:13.654431 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d7b74-193b-43ad-9b58-4f1aef78d8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:13.655390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d7b74-193b-43ad-9b58-4f1aef78d8a4 admin admin] PATH_INFO: `/v3/projects/15166cd3bf054c61898a4d7a1c5a811b/users/8d83f8eb6983430bb82fabb661e6ecd6/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:13.704796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d7b74-193b-43ad-9b58-4f1aef78d8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15166cd3bf054c61898a4d7a1c5a811b, user_id=8d83f8eb6983430bb82fabb661e6ecd6, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:13.712862 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d7b74-193b-43ad-9b58-4f1aef78d8a4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:13.717872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 841/1676] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:13 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:13.719659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8601e-a792-4ca5-b1f3-cf3ee17cc957 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:13.749361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 836/1677] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:13 2022] PUT /identity/v3/projects/15166cd3bf054c61898a4d7a1c5a811b/users/8d83f8eb6983430bb82fabb661e6ecd6/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:13.751257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d7b74-193b-43ad-9b58-4f1aef78d8a4 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:13.899888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:13.909688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8601e-a792-4ca5-b1f3-cf3ee17cc957 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:13.921626 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd27dd7-c2fc-420b-b12a-9fe86b9b02e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:13.924668 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd27dd7-c2fc-420b-b12a-9fe86b9b02e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:13.924668 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd27dd7-c2fc-420b-b12a-9fe86b9b02e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:13.926236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d7b74-193b-43ad-9b58-4f1aef78d8a4 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:13.927105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd27dd7-c2fc-420b-b12a-9fe86b9b02e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:13.927887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd27dd7-c2fc-420b-b12a-9fe86b9b02e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:13.932273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd27dd7-c2fc-420b-b12a-9fe86b9b02e7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:13.941568 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb905b-e9a0-439b-8636-3869e6e37f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:13.942274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb905b-e9a0-439b-8636-3869e6e37f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:13.942552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb905b-e9a0-439b-8636-3869e6e37f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:13.942826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb905b-e9a0-439b-8636-3869e6e37f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:13.943569 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb905b-e9a0-439b-8636-3869e6e37f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:13.947638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb905b-e9a0-439b-8636-3869e6e37f98 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:13.985326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 837/1679] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:13.985544 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 842/1679] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:13 2022] POST /identity/v3/users => generated 282 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:20:13.990355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb905b-e9a0-439b-8636-3869e6e37f98 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:13.993575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd27dd7-c2fc-420b-b12a-9fe86b9b02e7 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:14.015826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb905b-e9a0-439b-8636-3869e6e37f98 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:14.017587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd27dd7-c2fc-420b-b12a-9fe86b9b02e7 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:14.028632 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e4c48-a744-4079-96a8-4e3ecfe88ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:14.029138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcece05-53e2-476f-b7bd-dc45ffdb6ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:14.030230 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4c48-a744-4079-96a8-4e3ecfe88ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:14.031121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcece05-53e2-476f-b7bd-dc45ffdb6ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:14.031516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcece05-53e2-476f-b7bd-dc45ffdb6ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:14.032035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4c48-a744-4079-96a8-4e3ecfe88ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:14.032408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcece05-53e2-476f-b7bd-dc45ffdb6ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:14.032780 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4c48-a744-4079-96a8-4e3ecfe88ac1 admin admin] PATH_INFO: `/v3/projects/15166cd3bf054c61898a4d7a1c5a811b/users/8d83f8eb6983430bb82fabb661e6ecd6/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:14.035969 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcece05-53e2-476f-b7bd-dc45ffdb6ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:14.038937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcece05-53e2-476f-b7bd-dc45ffdb6ccd admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:14.040046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e4c48-a744-4079-96a8-4e3ecfe88ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15166cd3bf054c61898a4d7a1c5a811b, user_id=8d83f8eb6983430bb82fabb661e6ecd6, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:14.047061 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e4c48-a744-4079-96a8-4e3ecfe88ac1 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:14.065747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 843/1680] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:14.071065 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcece05-53e2-476f-b7bd-dc45ffdb6ccd admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:14.076269 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 838/1681] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:13 2022] PUT /identity/v3/projects/15166cd3bf054c61898a4d7a1c5a811b/users/8d83f8eb6983430bb82fabb661e6ecd6/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:14.088534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69773c0-0156-4f55-9af6-88d28ab73905 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:14.088909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69773c0-0156-4f55-9af6-88d28ab73905 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:14.089369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69773c0-0156-4f55-9af6-88d28ab73905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:14.100950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcece05-53e2-476f-b7bd-dc45ffdb6ccd admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:14.151543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:14.158475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-b69773c0-0156-4f55-9af6-88d28ab73905 None None] MFA Rules not processed for user `8d83f8eb6983430bb82fabb661e6ecd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:14.160773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b69773c0-0156-4f55-9af6-88d28ab73905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:14.253923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197af377-d904-45e1-b6b2-f1781b1f29b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:14.255265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197af377-d904-45e1-b6b2-f1781b1f29b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:14.255746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197af377-d904-45e1-b6b2-f1781b1f29b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:14.256181 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197af377-d904-45e1-b6b2-f1781b1f29b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:14.260429 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197af377-d904-45e1-b6b2-f1781b1f29b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:14.262212 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197af377-d904-45e1-b6b2-f1781b1f29b4 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:14.284051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 844/1682] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:14.288567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197af377-d904-45e1-b6b2-f1781b1f29b4 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:14.302289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197af377-d904-45e1-b6b2-f1781b1f29b4 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:14.312048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b714df4-0b28-4fb7-a926-28885e4c71d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:14.314206 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b714df4-0b28-4fb7-a926-28885e4c71d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:14.314595 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b714df4-0b28-4fb7-a926-28885e4c71d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:14.314771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b714df4-0b28-4fb7-a926-28885e4c71d0 admin admin] PATH_INFO: `/v3/projects/d987825e5046499a85116fc11d49c3a4/users/01a81463fae94e8c8a3791edc3ff41d3/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:14.328572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 839/1683] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:14.346969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69773c0-0156-4f55-9af6-88d28ab73905 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:14.350659 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b69773c0-0156-4f55-9af6-88d28ab73905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:14.366211 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b714df4-0b28-4fb7-a926-28885e4c71d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d987825e5046499a85116fc11d49c3a4, user_id=01a81463fae94e8c8a3791edc3ff41d3, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:14.370896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b714df4-0b28-4fb7-a926-28885e4c71d0 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:14.424453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 845/1684] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:14 2022] PUT /identity/v3/projects/d987825e5046499a85116fc11d49c3a4/users/01a81463fae94e8c8a3791edc3ff41d3/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:14.426306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48426ed-1025-4488-a197-e459cf356930 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:14.426600 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48426ed-1025-4488-a197-e459cf356930 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:14.426885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48426ed-1025-4488-a197-e459cf356930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:14.466642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-b48426ed-1025-4488-a197-e459cf356930 None None] MFA Rules not processed for user `01a81463fae94e8c8a3791edc3ff41d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:14.468123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b48426ed-1025-4488-a197-e459cf356930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:14.478038 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69773c0-0156-4f55-9af6-88d28ab73905 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:14.597642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 846/1685] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:14.603226 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48426ed-1025-4488-a197-e459cf356930 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:14.613036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e9053-2d88-4f64-9942-a7aa7d1ca4e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:14.614025 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9053-2d88-4f64-9942-a7aa7d1ca4e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:14.614922 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9053-2d88-4f64-9942-a7aa7d1ca4e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:14.615862 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9053-2d88-4f64-9942-a7aa7d1ca4e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:14.689356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:14.731613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48426ed-1025-4488-a197-e459cf356930 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:14.744938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16256c8f-3716-4f47-9f84-2ddea2f2aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:14.744938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16256c8f-3716-4f47-9f84-2ddea2f2aa85 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:14.745276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16256c8f-3716-4f47-9f84-2ddea2f2aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:14.745627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16256c8f-3716-4f47-9f84-2ddea2f2aa85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:14.746962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16256c8f-3716-4f47-9f84-2ddea2f2aa85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:14.749693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16256c8f-3716-4f47-9f84-2ddea2f2aa85 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:14.762772 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e9053-2d88-4f64-9942-a7aa7d1ca4e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:14.765416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e9053-2d88-4f64-9942-a7aa7d1ca4e4 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:14.788570 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 840/1686] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:20:14.790286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e9053-2d88-4f64-9942-a7aa7d1ca4e4 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:14.792211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ef8e9053-2d88-4f64-9942-a7aa7d1ca4e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:14.808888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 847/1687] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:14 2022] POST /identity/v3/projects => generated 365 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:14.813152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16256c8f-3716-4f47-9f84-2ddea2f2aa85 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:14.832891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e9053-2d88-4f64-9942-a7aa7d1ca4e4 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:14.836702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:14.964178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16256c8f-3716-4f47-9f84-2ddea2f2aa85 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:14.969433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:14.971144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:14.971441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:14.971726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] PATH_INFO: `/v3/projects/734172f850304fa4a93c1530f8016c18` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:14.973351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734172f850304fa4a93c1530f8016c18)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:14.975343 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:14.981353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e39808-8e25-4d70-9c15-6d92a620ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:14.982068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39808-8e25-4d70-9c15-6d92a620ec8c admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:14.982355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39808-8e25-4d70-9c15-6d92a620ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:14.982626 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39808-8e25-4d70-9c15-6d92a620ec8c admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:14.983344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e39808-8e25-4d70-9c15-6d92a620ec8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:14.985846 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e39808-8e25-4d70-9c15-6d92a620ec8c admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:15.034688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 848/1688] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:14 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:15.035914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e39808-8e25-4d70-9c15-6d92a620ec8c admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:15.071178 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734172f850304fa4a93c1530f8016c18', 'request_id': 'req-1a123f9d-3aed-4378-bf58-305e3c85dba1'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:15.082746 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734172f850304fa4a93c1530f8016c18', 'request_id': 'req-1a123f9d-3aed-4378-bf58-305e3c85dba1'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:15.094228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734172f850304fa4a93c1530f8016c18', 'request_id': 'req-1a123f9d-3aed-4378-bf58-305e3c85dba1'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:15.117704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] The token cache is being invalidate because project 734172f850304fa4a93c1530f8016c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:15.118186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:15.127144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:15.133344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 841/1689] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:14 2022] DELETE /identity/v3/projects/734172f850304fa4a93c1530f8016c18 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:15.133344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:15.133344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:15.260658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:15.276387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a123f9d-3aed-4378-bf58-305e3c85dba1 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:15.291806 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cccd38-af52-4f14-a99a-f1b482eefee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:15.292643 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cccd38-af52-4f14-a99a-f1b482eefee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:15.294756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cccd38-af52-4f14-a99a-f1b482eefee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:15.295139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cccd38-af52-4f14-a99a-f1b482eefee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:15.296010 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cccd38-af52-4f14-a99a-f1b482eefee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:15.307908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cccd38-af52-4f14-a99a-f1b482eefee3 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:15.313080 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e39808-8e25-4d70-9c15-6d92a620ec8c admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:15.338708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 842/1690] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:15.340490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ca1ba-7858-4190-aa27-5b81cd364dfe None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:15.340946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ca1ba-7858-4190-aa27-5b81cd364dfe None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:15.341442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ca1ba-7858-4190-aa27-5b81cd364dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:15.393457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-211ca1ba-7858-4190-aa27-5b81cd364dfe None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:15.395211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-211ca1ba-7858-4190-aa27-5b81cd364dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:15.433322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 843/1691] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:15.441917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ca1ba-7858-4190-aa27-5b81cd364dfe None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:15.469336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ca1ba-7858-4190-aa27-5b81cd364dfe None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:15.488372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b81bec-d0ce-4b6f-8433-e0fb862c83e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:15.494465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b81bec-d0ce-4b6f-8433-e0fb862c83e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:15.494790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b81bec-d0ce-4b6f-8433-e0fb862c83e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:15.495048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b81bec-d0ce-4b6f-8433-e0fb862c83e7 admin admin] PATH_INFO: `/v3/projects/044ac939568b4b22afb5d1a16c731280/users/89db4481af384dfd9836e63058efa6d8/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:15.568255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b81bec-d0ce-4b6f-8433-e0fb862c83e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044ac939568b4b22afb5d1a16c731280, user_id=89db4481af384dfd9836e63058efa6d8, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:15.574658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b81bec-d0ce-4b6f-8433-e0fb862c83e7 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:15.598537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473f95b-5f94-4513-a7cd-f27e54330886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:15.599983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473f95b-5f94-4513-a7cd-f27e54330886 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:15.600476 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473f95b-5f94-4513-a7cd-f27e54330886 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:15.600957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473f95b-5f94-4513-a7cd-f27e54330886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:15.603170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6473f95b-5f94-4513-a7cd-f27e54330886 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:15.659048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 844/1692] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:15 2022] PUT /identity/v3/projects/044ac939568b4b22afb5d1a16c731280/users/89db4481af384dfd9836e63058efa6d8/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:15.665817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642031c0-1968-4df6-8571-63860800bfc9 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:15.666231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642031c0-1968-4df6-8571-63860800bfc9 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:15.666517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642031c0-1968-4df6-8571-63860800bfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:15.703058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-642031c0-1968-4df6-8571-63860800bfc9 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:15.704535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-642031c0-1968-4df6-8571-63860800bfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:15.768648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473f95b-5f94-4513-a7cd-f27e54330886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:15.770736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473f95b-5f94-4513-a7cd-f27e54330886 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:15.791161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 849/1693] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:15.792401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473f95b-5f94-4513-a7cd-f27e54330886 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:15.796474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6473f95b-5f94-4513-a7cd-f27e54330886 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:15.848492 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473f95b-5f94-4513-a7cd-f27e54330886 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:15.854737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 845/1694] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:15.855690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642031c0-1968-4df6-8571-63860800bfc9 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:15.867053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642031c0-1968-4df6-8571-63860800bfc9 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:15.873076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:15.874284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:15.874669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:15.875049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] PATH_INFO: `/v3/projects/acccc27a3c114d6c9850eff61d3c4362` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:15.882092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acccc27a3c114d6c9850eff61d3c4362)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:15.884633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:15.887079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:15.890003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da281f-edb5-4a57-9224-08f711833232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:15.890927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da281f-edb5-4a57-9224-08f711833232 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:15.891213 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da281f-edb5-4a57-9224-08f711833232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:15.894105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da281f-edb5-4a57-9224-08f711833232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:15.897068 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da281f-edb5-4a57-9224-08f711833232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:15.901405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da281f-edb5-4a57-9224-08f711833232 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:15.935112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 846/1695] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:15.936066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da281f-edb5-4a57-9224-08f711833232 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:15.947854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da281f-edb5-4a57-9224-08f711833232 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:15.958773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ea1eb-c184-4a63-9951-483a2a6b62b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:15.960130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ea1eb-c184-4a63-9951-483a2a6b62b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:15.960457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ea1eb-c184-4a63-9951-483a2a6b62b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:15.960868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ea1eb-c184-4a63-9951-483a2a6b62b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:15.961760 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ea1eb-c184-4a63-9951-483a2a6b62b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:15.962042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ea1eb-c184-4a63-9951-483a2a6b62b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:15.963912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ea1eb-c184-4a63-9951-483a2a6b62b6 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:16.018550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 847/1696] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:16.019198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acccc27a3c114d6c9850eff61d3c4362', 'request_id': 'req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:16.021463 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cfa3b-6548-4faa-85a9-6621f2aabcd5 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:16.021755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cfa3b-6548-4faa-85a9-6621f2aabcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:16.022181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cfa3b-6548-4faa-85a9-6621f2aabcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:16.040731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acccc27a3c114d6c9850eff61d3c4362', 'request_id': 'req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:16.058828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acccc27a3c114d6c9850eff61d3c4362', 'request_id': 'req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:16.076811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] The token cache is being invalidate because project acccc27a3c114d6c9850eff61d3c4362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:16.077134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:16.077802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:16.081630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 850/1697] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:15 2022] DELETE /identity/v3/projects/acccc27a3c114d6c9850eff61d3c4362 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:16.081630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:16.081861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:16.092939 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-275cfa3b-6548-4faa-85a9-6621f2aabcd5 None None] MFA Rules not processed for user `16293fa03ced44cc994a0b8ad19ebb89`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:16.094409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-275cfa3b-6548-4faa-85a9-6621f2aabcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:16.202911 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 848/1698] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:16.203992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cfa3b-6548-4faa-85a9-6621f2aabcd5 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:16.205453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-275cfa3b-6548-4faa-85a9-6621f2aabcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:16.212208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e88dfb-86c3-4384-88d4-bd54b5b496c2 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:16.220991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c0435-9277-43ab-9040-d772b69a9c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:16.221964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c0435-9277-43ab-9040-d772b69a9c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:16.222279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c0435-9277-43ab-9040-d772b69a9c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:16.222563 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c0435-9277-43ab-9040-d772b69a9c7f admin admin] PATH_INFO: `/v3/projects/044ac939568b4b22afb5d1a16c731280/users/89db4481af384dfd9836e63058efa6d8/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:16.223065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cfa3b-6548-4faa-85a9-6621f2aabcd5 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:16.225247 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c0435-9277-43ab-9040-d772b69a9c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=044ac939568b4b22afb5d1a16c731280, user_id=89db4481af384dfd9836e63058efa6d8, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:16.229106 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0149c84-e124-422e-8a62-331e9f349cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:16.229747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c0435-9277-43ab-9040-d772b69a9c7f admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:16.229946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0149c84-e124-422e-8a62-331e9f349cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:16.230299 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0149c84-e124-422e-8a62-331e9f349cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:16.230666 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0149c84-e124-422e-8a62-331e9f349cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:16.231494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0149c84-e124-422e-8a62-331e9f349cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:16.234238 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0149c84-e124-422e-8a62-331e9f349cbf admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:16.250004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 851/1699] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:16 2022] PUT /identity/v3/projects/044ac939568b4b22afb5d1a16c731280/users/89db4481af384dfd9836e63058efa6d8/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:16.252322 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c0435-9277-43ab-9040-d772b69a9c7f admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:16.264809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d78c0435-9277-43ab-9040-d772b69a9c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:16.293706 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 849/1700] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:16 2022] POST /identity/v3/projects => generated 357 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:16.295274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0149c84-e124-422e-8a62-331e9f349cbf admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:16.302804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d0149c84-e124-422e-8a62-331e9f349cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:16.327614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:16.446876 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c0435-9277-43ab-9040-d772b69a9c7f admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:16.511466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:16.516060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0149c84-e124-422e-8a62-331e9f349cbf admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:16.530990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07bb5b-1786-4574-bec1-0bf59aa70c8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:16.532146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07bb5b-1786-4574-bec1-0bf59aa70c8a service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:16.532773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07bb5b-1786-4574-bec1-0bf59aa70c8a service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:16.533291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07bb5b-1786-4574-bec1-0bf59aa70c8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:16.577642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:16.578501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:16.578789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:16.581512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] PATH_INFO: `/v3/users/50364b4a488843d7824b707fc2a6e0b6` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:16.581512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50364b4a488843d7824b707fc2a6e0b6)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:16.582798 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:16.692519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07bb5b-1786-4574-bec1-0bf59aa70c8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:16.701354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07bb5b-1786-4574-bec1-0bf59aa70c8a service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:16.701803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50364b4a488843d7824b707fc2a6e0b6'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:16.702748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50364b4a488843d7824b707fc2a6e0b6'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:16.703392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50364b4a488843d7824b707fc2a6e0b6'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:16.713640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50364b4a488843d7824b707fc2a6e0b6'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:16.731812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50364b4a488843d7824b707fc2a6e0b6'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:16.752278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 850/1701] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:16.759776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1688-1c61-4859-b9fd-f2fa9e9ddc79 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:16.760344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1688-1c61-4859-b9fd-f2fa9e9ddc79 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:16.760638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1688-1c61-4859-b9fd-f2fa9e9ddc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:16.772239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 852/1702] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:16 2022] DELETE /identity/v3/users/50364b4a488843d7824b707fc2a6e0b6 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:16.777040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:16.779179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:16.892102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-696b1688-1c61-4859-b9fd-f2fa9e9ddc79 None None] MFA Rules not processed for user `89db4481af384dfd9836e63058efa6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:16.897144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-696b1688-1c61-4859-b9fd-f2fa9e9ddc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:17.022296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6630720-af64-4201-9b44-76040c444f96 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:17.045543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae9024-b02a-4c15-b00f-62354a14e612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:17.046253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae9024-b02a-4c15-b00f-62354a14e612 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:17.052321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae9024-b02a-4c15-b00f-62354a14e612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:17.052321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae9024-b02a-4c15-b00f-62354a14e612 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:17.053072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 851/1703] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:17.060517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae9024-b02a-4c15-b00f-62354a14e612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:17.060822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1688-1c61-4859-b9fd-f2fa9e9ddc79 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:17.062716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-696b1688-1c61-4859-b9fd-f2fa9e9ddc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:17.070562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae9024-b02a-4c15-b00f-62354a14e612 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:17.147876 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 853/1704] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:16 2022] POST /identity/v3/users => generated 279 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:17.148937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae9024-b02a-4c15-b00f-62354a14e612 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:17.167596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:17.178742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae9024-b02a-4c15-b00f-62354a14e612 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:17.198322 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036e06a-e7cc-4a94-b67e-716189504389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:17.199460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036e06a-e7cc-4a94-b67e-716189504389 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:17.199813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036e06a-e7cc-4a94-b67e-716189504389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:17.200099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036e06a-e7cc-4a94-b67e-716189504389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:17.200911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036e06a-e7cc-4a94-b67e-716189504389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:17.202689 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036e06a-e7cc-4a94-b67e-716189504389 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:17.232230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 854/1705] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:17.237200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1688-1c61-4859-b9fd-f2fa9e9ddc79 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:17.241825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036e06a-e7cc-4a94-b67e-716189504389 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:17.252604 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089764a-55e6-4792-b60e-c90f0c2603bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:17.253357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089764a-55e6-4792-b60e-c90f0c2603bf service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:17.253646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089764a-55e6-4792-b60e-c90f0c2603bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:17.253924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089764a-55e6-4792-b60e-c90f0c2603bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:17.260290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036e06a-e7cc-4a94-b67e-716189504389 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:17.269665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911fb55-d175-45c4-a725-4892abbf99f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:17.270368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911fb55-d175-45c4-a725-4892abbf99f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:17.270652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911fb55-d175-45c4-a725-4892abbf99f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:17.270933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911fb55-d175-45c4-a725-4892abbf99f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:17.272723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911fb55-d175-45c4-a725-4892abbf99f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:17.277287 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089764a-55e6-4792-b60e-c90f0c2603bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:17.277802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911fb55-d175-45c4-a725-4892abbf99f7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:17.281030 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089764a-55e6-4792-b60e-c90f0c2603bf service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:17.305333 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 855/1706] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:17.307781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 852/1707] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:17.309544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089764a-55e6-4792-b60e-c90f0c2603bf service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:17.337013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089764a-55e6-4792-b60e-c90f0c2603bf service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:17.347249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b7c45-3be6-43d8-8bdb-02ad66a65f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:17.349967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b7c45-3be6-43d8-8bdb-02ad66a65f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:17.350254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b7c45-3be6-43d8-8bdb-02ad66a65f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:17.350559 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b7c45-3be6-43d8-8bdb-02ad66a65f78 admin admin] PATH_INFO: `/v3/projects/bbe45712a28c4cdc9bfe43e0df83dc5f/users/cb17b3997e1947d2817b80d37c842403/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:17.395839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b7c45-3be6-43d8-8bdb-02ad66a65f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe45712a28c4cdc9bfe43e0df83dc5f, user_id=cb17b3997e1947d2817b80d37c842403, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:17.404251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b7c45-3be6-43d8-8bdb-02ad66a65f78 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:17.439126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 853/1708] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:17 2022] PUT /identity/v3/projects/bbe45712a28c4cdc9bfe43e0df83dc5f/users/cb17b3997e1947d2817b80d37c842403/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:17.450706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e372ba-2974-4398-93c9-a68950f4b869 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:17.451038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e372ba-2974-4398-93c9-a68950f4b869 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:17.451279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e372ba-2974-4398-93c9-a68950f4b869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:17.530189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e0e372ba-2974-4398-93c9-a68950f4b869 None None] MFA Rules not processed for user `cb17b3997e1947d2817b80d37c842403`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:17.531666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e0e372ba-2974-4398-93c9-a68950f4b869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:17.550253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:17.698417 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b7c45-3be6-43d8-8bdb-02ad66a65f78 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:17.711490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 856/1709] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:17 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:17.803837 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e372ba-2974-4398-93c9-a68950f4b869 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:17.856666 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b7c45-3be6-43d8-8bdb-02ad66a65f78 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:17.874676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352fd91-925d-4d3e-ae84-b9e7332e2c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:17.875819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352fd91-925d-4d3e-ae84-b9e7332e2c14 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:17.876206 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352fd91-925d-4d3e-ae84-b9e7332e2c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:17.876693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352fd91-925d-4d3e-ae84-b9e7332e2c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:17.877700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352fd91-925d-4d3e-ae84-b9e7332e2c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:17.880155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352fd91-925d-4d3e-ae84-b9e7332e2c14 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:17.957015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 854/1710] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:17 2022] POST /identity/v3/projects => generated 355 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:20:17.959044 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352fd91-925d-4d3e-ae84-b9e7332e2c14 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:17.962963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e372ba-2974-4398-93c9-a68950f4b869 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:18.050298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352fd91-925d-4d3e-ae84-b9e7332e2c14 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:18.056018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9c5f9-bb21-4fac-9fc5-27df4d8e1d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:18.056915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9c5f9-bb21-4fac-9fc5-27df4d8e1d11 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:18.057355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9c5f9-bb21-4fac-9fc5-27df4d8e1d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:18.057742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9c5f9-bb21-4fac-9fc5-27df4d8e1d11 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:18.058734 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9c5f9-bb21-4fac-9fc5-27df4d8e1d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:18.062332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9c5f9-bb21-4fac-9fc5-27df4d8e1d11 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:18.099432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 855/1711] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:17 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:18.101632 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9c5f9-bb21-4fac-9fc5-27df4d8e1d11 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:18.127464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9c5f9-bb21-4fac-9fc5-27df4d8e1d11 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:18.136533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6e681-28f1-48e6-a41b-ddcdba72cc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:18.137485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e681-28f1-48e6-a41b-ddcdba72cc85 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:18.137777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e681-28f1-48e6-a41b-ddcdba72cc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:18.138065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e681-28f1-48e6-a41b-ddcdba72cc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:18.139029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6e681-28f1-48e6-a41b-ddcdba72cc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:18.143005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6e681-28f1-48e6-a41b-ddcdba72cc85 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:18.149149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91eb3d-b91f-469a-8cfe-9c1a721352b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:18.152281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91eb3d-b91f-469a-8cfe-9c1a721352b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:18.152498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91eb3d-b91f-469a-8cfe-9c1a721352b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:18.152708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91eb3d-b91f-469a-8cfe-9c1a721352b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:18.160341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0c91eb3d-b91f-469a-8cfe-9c1a721352b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:18.169245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 856/1712] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:20:18.174489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6e681-28f1-48e6-a41b-ddcdba72cc85 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:18.200342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6e681-28f1-48e6-a41b-ddcdba72cc85 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:18.212987 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f3825-9742-4251-8079-1f0aba2bf6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:18.214192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f3825-9742-4251-8079-1f0aba2bf6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:18.214495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f3825-9742-4251-8079-1f0aba2bf6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:18.214963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f3825-9742-4251-8079-1f0aba2bf6b9 admin admin] PATH_INFO: `/v3/projects/77693dcccbc846f58224a39573c863a9/users/6b9ee0c21e2f424d93ad76a3747caddc/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:18.242940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:18.274739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f3825-9742-4251-8079-1f0aba2bf6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77693dcccbc846f58224a39573c863a9, user_id=6b9ee0c21e2f424d93ad76a3747caddc, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:18.279677 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f3825-9742-4251-8079-1f0aba2bf6b9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:18.309952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 857/1713] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:18 2022] PUT /identity/v3/projects/77693dcccbc846f58224a39573c863a9/users/6b9ee0c21e2f424d93ad76a3747caddc/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:18.314498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f3825-9742-4251-8079-1f0aba2bf6b9 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:18.347978 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91eb3d-b91f-469a-8cfe-9c1a721352b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:18.349555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91eb3d-b91f-469a-8cfe-9c1a721352b5 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:18.425780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 857/1714] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:17 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:20:18.509868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f3825-9742-4251-8079-1f0aba2bf6b9 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:18.518091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eaeb3-2906-49bb-acb7-9e2f0890343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:18.519443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eaeb3-2906-49bb-acb7-9e2f0890343f admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:18.520455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eaeb3-2906-49bb-acb7-9e2f0890343f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:18.521445 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eaeb3-2906-49bb-acb7-9e2f0890343f admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:18.522893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eaeb3-2906-49bb-acb7-9e2f0890343f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:18.525619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eaeb3-2906-49bb-acb7-9e2f0890343f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:18.564038 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 858/1715] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:18.568970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91eb3d-b91f-469a-8cfe-9c1a721352b5 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:18.590126 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91eb3d-b91f-469a-8cfe-9c1a721352b5 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:18.601607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7207d8-ff54-4467-909d-7a54db3aba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:18.605756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7207d8-ff54-4467-909d-7a54db3aba28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:18.606162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7207d8-ff54-4467-909d-7a54db3aba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:18.606405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7207d8-ff54-4467-909d-7a54db3aba28 admin admin] PATH_INFO: `/v3/projects/77693dcccbc846f58224a39573c863a9/users/6b9ee0c21e2f424d93ad76a3747caddc/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:18.611031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7207d8-ff54-4467-909d-7a54db3aba28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77693dcccbc846f58224a39573c863a9, user_id=6b9ee0c21e2f424d93ad76a3747caddc, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:18.613921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7207d8-ff54-4467-909d-7a54db3aba28 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:18.658528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 858/1716] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:18 2022] PUT /identity/v3/projects/77693dcccbc846f58224a39573c863a9/users/6b9ee0c21e2f424d93ad76a3747caddc/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:18.675099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5aeea-8748-4fbb-9a99-b5d5941e7297 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:18.675698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5aeea-8748-4fbb-9a99-b5d5941e7297 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:18.676190 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5aeea-8748-4fbb-9a99-b5d5941e7297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:18.749775 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-4dc5aeea-8748-4fbb-9a99-b5d5941e7297 None None] MFA Rules not processed for user `6b9ee0c21e2f424d93ad76a3747caddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:18.755363 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4dc5aeea-8748-4fbb-9a99-b5d5941e7297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:19.069496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 859/1717] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:18 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:19.079745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7207d8-ff54-4467-909d-7a54db3aba28 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:19.082025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7c7207d8-ff54-4467-909d-7a54db3aba28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:19.101430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:19.247830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7207d8-ff54-4467-909d-7a54db3aba28 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:19.255323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5aeea-8748-4fbb-9a99-b5d5941e7297 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:19.260855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f6110-ba7d-46f3-ad2b-06fd3b49e4d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:19.261640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f6110-ba7d-46f3-ad2b-06fd3b49e4d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:19.261928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f6110-ba7d-46f3-ad2b-06fd3b49e4d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:19.262173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4dc5aeea-8748-4fbb-9a99-b5d5941e7297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:19.262341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f6110-ba7d-46f3-ad2b-06fd3b49e4d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:19.285842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f6110-ba7d-46f3-ad2b-06fd3b49e4d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:19.287337 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f6110-ba7d-46f3-ad2b-06fd3b49e4d5 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:19.332646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 859/1718] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:19 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:19.481762 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5aeea-8748-4fbb-9a99-b5d5941e7297 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:19.484486 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f6110-ba7d-46f3-ad2b-06fd3b49e4d5 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:19.496395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f6110-ba7d-46f3-ad2b-06fd3b49e4d5 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:19.501509 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935abd0c-7a0a-447c-954c-7543822d6fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:19.502685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935abd0c-7a0a-447c-954c-7543822d6fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:19.503077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935abd0c-7a0a-447c-954c-7543822d6fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:19.504148 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935abd0c-7a0a-447c-954c-7543822d6fae admin admin] PATH_INFO: `/v3/projects/124f2279aa644b7ea0155a0ac58a001c` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:19.506330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935abd0c-7a0a-447c-954c-7543822d6fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=124f2279aa644b7ea0155a0ac58a001c)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:19.506490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9e684-98e4-4eaf-a546-d90a1e579dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:19.507094 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9e684-98e4-4eaf-a546-d90a1e579dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:19.507380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9e684-98e4-4eaf-a546-d90a1e579dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:19.507665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9e684-98e4-4eaf-a546-d90a1e579dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:19.513084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935abd0c-7a0a-447c-954c-7543822d6fae admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:19.553939 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:19.651283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-935abd0c-7a0a-447c-954c-7543822d6fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124f2279aa644b7ea0155a0ac58a001c', 'request_id': 'req-935abd0c-7a0a-447c-954c-7543822d6fae'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:19.668772 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-935abd0c-7a0a-447c-954c-7543822d6fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124f2279aa644b7ea0155a0ac58a001c', 'request_id': 'req-935abd0c-7a0a-447c-954c-7543822d6fae'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:19.669000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9e684-98e4-4eaf-a546-d90a1e579dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:19.672252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9e684-98e4-4eaf-a546-d90a1e579dc2 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:19.695140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-935abd0c-7a0a-447c-954c-7543822d6fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124f2279aa644b7ea0155a0ac58a001c', 'request_id': 'req-935abd0c-7a0a-447c-954c-7543822d6fae'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:19.717086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 860/1719] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:19 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:20:19.729572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-935abd0c-7a0a-447c-954c-7543822d6fae admin admin] The token cache is being invalidate because project 124f2279aa644b7ea0155a0ac58a001c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:19.730377 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-935abd0c-7a0a-447c-954c-7543822d6fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:19.732618 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-935abd0c-7a0a-447c-954c-7543822d6fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:19.741625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 860/1720] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:19 2022] DELETE /identity/v3/projects/124f2279aa644b7ea0155a0ac58a001c => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:19.747674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44f60-732d-4d7a-af7d-17c6006deebf None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:19.747674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44f60-732d-4d7a-af7d-17c6006deebf None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:19.747674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44f60-732d-4d7a-af7d-17c6006deebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:19.844001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e9d44f60-732d-4d7a-af7d-17c6006deebf None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:19.848258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e9d44f60-732d-4d7a-af7d-17c6006deebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:20.100856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 861/1721] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:20.110505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424ef4b-a910-46ad-ad37-6297cc154249 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:20.111113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424ef4b-a910-46ad-ad37-6297cc154249 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:20.111351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424ef4b-a910-46ad-ad37-6297cc154249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:20.149248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-2424ef4b-a910-46ad-ad37-6297cc154249 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:20.157556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-2424ef4b-a910-46ad-ad37-6297cc154249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:20.191614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 861/1722] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:20.196414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d44f60-732d-4d7a-af7d-17c6006deebf None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:20.214587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d44f60-732d-4d7a-af7d-17c6006deebf None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:20.235045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c930f-f613-4bed-873a-7a25122d4e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:20.235909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c930f-f613-4bed-873a-7a25122d4e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:20.236301 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c930f-f613-4bed-873a-7a25122d4e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:20.242157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c930f-f613-4bed-873a-7a25122d4e63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:20.246549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c930f-f613-4bed-873a-7a25122d4e63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:20.247254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c930f-f613-4bed-873a-7a25122d4e63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:20.249449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c930f-f613-4bed-873a-7a25122d4e63 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:20.293006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 862/1723] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:20.297694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424ef4b-a910-46ad-ad37-6297cc154249 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:20.312210 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424ef4b-a910-46ad-ad37-6297cc154249 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:20.325254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98695a7-b5dc-4b11-9b90-2b99587eee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:20.326491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98695a7-b5dc-4b11-9b90-2b99587eee29 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:20.327214 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98695a7-b5dc-4b11-9b90-2b99587eee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:20.327821 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98695a7-b5dc-4b11-9b90-2b99587eee29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:20.329933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98695a7-b5dc-4b11-9b90-2b99587eee29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:20.332295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98695a7-b5dc-4b11-9b90-2b99587eee29 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:20.378245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 862/1724] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:20 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:20.383580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c930f-f613-4bed-873a-7a25122d4e63 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:20.405496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c930f-f613-4bed-873a-7a25122d4e63 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:20.497259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:20.579395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b93e7-77ad-4add-9015-308260ef1f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:20.580094 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b93e7-77ad-4add-9015-308260ef1f81 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:20.580377 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b93e7-77ad-4add-9015-308260ef1f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:20.580651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b93e7-77ad-4add-9015-308260ef1f81 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:20.581406 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b93e7-77ad-4add-9015-308260ef1f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:20.583669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b93e7-77ad-4add-9015-308260ef1f81 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:20.626256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 863/1725] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:20 2022] POST /identity/v3/users => generated 291 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:20.627831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98695a7-b5dc-4b11-9b90-2b99587eee29 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:20.647314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98695a7-b5dc-4b11-9b90-2b99587eee29 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:20.662344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aedb9-367b-458a-84a1-3f5dbe0ed0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:20.663758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aedb9-367b-458a-84a1-3f5dbe0ed0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:20.664586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aedb9-367b-458a-84a1-3f5dbe0ed0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:20.667259 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aedb9-367b-458a-84a1-3f5dbe0ed0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:20.668208 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aedb9-367b-458a-84a1-3f5dbe0ed0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:20.670125 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aedb9-367b-458a-84a1-3f5dbe0ed0a5 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:20.710641 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 863/1726] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:20.714655 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b93e7-77ad-4add-9015-308260ef1f81 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:20.742643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b93e7-77ad-4add-9015-308260ef1f81 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:20.755538 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce37f11-499e-4636-aff7-6f91c0e9c33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:20.757515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37f11-499e-4636-aff7-6f91c0e9c33c admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:20.758591 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37f11-499e-4636-aff7-6f91c0e9c33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:20.759369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37f11-499e-4636-aff7-6f91c0e9c33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:20.761438 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce37f11-499e-4636-aff7-6f91c0e9c33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:20.771730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce37f11-499e-4636-aff7-6f91c0e9c33c admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:20.796547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aedb9-367b-458a-84a1-3f5dbe0ed0a5 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:20.798053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 864/1727] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:20.827061 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aedb9-367b-458a-84a1-3f5dbe0ed0a5 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:20.868592 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ac4c-3db2-4898-9260-ad589656aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:20.872489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ac4c-3db2-4898-9260-ad589656aed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:20.872999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ac4c-3db2-4898-9260-ad589656aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:20.874466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ac4c-3db2-4898-9260-ad589656aed5 admin admin] PATH_INFO: `/v3/projects/10d89611294c4eddbf8acf8b7e40408b/users/cb08b4ed896c407ea4b7bdaf623d6e92/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:20.909166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ac4c-3db2-4898-9260-ad589656aed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d89611294c4eddbf8acf8b7e40408b, user_id=cb08b4ed896c407ea4b7bdaf623d6e92, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:20.912188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ac4c-3db2-4898-9260-ad589656aed5 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:20.947660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 864/1728] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:20 2022] PUT /identity/v3/projects/10d89611294c4eddbf8acf8b7e40408b/users/cb08b4ed896c407ea4b7bdaf623d6e92/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:20.963526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02fa33-0d48-4104-874c-6fd605db8136 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:20.963807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02fa33-0d48-4104-874c-6fd605db8136 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:20.964239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02fa33-0d48-4104-874c-6fd605db8136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:21.037085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ff02fa33-0d48-4104-874c-6fd605db8136 None None] MFA Rules not processed for user `cb08b4ed896c407ea4b7bdaf623d6e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:21.038383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ff02fa33-0d48-4104-874c-6fd605db8136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:21.230890 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 865/1729] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:21.233006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ac4c-3db2-4898-9260-ad589656aed5 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:21.473356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ac4c-3db2-4898-9260-ad589656aed5 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:21.490468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b06ba7-8cd6-4a06-817a-6920c19f4eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:21.491274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b06ba7-8cd6-4a06-817a-6920c19f4eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:21.491557 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b06ba7-8cd6-4a06-817a-6920c19f4eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:21.491834 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b06ba7-8cd6-4a06-817a-6920c19f4eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:21.492579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b06ba7-8cd6-4a06-817a-6920c19f4eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:21.494804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b06ba7-8cd6-4a06-817a-6920c19f4eaf admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:21.561103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 865/1730] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:21 2022] POST /identity/v3/projects => generated 379 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:21.564203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02fa33-0d48-4104-874c-6fd605db8136 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:21.588065 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02fa33-0d48-4104-874c-6fd605db8136 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:21.744426 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313dd20-51c1-46d2-a7b8-3c508086955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:21.745150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313dd20-51c1-46d2-a7b8-3c508086955b admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:21.745480 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313dd20-51c1-46d2-a7b8-3c508086955b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:21.745759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313dd20-51c1-46d2-a7b8-3c508086955b admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:21.746562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313dd20-51c1-46d2-a7b8-3c508086955b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:21.758695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313dd20-51c1-46d2-a7b8-3c508086955b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:21.802426 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 866/1731] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:21 2022] POST /identity/v3/users => generated 296 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:21.804382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b06ba7-8cd6-4a06-817a-6920c19f4eaf admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:21.831756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b06ba7-8cd6-4a06-817a-6920c19f4eaf admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:21.846975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abf3cd-5acf-46e6-8b43-7ce048725f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:21.850553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abf3cd-5acf-46e6-8b43-7ce048725f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:21.850845 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abf3cd-5acf-46e6-8b43-7ce048725f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:21.851132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abf3cd-5acf-46e6-8b43-7ce048725f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:21.864626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abf3cd-5acf-46e6-8b43-7ce048725f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:21.866786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abf3cd-5acf-46e6-8b43-7ce048725f32 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:21.899039 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313dd20-51c1-46d2-a7b8-3c508086955b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:21.905425 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 866/1732] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:21.911062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313dd20-51c1-46d2-a7b8-3c508086955b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:21.925910 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8300-8095-45f1-a903-697ea6ce1707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:21.927574 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8300-8095-45f1-a903-697ea6ce1707 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:21.928076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8300-8095-45f1-a903-697ea6ce1707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:21.928542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8300-8095-45f1-a903-697ea6ce1707 admin admin] PATH_INFO: `/v3/projects/07ead6d158a24ecc95164817dab8b94e/users/b8dd6ca9347943f5905c41ef30ff57ca/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:21.967857 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8300-8095-45f1-a903-697ea6ce1707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ead6d158a24ecc95164817dab8b94e, user_id=b8dd6ca9347943f5905c41ef30ff57ca, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:21.971197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8300-8095-45f1-a903-697ea6ce1707 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:21.992510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 867/1733] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:21 2022] PUT /identity/v3/projects/07ead6d158a24ecc95164817dab8b94e/users/b8dd6ca9347943f5905c41ef30ff57ca/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:21.997104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abf3cd-5acf-46e6-8b43-7ce048725f32 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:22.016143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abf3cd-5acf-46e6-8b43-7ce048725f32 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:22.022172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:22.190904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95831fdc-6a8f-4e7a-a6c5-9315727228b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:22.192200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95831fdc-6a8f-4e7a-a6c5-9315727228b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:22.193482 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95831fdc-6a8f-4e7a-a6c5-9315727228b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:22.193948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95831fdc-6a8f-4e7a-a6c5-9315727228b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:22.195083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95831fdc-6a8f-4e7a-a6c5-9315727228b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:22.201714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95831fdc-6a8f-4e7a-a6c5-9315727228b5 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:22.230608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 867/1734] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:20:22.234744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8300-8095-45f1-a903-697ea6ce1707 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:22.250988 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8300-8095-45f1-a903-697ea6ce1707 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:22.263478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87624348-fbbc-435b-bdf9-b01084891ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:22.264524 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87624348-fbbc-435b-bdf9-b01084891ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:22.264921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87624348-fbbc-435b-bdf9-b01084891ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:22.265271 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87624348-fbbc-435b-bdf9-b01084891ad9 admin admin] PATH_INFO: `/v3/projects/07ead6d158a24ecc95164817dab8b94e/users/b8dd6ca9347943f5905c41ef30ff57ca/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:22.272147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87624348-fbbc-435b-bdf9-b01084891ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ead6d158a24ecc95164817dab8b94e, user_id=b8dd6ca9347943f5905c41ef30ff57ca, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:22.277547 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87624348-fbbc-435b-bdf9-b01084891ad9 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:22.283858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:22.308849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 868/1735] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:22 2022] PUT /identity/v3/projects/07ead6d158a24ecc95164817dab8b94e/users/b8dd6ca9347943f5905c41ef30ff57ca/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:22.319528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ecadd-0d7c-4263-a7fa-dbb94e54d39e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:22.320091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ecadd-0d7c-4263-a7fa-dbb94e54d39e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:22.320186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ecadd-0d7c-4263-a7fa-dbb94e54d39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:22.361864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-264ecadd-0d7c-4263-a7fa-dbb94e54d39e None None] MFA Rules not processed for user `b8dd6ca9347943f5905c41ef30ff57ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:22.363694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-264ecadd-0d7c-4263-a7fa-dbb94e54d39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:22.561447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 868/1736] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:22.570691 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87624348-fbbc-435b-bdf9-b01084891ad9 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:22.573076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-87624348-fbbc-435b-bdf9-b01084891ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:22.658485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026669a-df35-437e-a378-27cb9cec7760 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:22.658785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026669a-df35-437e-a378-27cb9cec7760 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:22.659055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026669a-df35-437e-a378-27cb9cec7760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:22.719767 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-2026669a-df35-437e-a378-27cb9cec7760 None None] MFA Rules not processed for user `d6db138644b14a20a43b3b1b3fa63314`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:22.721031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-2026669a-df35-437e-a378-27cb9cec7760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:22.782204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87624348-fbbc-435b-bdf9-b01084891ad9 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:22.789562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71672a-ac44-4086-b724-11e44b6d46fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:22.790769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71672a-ac44-4086-b724-11e44b6d46fc service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:22.791532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71672a-ac44-4086-b724-11e44b6d46fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:22.792782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71672a-ac44-4086-b724-11e44b6d46fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:22.810114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71672a-ac44-4086-b724-11e44b6d46fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:22.812878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71672a-ac44-4086-b724-11e44b6d46fc service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:22.860687 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 869/1737] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:22.952042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 869/1738] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:20:22.976272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71672a-ac44-4086-b724-11e44b6d46fc service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:22.978612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1d71672a-ac44-4086-b724-11e44b6d46fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:23.005043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fae433-993e-42e4-bdc7-d42ff6928e8f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:23.011019 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fae433-993e-42e4-bdc7-d42ff6928e8f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:23.011438 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fae433-993e-42e4-bdc7-d42ff6928e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:23.136741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-17fae433-993e-42e4-bdc7-d42ff6928e8f None None] MFA Rules not processed for user `16293fa03ced44cc994a0b8ad19ebb89`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:23.141017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-17fae433-993e-42e4-bdc7-d42ff6928e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:23.189964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:23.303123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71672a-ac44-4086-b724-11e44b6d46fc service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:23.317149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 870/1739] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:20:23.338121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b5208-7dbd-4bb6-93f8-2db49a845c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:23.340496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b5208-7dbd-4bb6-93f8-2db49a845c0c service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:23.341331 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b5208-7dbd-4bb6-93f8-2db49a845c0c service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:23.341836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b5208-7dbd-4bb6-93f8-2db49a845c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:23.418988 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b5208-7dbd-4bb6-93f8-2db49a845c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:23.429989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b5208-7dbd-4bb6-93f8-2db49a845c0c service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:23.481061 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 870/1740] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:23.882441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fae433-993e-42e4-bdc7-d42ff6928e8f None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:23.905409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fae433-993e-42e4-bdc7-d42ff6928e8f None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:23.937383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36af51-4fe2-4400-88cc-492a321a348b tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd6ca9347943f5905c41ef30ff57ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07ead6d158a24ecc95164817dab8b94e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:23.938528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36af51-4fe2-4400-88cc-492a321a348b tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:23.939726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36af51-4fe2-4400-88cc-492a321a348b tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:23.940208 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36af51-4fe2-4400-88cc-492a321a348b tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:23.941451 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36af51-4fe2-4400-88cc-492a321a348b tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:23.942649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36af51-4fe2-4400-88cc-492a321a348b tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:23.946251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36af51-4fe2-4400-88cc-492a321a348b tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:23.981622 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 871/1741] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:23.985239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b5208-7dbd-4bb6-93f8-2db49a845c0c service nova] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:24.003003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b5208-7dbd-4bb6-93f8-2db49a845c0c service nova] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:24.010936 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b6db4-b002-4016-bd17-165989e2cbe2 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd6ca9347943f5905c41ef30ff57ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07ead6d158a24ecc95164817dab8b94e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:24.011640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b6db4-b002-4016-bd17-165989e2cbe2 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:24.011931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b6db4-b002-4016-bd17-165989e2cbe2 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:24.012288 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b6db4-b002-4016-bd17-165989e2cbe2 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:24.013121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b6db4-b002-4016-bd17-165989e2cbe2 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:24.015179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b6db4-b002-4016-bd17-165989e2cbe2 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:24.063727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 871/1742] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:23 2022] POST /identity/v3/projects => generated 355 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:24.068759 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36af51-4fe2-4400-88cc-492a321a348b tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:24.085576 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36af51-4fe2-4400-88cc-492a321a348b tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:24.280414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98f995-5ba1-4ce0-b3ab-8780352520c9 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd6ca9347943f5905c41ef30ff57ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07ead6d158a24ecc95164817dab8b94e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:24.281269 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98f995-5ba1-4ce0-b3ab-8780352520c9 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:24.281563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98f995-5ba1-4ce0-b3ab-8780352520c9 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:24.286420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98f995-5ba1-4ce0-b3ab-8780352520c9 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:24.294968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98f995-5ba1-4ce0-b3ab-8780352520c9 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:24.301513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98f995-5ba1-4ce0-b3ab-8780352520c9 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:24.320623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98f995-5ba1-4ce0-b3ab-8780352520c9 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:24.375476 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 872/1743] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:24.451521 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3231f3-ce86-4fb1-b7ff-84a0022c5c91 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:24.452070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3231f3-ce86-4fb1-b7ff-84a0022c5c91 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:24.452070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3231f3-ce86-4fb1-b7ff-84a0022c5c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:24.531561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ba3231f3-ce86-4fb1-b7ff-84a0022c5c91 None None] MFA Rules not processed for user `58366850e234491cafe268bb56e9e3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:24.539739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ba3231f3-ce86-4fb1-b7ff-84a0022c5c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:24.592181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98f995-5ba1-4ce0-b3ab-8780352520c9 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:24.614019 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98f995-5ba1-4ce0-b3ab-8780352520c9 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:24.642298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8dd6ca9347943f5905c41ef30ff57ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07ead6d158a24ecc95164817dab8b94e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:24.645493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:24.645790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:24.646071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] PATH_INFO: `/v3/projects/52dd9a407204419aac240dea2055d040` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:24.651591 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52dd9a407204419aac240dea2055d040)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:24.655393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:24.756339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:24.769995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52dd9a407204419aac240dea2055d040', 'request_id': 'req-f8cf25a3-e3fb-4284-bc07-941e10411265'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:24.812461 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52dd9a407204419aac240dea2055d040', 'request_id': 'req-f8cf25a3-e3fb-4284-bc07-941e10411265'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:24.825200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52dd9a407204419aac240dea2055d040', 'request_id': 'req-f8cf25a3-e3fb-4284-bc07-941e10411265'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:24.852145 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 872/1744] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:24.853244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] The token cache is being invalidate because project 52dd9a407204419aac240dea2055d040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:24.853912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:24.856055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:24.866124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 873/1745] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:24 2022] DELETE /identity/v3/projects/52dd9a407204419aac240dea2055d040 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:24.882563 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3231f3-ce86-4fb1-b7ff-84a0022c5c91 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:25.076791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3231f3-ce86-4fb1-b7ff-84a0022c5c91 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:25.324463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af342c-44fa-489b-885d-2a14535534be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:25.327147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af342c-44fa-489b-885d-2a14535534be service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:25.328492 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af342c-44fa-489b-885d-2a14535534be service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:25.328970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af342c-44fa-489b-885d-2a14535534be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:25.334054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-81af342c-44fa-489b-885d-2a14535534be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:25.507540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af342c-44fa-489b-885d-2a14535534be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:25.513458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af342c-44fa-489b-885d-2a14535534be service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:25.548120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 873/1746] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:20:25.617393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:25.620534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:25.665254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df205538-6444-4fff-a452-a47ba6c92ad3 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:25.665653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df205538-6444-4fff-a452-a47ba6c92ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:25.666030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df205538-6444-4fff-a452-a47ba6c92ad3 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:25.667808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 874/1747] 10.222.0.62 () {54 vars in 912 bytes} [Thu Jul 7 07:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:20:25.685055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8eef9d-f307-4167-9527-57115d21c258 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:25.685667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8eef9d-f307-4167-9527-57115d21c258 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:25.685942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8eef9d-f307-4167-9527-57115d21c258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:25.730634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:25.809845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-3d8eef9d-f307-4167-9527-57115d21c258 None None] MFA Rules not processed for user `4d0c6b46b5d248e5bed2b1bbdfa74f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:25.811673 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3d8eef9d-f307-4167-9527-57115d21c258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:25.838279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:25.863217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf25a3-e3fb-4284-bc07-941e10411265 tempest-VolumeQuotaClassesTest-378653138 tempest-VolumeQuotaClassesTest-378653138-project-admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:25.895653 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd72bf-925f-44dc-9a7f-751228c2fd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:25.902009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd72bf-925f-44dc-9a7f-751228c2fd72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:25.903229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd72bf-925f-44dc-9a7f-751228c2fd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:25.906025 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd72bf-925f-44dc-9a7f-751228c2fd72 admin admin] PATH_INFO: `/v3/users/cb08b4ed896c407ea4b7bdaf623d6e92` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:25.912205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd72bf-925f-44dc-9a7f-751228c2fd72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb08b4ed896c407ea4b7bdaf623d6e92)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:25.916776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd72bf-925f-44dc-9a7f-751228c2fd72 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:26.046656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 875/1748] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:20:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:20:26.077776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e4dd72bf-925f-44dc-9a7f-751228c2fd72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb08b4ed896c407ea4b7bdaf623d6e92'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:26.078910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e4dd72bf-925f-44dc-9a7f-751228c2fd72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb08b4ed896c407ea4b7bdaf623d6e92'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:26.080684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e4dd72bf-925f-44dc-9a7f-751228c2fd72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb08b4ed896c407ea4b7bdaf623d6e92'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:26.095397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8eef9d-f307-4167-9527-57115d21c258 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:26.102052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3d8eef9d-f307-4167-9527-57115d21c258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:26.115429 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e4dd72bf-925f-44dc-9a7f-751228c2fd72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb08b4ed896c407ea4b7bdaf623d6e92'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:26.144311 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8eef9d-f307-4167-9527-57115d21c258 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:26.151564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e4dd72bf-925f-44dc-9a7f-751228c2fd72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb08b4ed896c407ea4b7bdaf623d6e92'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:26.164049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff18ea-3141-42b0-9a9e-1510227f7d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:26.165149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff18ea-3141-42b0-9a9e-1510227f7d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:26.168400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff18ea-3141-42b0-9a9e-1510227f7d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:26.169095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff18ea-3141-42b0-9a9e-1510227f7d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:26.179782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-11ff18ea-3141-42b0-9a9e-1510227f7d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:26.229978 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff18ea-3141-42b0-9a9e-1510227f7d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:26.234535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 874/1749] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:25 2022] DELETE /identity/v3/users/cb08b4ed896c407ea4b7bdaf623d6e92 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:26.239328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff18ea-3141-42b0-9a9e-1510227f7d35 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:26.239794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c1ae3-6f6e-4649-8946-2e42624ae220 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:26.240378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c1ae3-6f6e-4649-8946-2e42624ae220 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:26.249078 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c1ae3-6f6e-4649-8946-2e42624ae220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:26.267223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 876/1750] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:26.298462 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-d77c1ae3-6f6e-4649-8946-2e42624ae220 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:26.299832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d77c1ae3-6f6e-4649-8946-2e42624ae220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:26.470782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 875/1751] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:20:26.687706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff18ea-3141-42b0-9a9e-1510227f7d35 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:26.689644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-11ff18ea-3141-42b0-9a9e-1510227f7d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:26.720262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff18ea-3141-42b0-9a9e-1510227f7d35 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:26.862660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaec7fa-84ab-431c-8c81-6155b228750e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:26.873573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaec7fa-84ab-431c-8c81-6155b228750e service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:26.873789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaec7fa-84ab-431c-8c81-6155b228750e service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:26.874930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaec7fa-84ab-431c-8c81-6155b228750e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:26.897893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaec7fa-84ab-431c-8c81-6155b228750e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:26.900453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaec7fa-84ab-431c-8c81-6155b228750e service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:26.922469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 877/1752] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:28.202623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d4ef7-f8bd-426c-abf1-43c091fa3e35 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:28.203521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d4ef7-f8bd-426c-abf1-43c091fa3e35 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:28.207604 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d4ef7-f8bd-426c-abf1-43c091fa3e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:28.307869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-5e5d4ef7-f8bd-426c-abf1-43c091fa3e35 None None] MFA Rules not processed for user `3401cbd655eb4dffb2acb46cfbdd9259`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:28.310864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5e5d4ef7-f8bd-426c-abf1-43c091fa3e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:28.562514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaec7fa-84ab-431c-8c81-6155b228750e service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:28.565583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6aaec7fa-84ab-431c-8c81-6155b228750e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:28.588989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:28.607376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaec7fa-84ab-431c-8c81-6155b228750e service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:28.629026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef5d84-50b8-4e14-a9ad-5f56d300262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:28.629997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef5d84-50b8-4e14-a9ad-5f56d300262b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:28.630281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef5d84-50b8-4e14-a9ad-5f56d300262b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:28.630557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef5d84-50b8-4e14-a9ad-5f56d300262b admin admin] PATH_INFO: `/v3/users/cd412cb2f08b4fd597fb5638bbb7f32e` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:28.644516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef5d84-50b8-4e14-a9ad-5f56d300262b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd412cb2f08b4fd597fb5638bbb7f32e)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:28.646973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef5d84-50b8-4e14-a9ad-5f56d300262b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:28.672749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 876/1753] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:28.684754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52c57-42cf-4125-944f-37c799a43954 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:28.685322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52c57-42cf-4125-944f-37c799a43954 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:28.685745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52c57-42cf-4125-944f-37c799a43954 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:28.690016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 877/1754] 10.222.0.62 () {54 vars in 960 bytes} [Thu Jul 7 07:20:28 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:20:28.691661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2d6a2-839d-445e-a59d-e845330cd170 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:28.692601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2d6a2-839d-445e-a59d-e845330cd170 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:28.693395 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2d6a2-839d-445e-a59d-e845330cd170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:28.741576 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-69c2d6a2-839d-445e-a59d-e845330cd170 None None] MFA Rules not processed for user `3401cbd655eb4dffb2acb46cfbdd9259`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:28.743126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-69c2d6a2-839d-445e-a59d-e845330cd170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:28.770689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 878/1755] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:28.774940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e4b7c-2c1c-4a00-b748-4741966b8324 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:28.776624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e4b7c-2c1c-4a00-b748-4741966b8324 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:28.777066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e4b7c-2c1c-4a00-b748-4741966b8324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:28.831973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-664e4b7c-2c1c-4a00-b748-4741966b8324 None None] MFA Rules not processed for user `bd80f27a4499407d8c350f2908638334`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:28.833838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-08ef5d84-50b8-4e14-a9ad-5f56d300262b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd412cb2f08b4fd597fb5638bbb7f32e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:28.836240 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-08ef5d84-50b8-4e14-a9ad-5f56d300262b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd412cb2f08b4fd597fb5638bbb7f32e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:28.838941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-08ef5d84-50b8-4e14-a9ad-5f56d300262b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd412cb2f08b4fd597fb5638bbb7f32e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:28.839150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-664e4b7c-2c1c-4a00-b748-4741966b8324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:28.861466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-08ef5d84-50b8-4e14-a9ad-5f56d300262b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd412cb2f08b4fd597fb5638bbb7f32e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:28.886340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-08ef5d84-50b8-4e14-a9ad-5f56d300262b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd412cb2f08b4fd597fb5638bbb7f32e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:29.018099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 878/1756] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:28 2022] DELETE /identity/v3/users/cd412cb2f08b4fd597fb5638bbb7f32e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:29.022684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13177b0-df3c-4d06-9e2e-c3935def4e21 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:29.022977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13177b0-df3c-4d06-9e2e-c3935def4e21 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:29.027038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13177b0-df3c-4d06-9e2e-c3935def4e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:29.104781 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c13177b0-df3c-4d06-9e2e-c3935def4e21 None None] MFA Rules not processed for user `d6db138644b14a20a43b3b1b3fa63314`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:29.106991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c13177b0-df3c-4d06-9e2e-c3935def4e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:29.136564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:29.196398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 879/1757] 10.222.0.62 () {58 vars in 1057 bytes} [Thu Jul 7 07:20:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:29.204177 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e4b7c-2c1c-4a00-b748-4741966b8324 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:29.206979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-664e4b7c-2c1c-4a00-b748-4741966b8324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:29.308331 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 879/1758] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:29.310281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde25c7-f1b9-49e9-9508-0f1a1b24baf2 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:29.310576 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde25c7-f1b9-49e9-9508-0f1a1b24baf2 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:29.310878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde25c7-f1b9-49e9-9508-0f1a1b24baf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:29.436218 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ebde25c7-f1b9-49e9-9508-0f1a1b24baf2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:29.437550 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ebde25c7-f1b9-49e9-9508-0f1a1b24baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:29.444005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e4b7c-2c1c-4a00-b748-4741966b8324 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:29.679457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:29.689281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 880/1759] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:29.689281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde25c7-f1b9-49e9-9508-0f1a1b24baf2 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:29.699063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a4255-bd0b-44cd-bf08-c3b990c43788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:29.699833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a4255-bd0b-44cd-bf08-c3b990c43788 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:29.700118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a4255-bd0b-44cd-bf08-c3b990c43788 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:29.702132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a4255-bd0b-44cd-bf08-c3b990c43788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:29.708342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5b0a4255-bd0b-44cd-bf08-c3b990c43788 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:29.925655 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde25c7-f1b9-49e9-9508-0f1a1b24baf2 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:29.933347 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988e692-3d2b-4237-8b29-5141ec807785 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:29.934411 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e692-3d2b-4237-8b29-5141ec807785 service placement] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:29.934841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e692-3d2b-4237-8b29-5141ec807785 service placement] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:29.935332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e692-3d2b-4237-8b29-5141ec807785 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:29.940265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b988e692-3d2b-4237-8b29-5141ec807785 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:29.998800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988e692-3d2b-4237-8b29-5141ec807785 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:30.005892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988e692-3d2b-4237-8b29-5141ec807785 service placement] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:30.070726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 881/1760] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:30.074546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988e692-3d2b-4237-8b29-5141ec807785 service placement] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:30.076164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b988e692-3d2b-4237-8b29-5141ec807785 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:30.109157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988e692-3d2b-4237-8b29-5141ec807785 service placement] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:30.118631 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:30.119916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:30.119916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:30.120154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] PATH_INFO: `/v3/users/01a81463fae94e8c8a3791edc3ff41d3` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:30.121776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a81463fae94e8c8a3791edc3ff41d3)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:30.123747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:30.137423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a4255-bd0b-44cd-bf08-c3b990c43788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:30.139093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a4255-bd0b-44cd-bf08-c3b990c43788 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:30.151687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 880/1761] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 955 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:30.152328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a4255-bd0b-44cd-bf08-c3b990c43788 service nova] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:30.155021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5b0a4255-bd0b-44cd-bf08-c3b990c43788 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:30.196969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a4255-bd0b-44cd-bf08-c3b990c43788 service nova] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:30.214459 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4b53d-fee5-4ebd-858c-0de84fb64534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:30.216583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4b53d-fee5-4ebd-858c-0de84fb64534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:30.217931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4b53d-fee5-4ebd-858c-0de84fb64534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:30.218234 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4b53d-fee5-4ebd-858c-0de84fb64534 admin admin] PATH_INFO: `/v3/projects/10d89611294c4eddbf8acf8b7e40408b` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:30.220650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4b53d-fee5-4ebd-858c-0de84fb64534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d89611294c4eddbf8acf8b7e40408b)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:30.226514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4b53d-fee5-4ebd-858c-0de84fb64534 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:30.234453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a81463fae94e8c8a3791edc3ff41d3'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:30.235909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a81463fae94e8c8a3791edc3ff41d3'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:30.238048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a81463fae94e8c8a3791edc3ff41d3'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:30.247512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:30.255730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a81463fae94e8c8a3791edc3ff41d3'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:30.283137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a81463fae94e8c8a3791edc3ff41d3'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:30.341201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6cb4b53d-fee5-4ebd-858c-0de84fb64534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d89611294c4eddbf8acf8b7e40408b', 'request_id': 'req-6cb4b53d-fee5-4ebd-858c-0de84fb64534'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:30.345502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 882/1762] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:30 2022] DELETE /identity/v3/users/01a81463fae94e8c8a3791edc3ff41d3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:30.346620 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:30.351437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:30.357320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6cb4b53d-fee5-4ebd-858c-0de84fb64534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d89611294c4eddbf8acf8b7e40408b', 'request_id': 'req-6cb4b53d-fee5-4ebd-858c-0de84fb64534'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:30.369507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6cb4b53d-fee5-4ebd-858c-0de84fb64534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d89611294c4eddbf8acf8b7e40408b', 'request_id': 'req-6cb4b53d-fee5-4ebd-858c-0de84fb64534'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:30.412543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6cb4b53d-fee5-4ebd-858c-0de84fb64534 admin admin] The token cache is being invalidate because project 10d89611294c4eddbf8acf8b7e40408b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:30.414056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6cb4b53d-fee5-4ebd-858c-0de84fb64534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:30.416751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6cb4b53d-fee5-4ebd-858c-0de84fb64534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:30.421579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 881/1763] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:30 2022] DELETE /identity/v3/projects/10d89611294c4eddbf8acf8b7e40408b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:30.423354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dc362-5e01-4013-8edc-36f0df6addcf None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:30.426418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dc362-5e01-4013-8edc-36f0df6addcf None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:30.427001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dc362-5e01-4013-8edc-36f0df6addcf None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:30.440013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 882/1764] 10.222.0.62 () {54 vars in 912 bytes} [Thu Jul 7 07:20:30 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:20:30.442619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae999b-7453-4588-af26-bddf26156a3a None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:30.443183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae999b-7453-4588-af26-bddf26156a3a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:30.443667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae999b-7453-4588-af26-bddf26156a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:30.516008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-6fae999b-7453-4588-af26-bddf26156a3a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:30.521914 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6fae999b-7453-4588-af26-bddf26156a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:30.560612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d0a76-e167-4e8b-b126-98b3778eb070 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:30.577490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88122fca-215c-4865-a433-ab8342367207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:30.578554 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88122fca-215c-4865-a433-ab8342367207 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:30.580606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88122fca-215c-4865-a433-ab8342367207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:30.581808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88122fca-215c-4865-a433-ab8342367207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:30.587758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-88122fca-215c-4865-a433-ab8342367207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:30.741382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 883/1765] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:30.742900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae999b-7453-4588-af26-bddf26156a3a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:30.748055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6fae999b-7453-4588-af26-bddf26156a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:30.780869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae999b-7453-4588-af26-bddf26156a3a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:30.798171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c19a6-5a78-4f1a-8ef0-36d64fdc1083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:30.799444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c19a6-5a78-4f1a-8ef0-36d64fdc1083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:30.802742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c19a6-5a78-4f1a-8ef0-36d64fdc1083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:30.802742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c19a6-5a78-4f1a-8ef0-36d64fdc1083 admin admin] PATH_INFO: `/v3/users/b8dd6ca9347943f5905c41ef30ff57ca` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:30.804746 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c19a6-5a78-4f1a-8ef0-36d64fdc1083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8dd6ca9347943f5905c41ef30ff57ca)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:30.819847 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c19a6-5a78-4f1a-8ef0-36d64fdc1083 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:30.846355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88122fca-215c-4865-a433-ab8342367207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:30.848147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88122fca-215c-4865-a433-ab8342367207 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:30.865077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 883/1766] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:30.866594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beec41-c4f7-4b34-bf73-cfed1cf65bb5 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:30.866888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beec41-c4f7-4b34-bf73-cfed1cf65bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:30.867168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beec41-c4f7-4b34-bf73-cfed1cf65bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:30.904538 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-66beec41-c4f7-4b34-bf73-cfed1cf65bb5 None None] MFA Rules not processed for user `4d0c6b46b5d248e5bed2b1bbdfa74f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:30.907228 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-66beec41-c4f7-4b34-bf73-cfed1cf65bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:30.920839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 884/1767] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:20:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:30.922919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:30.924672 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beec41-c4f7-4b34-bf73-cfed1cf65bb5 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:30.929684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-66beec41-c4f7-4b34-bf73-cfed1cf65bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:30.988681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beec41-c4f7-4b34-bf73-cfed1cf65bb5 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:30.993337 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24499898-b382-4e30-9726-9e819c96ade7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:30.994117 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24499898-b382-4e30-9726-9e819c96ade7 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:30.994412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24499898-b382-4e30-9726-9e819c96ade7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:30.994688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24499898-b382-4e30-9726-9e819c96ade7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:31.046941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24499898-b382-4e30-9726-9e819c96ade7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:31.049345 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24499898-b382-4e30-9726-9e819c96ade7 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:31.066151 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6e1c19a6-5a78-4f1a-8ef0-36d64fdc1083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8dd6ca9347943f5905c41ef30ff57ca'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:31.067758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6e1c19a6-5a78-4f1a-8ef0-36d64fdc1083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8dd6ca9347943f5905c41ef30ff57ca'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:31.070038 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6e1c19a6-5a78-4f1a-8ef0-36d64fdc1083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8dd6ca9347943f5905c41ef30ff57ca'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:31.097007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 885/1768] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:31.100521 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24499898-b382-4e30-9726-9e819c96ade7 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:31.102782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-24499898-b382-4e30-9726-9e819c96ade7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:31.114198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6e1c19a6-5a78-4f1a-8ef0-36d64fdc1083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8dd6ca9347943f5905c41ef30ff57ca'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:31.136488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24499898-b382-4e30-9726-9e819c96ade7 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:31.153731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de81ec-229a-4d6d-8217-6bf3adb06809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:31.160020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de81ec-229a-4d6d-8217-6bf3adb06809 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:31.161687 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de81ec-229a-4d6d-8217-6bf3adb06809 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:31.162063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6e1c19a6-5a78-4f1a-8ef0-36d64fdc1083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8dd6ca9347943f5905c41ef30ff57ca'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:31.163701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de81ec-229a-4d6d-8217-6bf3adb06809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:31.169823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-52de81ec-229a-4d6d-8217-6bf3adb06809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:31.196929 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de81ec-229a-4d6d-8217-6bf3adb06809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:31.204507 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de81ec-229a-4d6d-8217-6bf3adb06809 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:31.240314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 886/1769] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:31.290124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 884/1770] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:30 2022] DELETE /identity/v3/users/b8dd6ca9347943f5905c41ef30ff57ca => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:32.157442 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de81ec-229a-4d6d-8217-6bf3adb06809 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:32.159974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-52de81ec-229a-4d6d-8217-6bf3adb06809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:32.195585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de81ec-229a-4d6d-8217-6bf3adb06809 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:32.503340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:32.558939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:32.564902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:32.564902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:32.565189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] PATH_INFO: `/v3/projects/11e17b26a237484f9841e2a5093551da` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:32.572549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e17b26a237484f9841e2a5093551da)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:32.574706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:32.696089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae067cd-3d1b-4832-9bde-4d7abb2ccd84 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:32.696885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae067cd-3d1b-4832-9bde-4d7abb2ccd84 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:32.696885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae067cd-3d1b-4832-9bde-4d7abb2ccd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:32.747700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-7ae067cd-3d1b-4832-9bde-4d7abb2ccd84 None None] MFA Rules not processed for user `58366850e234491cafe268bb56e9e3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:32.751771 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7ae067cd-3d1b-4832-9bde-4d7abb2ccd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:32.822513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e17b26a237484f9841e2a5093551da', 'request_id': 'req-b2688918-3906-4f13-ac7a-93bcc95eb7ec'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:32.835672 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e17b26a237484f9841e2a5093551da', 'request_id': 'req-b2688918-3906-4f13-ac7a-93bcc95eb7ec'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:32.858369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e17b26a237484f9841e2a5093551da', 'request_id': 'req-b2688918-3906-4f13-ac7a-93bcc95eb7ec'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:32.918038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] The token cache is being invalidate because project 11e17b26a237484f9841e2a5093551da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:32.918358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:32.921277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:32.935523 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 887/1771] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:32 2022] DELETE /identity/v3/projects/11e17b26a237484f9841e2a5093551da => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:32.937178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:32.941350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:32.967979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 885/1772] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:32.972309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae067cd-3d1b-4832-9bde-4d7abb2ccd84 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:32.977019 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7ae067cd-3d1b-4832-9bde-4d7abb2ccd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:33.056986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae067cd-3d1b-4832-9bde-4d7abb2ccd84 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:33.216925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2688918-3906-4f13-ac7a-93bcc95eb7ec admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:33.230195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:33.236534 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:33.237173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:33.237494 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] PATH_INFO: `/v3/projects/d987825e5046499a85116fc11d49c3a4` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:33.240656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d987825e5046499a85116fc11d49c3a4)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:33.242674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:33.351365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:33.353082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:33.354752 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:33.355900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] PATH_INFO: `/v3/users/8d83f8eb6983430bb82fabb661e6ecd6` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:33.358537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d83f8eb6983430bb82fabb661e6ecd6)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:33.364461 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:33.405724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd987825e5046499a85116fc11d49c3a4', 'request_id': 'req-996c2abe-f91e-4077-bbf0-29d0d4b912bc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:33.424229 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd987825e5046499a85116fc11d49c3a4', 'request_id': 'req-996c2abe-f91e-4077-bbf0-29d0d4b912bc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:33.440649 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd987825e5046499a85116fc11d49c3a4', 'request_id': 'req-996c2abe-f91e-4077-bbf0-29d0d4b912bc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:33.461611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] The token cache is being invalidate because project d987825e5046499a85116fc11d49c3a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:33.461915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:33.464848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:33.467434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 888/1773] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:32 2022] DELETE /identity/v3/projects/d987825e5046499a85116fc11d49c3a4 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:33.468332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:33.477169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:33.517789 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d83f8eb6983430bb82fabb661e6ecd6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:33.518465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d83f8eb6983430bb82fabb661e6ecd6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:33.525387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:33.526549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:33.528022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d83f8eb6983430bb82fabb661e6ecd6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:33.557881 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d83f8eb6983430bb82fabb661e6ecd6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:33.592386 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d83f8eb6983430bb82fabb661e6ecd6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:33.674241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 886/1774] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:32 2022] DELETE /identity/v3/users/8d83f8eb6983430bb82fabb661e6ecd6 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:33.679119 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:33.686573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:33.731993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c2abe-f91e-4077-bbf0-29d0d4b912bc admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:33.863799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e642eb2-93be-4e03-8569-a07e7babe188 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:33.878288 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91d6a4-b0f6-45c1-a1cf-7367c992bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:33.880427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a830c0-f2c9-4968-8702-058ff61564d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:33.881399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a830c0-f2c9-4968-8702-058ff61564d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:33.881722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a830c0-f2c9-4968-8702-058ff61564d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:33.882463 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d6a4-b0f6-45c1-a1cf-7367c992bb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:33.882778 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d6a4-b0f6-45c1-a1cf-7367c992bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:33.883095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d6a4-b0f6-45c1-a1cf-7367c992bb4e admin admin] PATH_INFO: `/v3/users/89db4481af384dfd9836e63058efa6d8` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:33.884912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91d6a4-b0f6-45c1-a1cf-7367c992bb4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89db4481af384dfd9836e63058efa6d8)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:33.885449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a830c0-f2c9-4968-8702-058ff61564d5 admin admin] PATH_INFO: `/v3/projects/07ead6d158a24ecc95164817dab8b94e` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:33.887675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a830c0-f2c9-4968-8702-058ff61564d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ead6d158a24ecc95164817dab8b94e)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:33.891799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a830c0-f2c9-4968-8702-058ff61564d5 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:33.892717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91d6a4-b0f6-45c1-a1cf-7367c992bb4e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:34.066723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0b91d6a4-b0f6-45c1-a1cf-7367c992bb4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89db4481af384dfd9836e63058efa6d8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.076149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0b91d6a4-b0f6-45c1-a1cf-7367c992bb4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89db4481af384dfd9836e63058efa6d8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.077262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0b91d6a4-b0f6-45c1-a1cf-7367c992bb4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89db4481af384dfd9836e63058efa6d8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.099590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0b91d6a4-b0f6-45c1-a1cf-7367c992bb4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89db4481af384dfd9836e63058efa6d8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.100592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f1a830c0-f2c9-4968-8702-058ff61564d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ead6d158a24ecc95164817dab8b94e', 'request_id': 'req-f1a830c0-f2c9-4968-8702-058ff61564d5'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.117778 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f1a830c0-f2c9-4968-8702-058ff61564d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ead6d158a24ecc95164817dab8b94e', 'request_id': 'req-f1a830c0-f2c9-4968-8702-058ff61564d5'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.118029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0b91d6a4-b0f6-45c1-a1cf-7367c992bb4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89db4481af384dfd9836e63058efa6d8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.134907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f1a830c0-f2c9-4968-8702-058ff61564d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ead6d158a24ecc95164817dab8b94e', 'request_id': 'req-f1a830c0-f2c9-4968-8702-058ff61564d5'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.148358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 887/1775] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:33 2022] DELETE /identity/v3/users/89db4481af384dfd9836e63058efa6d8 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:34.150006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5c261-a1e5-441a-b1f9-0f21d70be643 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:34.150517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5c261-a1e5-441a-b1f9-0f21d70be643 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:34.151064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5c261-a1e5-441a-b1f9-0f21d70be643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:34.169358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f1a830c0-f2c9-4968-8702-058ff61564d5 admin admin] The token cache is being invalidate because project 07ead6d158a24ecc95164817dab8b94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:34.169771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f1a830c0-f2c9-4968-8702-058ff61564d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.170730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f1a830c0-f2c9-4968-8702-058ff61564d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.175912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 889/1776] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:33 2022] DELETE /identity/v3/projects/07ead6d158a24ecc95164817dab8b94e => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:34.187030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407e271-543c-4ca6-90fd-85a8a4f6d5bf None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:34.190143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407e271-543c-4ca6-90fd-85a8a4f6d5bf None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:34.191211 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407e271-543c-4ca6-90fd-85a8a4f6d5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:34.200488 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-8ba5c261-a1e5-441a-b1f9-0f21d70be643 None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:34.202373 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-8ba5c261-a1e5-441a-b1f9-0f21d70be643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:34.232568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-3407e271-543c-4ca6-90fd-85a8a4f6d5bf None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:34.234710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3407e271-543c-4ca6-90fd-85a8a4f6d5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:34.305539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:34.346190 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 888/1777] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:20:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:34.376832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:34.418827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 890/1778] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:34.430963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09319c76-a549-4601-a159-18d057d1ca73 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:34.431250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09319c76-a549-4601-a159-18d057d1ca73 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:34.431585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09319c76-a549-4601-a159-18d057d1ca73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:34.465844 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-09319c76-a549-4601-a159-18d057d1ca73 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:34.467662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-09319c76-a549-4601-a159-18d057d1ca73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:34.487099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 889/1779] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:34.488744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407e271-543c-4ca6-90fd-85a8a4f6d5bf None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:34.500972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407e271-543c-4ca6-90fd-85a8a4f6d5bf None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:34.516550 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765c600-158d-4581-9903-34a328dc5bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:34.517502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765c600-158d-4581-9903-34a328dc5bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:34.517945 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765c600-158d-4581-9903-34a328dc5bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:34.520215 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765c600-158d-4581-9903-34a328dc5bb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:34.522627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765c600-158d-4581-9903-34a328dc5bb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:34.523066 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765c600-158d-4581-9903-34a328dc5bb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:34.526797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765c600-158d-4581-9903-34a328dc5bb1 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:34.548097 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09319c76-a549-4601-a159-18d057d1ca73 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:34.550123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-09319c76-a549-4601-a159-18d057d1ca73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:34.563656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 891/1780] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:34.567574 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765c600-158d-4581-9903-34a328dc5bb1 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:34.584781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09319c76-a549-4601-a159-18d057d1ca73 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:34.590348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765c600-158d-4581-9903-34a328dc5bb1 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:34.597296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:34.598195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:34.600764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:34.601112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] PATH_INFO: `/v3/projects/15166cd3bf054c61898a4d7a1c5a811b` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:34.602631 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239e163-2623-467a-95fd-9223a10973c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:34.603593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15166cd3bf054c61898a4d7a1c5a811b)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:34.605334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239e163-2623-467a-95fd-9223a10973c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:34.606162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239e163-2623-467a-95fd-9223a10973c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:34.607512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239e163-2623-467a-95fd-9223a10973c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:34.608408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239e163-2623-467a-95fd-9223a10973c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:34.610128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:34.610759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239e163-2623-467a-95fd-9223a10973c3 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:34.704309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 892/1781] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:34 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:34.704309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239e163-2623-467a-95fd-9223a10973c3 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:34.704309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-4239e163-2623-467a-95fd-9223a10973c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:34.747318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15166cd3bf054c61898a4d7a1c5a811b', 'request_id': 'req-b84fefc0-a319-450e-ad97-6d4dbcdacc59'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.766156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15166cd3bf054c61898a4d7a1c5a811b', 'request_id': 'req-b84fefc0-a319-450e-ad97-6d4dbcdacc59'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.775730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15166cd3bf054c61898a4d7a1c5a811b', 'request_id': 'req-b84fefc0-a319-450e-ad97-6d4dbcdacc59'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.798380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] The token cache is being invalidate because project 15166cd3bf054c61898a4d7a1c5a811b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:34.799042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.799924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:34.805527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 890/1782] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:34 2022] DELETE /identity/v3/projects/15166cd3bf054c61898a4d7a1c5a811b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:34.806945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:34.818615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:34.870141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239e163-2623-467a-95fd-9223a10973c3 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:34.987175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fefc0-a319-450e-ad97-6d4dbcdacc59 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:35.004502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7fbb5-70ec-4aab-b5c0-d84aa48d1b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:35.005206 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7fbb5-70ec-4aab-b5c0-d84aa48d1b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:35.005512 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7fbb5-70ec-4aab-b5c0-d84aa48d1b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:35.005801 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7fbb5-70ec-4aab-b5c0-d84aa48d1b4d admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:35.009600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7fbb5-70ec-4aab-b5c0-d84aa48d1b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:35.017092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7fbb5-70ec-4aab-b5c0-d84aa48d1b4d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:35.054132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864fbef-1222-42b7-9a1d-4f7e12ceb622 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:35.055721 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864fbef-1222-42b7-9a1d-4f7e12ceb622 service swift] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:35.056083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864fbef-1222-42b7-9a1d-4f7e12ceb622 service swift] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:35.056370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864fbef-1222-42b7-9a1d-4f7e12ceb622 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:35.064007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f864fbef-1222-42b7-9a1d-4f7e12ceb622 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:35.066637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 891/1783] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:34 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:35.073699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8067-056a-4b38-8ec0-05051def5441 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:35.073991 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8067-056a-4b38-8ec0-05051def5441 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:35.076059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8067-056a-4b38-8ec0-05051def5441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:35.122921 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-5cec8067-056a-4b38-8ec0-05051def5441 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:35.124203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5cec8067-056a-4b38-8ec0-05051def5441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:35.149670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 892/1784] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:35.151514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8067-056a-4b38-8ec0-05051def5441 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:35.185899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8067-056a-4b38-8ec0-05051def5441 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:35.207483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8faf7-df2e-427b-926e-abb4e63dea62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:35.208183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8faf7-df2e-427b-926e-abb4e63dea62 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:35.210356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8faf7-df2e-427b-926e-abb4e63dea62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:35.210356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8faf7-df2e-427b-926e-abb4e63dea62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:35.211105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8faf7-df2e-427b-926e-abb4e63dea62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:35.219997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8faf7-df2e-427b-926e-abb4e63dea62 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:35.275970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:35.289548 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 893/1785] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:35.291555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864fbef-1222-42b7-9a1d-4f7e12ceb622 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:35.295146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc496f-63bd-4683-b7ea-d554715ebb52 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:35.295146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc496f-63bd-4683-b7ea-d554715ebb52 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:35.295561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc496f-63bd-4683-b7ea-d554715ebb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:35.302360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864fbef-1222-42b7-9a1d-4f7e12ceb622 service swift] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:35.363954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 893/1786] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:20:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:20:35.379084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864fbef-1222-42b7-9a1d-4f7e12ceb622 service swift] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:35.422635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864fbef-1222-42b7-9a1d-4f7e12ceb622 service swift] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:35.438846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-9ccc496f-63bd-4683-b7ea-d554715ebb52 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:35.442584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-9ccc496f-63bd-4683-b7ea-d554715ebb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:35.460542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5073f0-8ad7-443e-94bf-047f43d25733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:35.462007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5073f0-8ad7-443e-94bf-047f43d25733 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:35.462325 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5073f0-8ad7-443e-94bf-047f43d25733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:35.462611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5073f0-8ad7-443e-94bf-047f43d25733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:35.463375 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5073f0-8ad7-443e-94bf-047f43d25733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:35.472213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5073f0-8ad7-443e-94bf-047f43d25733 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:35.492236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 894/1787] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:35.495113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc496f-63bd-4683-b7ea-d554715ebb52 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:35.519336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 894/1788] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:35.526502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5073f0-8ad7-443e-94bf-047f43d25733 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:35.533178 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc496f-63bd-4683-b7ea-d554715ebb52 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:35.568332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eed16b-242d-4d10-bacb-d4d340abb91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:35.569342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eed16b-242d-4d10-bacb-d4d340abb91c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:35.569634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eed16b-242d-4d10-bacb-d4d340abb91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:35.569917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eed16b-242d-4d10-bacb-d4d340abb91c admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:35.570663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eed16b-242d-4d10-bacb-d4d340abb91c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:35.570912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5073f0-8ad7-443e-94bf-047f43d25733 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:35.571111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eed16b-242d-4d10-bacb-d4d340abb91c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:35.572925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eed16b-242d-4d10-bacb-d4d340abb91c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:35.578598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa68c30-1a6d-4b13-bfc7-ed90db33e9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:35.580790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa68c30-1a6d-4b13-bfc7-ed90db33e9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:35.581353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa68c30-1a6d-4b13-bfc7-ed90db33e9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:35.581866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa68c30-1a6d-4b13-bfc7-ed90db33e9a9 admin admin] PATH_INFO: `/v3/projects/aac5d7d6216e42c1bee6f080e8441e23/users/7c6d2bfa3b4749979f48a59a4915e224/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:35.608051 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 895/1789] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:35.610009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eed16b-242d-4d10-bacb-d4d340abb91c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:35.615962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa68c30-1a6d-4b13-bfc7-ed90db33e9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac5d7d6216e42c1bee6f080e8441e23, user_id=7c6d2bfa3b4749979f48a59a4915e224, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:35.620999 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa68c30-1a6d-4b13-bfc7-ed90db33e9a9 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:35.636180 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eed16b-242d-4d10-bacb-d4d340abb91c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:35.660220 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 895/1790] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:35 2022] PUT /identity/v3/projects/aac5d7d6216e42c1bee6f080e8441e23/users/7c6d2bfa3b4749979f48a59a4915e224/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:35.675134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07874fb-860d-4bf5-95ba-78ba3aa75969 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:35.675448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07874fb-860d-4bf5-95ba-78ba3aa75969 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:35.680113 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07874fb-860d-4bf5-95ba-78ba3aa75969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:35.690583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:35.755616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-b07874fb-860d-4bf5-95ba-78ba3aa75969 None None] MFA Rules not processed for user `7c6d2bfa3b4749979f48a59a4915e224`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:35.757422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b07874fb-860d-4bf5-95ba-78ba3aa75969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:35.922458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6af51-05a0-4049-9912-effdc8323521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:35.923288 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6af51-05a0-4049-9912-effdc8323521 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:35.923644 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6af51-05a0-4049-9912-effdc8323521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:35.924021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6af51-05a0-4049-9912-effdc8323521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:35.924827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6af51-05a0-4049-9912-effdc8323521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:35.938528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6af51-05a0-4049-9912-effdc8323521 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:36.014149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 896/1791] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:36.019068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07874fb-860d-4bf5-95ba-78ba3aa75969 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:36.020513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 896/1792] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:35 2022] POST /identity/v3/projects => generated 369 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:36.025706 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6af51-05a0-4049-9912-effdc8323521 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:36.066010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07874fb-860d-4bf5-95ba-78ba3aa75969 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:36.188638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6af51-05a0-4049-9912-effdc8323521 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:36.202402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9b784-f744-4b9c-95aa-049a91bed327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:36.203565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9b784-f744-4b9c-95aa-049a91bed327 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:36.203565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9b784-f744-4b9c-95aa-049a91bed327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:36.203992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9b784-f744-4b9c-95aa-049a91bed327 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:36.204786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9b784-f744-4b9c-95aa-049a91bed327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:36.210699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9b784-f744-4b9c-95aa-049a91bed327 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:36.275105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 897/1793] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:36 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:36.275105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9b784-f744-4b9c-95aa-049a91bed327 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:36.303807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9b784-f744-4b9c-95aa-049a91bed327 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:36.334946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d41ac-33ad-4559-bee5-7ceb1ff8715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:36.337903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d41ac-33ad-4559-bee5-7ceb1ff8715c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:36.338195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d41ac-33ad-4559-bee5-7ceb1ff8715c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:36.338583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d41ac-33ad-4559-bee5-7ceb1ff8715c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:36.339279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d41ac-33ad-4559-bee5-7ceb1ff8715c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:36.349892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d41ac-33ad-4559-bee5-7ceb1ff8715c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:36.386396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0523b-f42d-410e-af01-bcd2395d99de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:36.399430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0523b-f42d-410e-af01-bcd2395d99de admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:36.399791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0523b-f42d-410e-af01-bcd2395d99de admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:36.405380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 898/1794] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:36.406446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d41ac-33ad-4559-bee5-7ceb1ff8715c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:36.410727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0523b-f42d-410e-af01-bcd2395d99de admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:36.411739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0523b-f42d-410e-af01-bcd2395d99de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:36.413770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0523b-f42d-410e-af01-bcd2395d99de admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:36.431796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d41ac-33ad-4559-bee5-7ceb1ff8715c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:36.447070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69058d-cff4-4e61-9776-80d7d54d9725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:36.447768 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69058d-cff4-4e61-9776-80d7d54d9725 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:36.448056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69058d-cff4-4e61-9776-80d7d54d9725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:36.448337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69058d-cff4-4e61-9776-80d7d54d9725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:36.449074 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69058d-cff4-4e61-9776-80d7d54d9725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:36.460099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69058d-cff4-4e61-9776-80d7d54d9725 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:36.505229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 899/1795] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:36.506227 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69058d-cff4-4e61-9776-80d7d54d9725 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:36.510927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 897/1796] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:36 2022] POST /identity/v3/projects => generated 379 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:36.512247 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0523b-f42d-410e-af01-bcd2395d99de admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:36.529942 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69058d-cff4-4e61-9776-80d7d54d9725 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:36.619023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:36.701992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0523b-f42d-410e-af01-bcd2395d99de admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:36.717949 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad49016-9f3b-4f99-b211-8a5c7180313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:36.718982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad49016-9f3b-4f99-b211-8a5c7180313f admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:36.719480 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad49016-9f3b-4f99-b211-8a5c7180313f admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:36.720921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad49016-9f3b-4f99-b211-8a5c7180313f admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:36.721992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad49016-9f3b-4f99-b211-8a5c7180313f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:36.727627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad49016-9f3b-4f99-b211-8a5c7180313f admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:36.773366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b9297-3ceb-42f3-ad80-9b03e99686f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:36.775448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b9297-3ceb-42f3-ad80-9b03e99686f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:36.775846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b9297-3ceb-42f3-ad80-9b03e99686f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:36.777620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b9297-3ceb-42f3-ad80-9b03e99686f7 admin admin] PATH_INFO: `/v3/projects/4a27e8a11c7f42ff8d4dfab4f1d2bc79/users/e10c4530d49241189513d6f4efead648/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:36.797075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 898/1797] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:36 2022] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:36.802052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad49016-9f3b-4f99-b211-8a5c7180313f admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:36.825680 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad49016-9f3b-4f99-b211-8a5c7180313f admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:36.837927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27515ec4-d5c2-4f37-bbaf-83d02fb29177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:36.839080 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27515ec4-d5c2-4f37-bbaf-83d02fb29177 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:36.839751 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27515ec4-d5c2-4f37-bbaf-83d02fb29177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:36.840000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:36.840573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27515ec4-d5c2-4f37-bbaf-83d02fb29177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:36.843850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27515ec4-d5c2-4f37-bbaf-83d02fb29177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:36.850292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27515ec4-d5c2-4f37-bbaf-83d02fb29177 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:36.859341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b9297-3ceb-42f3-ad80-9b03e99686f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a27e8a11c7f42ff8d4dfab4f1d2bc79, user_id=e10c4530d49241189513d6f4efead648, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:36.866425 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b9297-3ceb-42f3-ad80-9b03e99686f7 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:36.886387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 899/1798] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:36.891094 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27515ec4-d5c2-4f37-bbaf-83d02fb29177 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:36.895859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 900/1799] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:36 2022] PUT /identity/v3/projects/4a27e8a11c7f42ff8d4dfab4f1d2bc79/users/e10c4530d49241189513d6f4efead648/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:36.907536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48bd6e-aeb5-4909-8726-7756c7c15120 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:36.907955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48bd6e-aeb5-4909-8726-7756c7c15120 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:36.908260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48bd6e-aeb5-4909-8726-7756c7c15120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:36.918135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27515ec4-d5c2-4f37-bbaf-83d02fb29177 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:37.027810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-4f48bd6e-aeb5-4909-8726-7756c7c15120 None None] MFA Rules not processed for user `e10c4530d49241189513d6f4efead648`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:37.029152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4f48bd6e-aeb5-4909-8726-7756c7c15120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:37.103841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd45fc7-73ca-4fe5-9eeb-f59938ce9183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:37.106611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd45fc7-73ca-4fe5-9eeb-f59938ce9183 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:37.106611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd45fc7-73ca-4fe5-9eeb-f59938ce9183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:37.106611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd45fc7-73ca-4fe5-9eeb-f59938ce9183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:37.108841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd45fc7-73ca-4fe5-9eeb-f59938ce9183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:37.116254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd45fc7-73ca-4fe5-9eeb-f59938ce9183 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:37.146576 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 900/1800] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:37.148479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd45fc7-73ca-4fe5-9eeb-f59938ce9183 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:37.170711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd45fc7-73ca-4fe5-9eeb-f59938ce9183 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:37.184702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f94e05-55a6-4c6a-b7a6-d7c03e1c2a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:37.187717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94e05-55a6-4c6a-b7a6-d7c03e1c2a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:37.188336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94e05-55a6-4c6a-b7a6-d7c03e1c2a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:37.189827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94e05-55a6-4c6a-b7a6-d7c03e1c2a36 admin admin] PATH_INFO: `/v3/projects/6e06635f0cf94c4dab22cf742f0e8a7d/users/5b7fd5fe54744842a0dbe1af97da1ed7/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:37.234676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f94e05-55a6-4c6a-b7a6-d7c03e1c2a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e06635f0cf94c4dab22cf742f0e8a7d, user_id=5b7fd5fe54744842a0dbe1af97da1ed7, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:37.239855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f94e05-55a6-4c6a-b7a6-d7c03e1c2a36 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:37.274165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 901/1801] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:37 2022] PUT /identity/v3/projects/6e06635f0cf94c4dab22cf742f0e8a7d/users/5b7fd5fe54744842a0dbe1af97da1ed7/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:37.284844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f67e56-1500-4f9b-996b-3e0b49c5f0b9 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:37.285402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f67e56-1500-4f9b-996b-3e0b49c5f0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:37.285707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f67e56-1500-4f9b-996b-3e0b49c5f0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:37.317444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 901/1802] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:37.324621 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48bd6e-aeb5-4909-8726-7756c7c15120 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:37.348545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-06f67e56-1500-4f9b-996b-3e0b49c5f0b9 None None] MFA Rules not processed for user `5b7fd5fe54744842a0dbe1af97da1ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:37.349858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-06f67e56-1500-4f9b-996b-3e0b49c5f0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:37.352236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48bd6e-aeb5-4909-8726-7756c7c15120 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:37.616695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 902/1803] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:20:37.618164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f67e56-1500-4f9b-996b-3e0b49c5f0b9 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:37.626915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627006b-6e30-43d9-a71a-99636c7cd0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:37.627684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627006b-6e30-43d9-a71a-99636c7cd0ce admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:37.627950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627006b-6e30-43d9-a71a-99636c7cd0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:37.628224 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627006b-6e30-43d9-a71a-99636c7cd0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:37.629076 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627006b-6e30-43d9-a71a-99636c7cd0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:37.640044 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627006b-6e30-43d9-a71a-99636c7cd0ce admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:37.675852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f67e56-1500-4f9b-996b-3e0b49c5f0b9 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:37.691901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf79b74-d93c-431e-b320-5ab3480c6dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:37.692597 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf79b74-d93c-431e-b320-5ab3480c6dae admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:37.692907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf79b74-d93c-431e-b320-5ab3480c6dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:37.693185 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf79b74-d93c-431e-b320-5ab3480c6dae admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:37.693927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf79b74-d93c-431e-b320-5ab3480c6dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:37.696152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf79b74-d93c-431e-b320-5ab3480c6dae admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:37.754929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 902/1804] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:37 2022] POST /identity/v3/projects => generated 369 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:20:37.755948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627006b-6e30-43d9-a71a-99636c7cd0ce admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:37.759456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:37.833116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 903/1805] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:37 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:37.834881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf79b74-d93c-431e-b320-5ab3480c6dae admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:37.908526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627006b-6e30-43d9-a71a-99636c7cd0ce admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:37.928501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:37.993743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf79b74-d93c-431e-b320-5ab3480c6dae admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:38.009188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d98ce-8412-48df-beed-a87fca89e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:38.009950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d98ce-8412-48df-beed-a87fca89e84b admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:38.010232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d98ce-8412-48df-beed-a87fca89e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:38.010519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d98ce-8412-48df-beed-a87fca89e84b admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:38.011908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d98ce-8412-48df-beed-a87fca89e84b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:38.014090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d98ce-8412-48df-beed-a87fca89e84b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:38.036470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967009a4-d24f-45d8-9203-e32281125c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:38.049098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967009a4-d24f-45d8-9203-e32281125c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:38.049098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967009a4-d24f-45d8-9203-e32281125c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:38.049098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967009a4-d24f-45d8-9203-e32281125c26 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:38.049098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967009a4-d24f-45d8-9203-e32281125c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:38.082778 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967009a4-d24f-45d8-9203-e32281125c26 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:38.101549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 903/1806] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:37 2022] POST /identity/v3/users => generated 291 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:38.105463 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d98ce-8412-48df-beed-a87fca89e84b admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:38.126967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d98ce-8412-48df-beed-a87fca89e84b admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:38.144897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f17aa-84a7-4ec6-aaea-f73b75f3177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:38.146063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f17aa-84a7-4ec6-aaea-f73b75f3177d admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:38.146667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f17aa-84a7-4ec6-aaea-f73b75f3177d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:38.147117 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f17aa-84a7-4ec6-aaea-f73b75f3177d admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:38.148397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f17aa-84a7-4ec6-aaea-f73b75f3177d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:38.151496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f17aa-84a7-4ec6-aaea-f73b75f3177d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:38.169082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 904/1807] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:20:38.171310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 904/1808] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:37 2022] POST /identity/v3/users => generated 295 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:38.176296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f17aa-84a7-4ec6-aaea-f73b75f3177d admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:38.176628 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967009a4-d24f-45d8-9203-e32281125c26 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:38.214340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967009a4-d24f-45d8-9203-e32281125c26 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:38.222720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f17aa-84a7-4ec6-aaea-f73b75f3177d admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:38.236138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e6a9b-98fc-44f4-a7d4-fe1846624c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:38.238924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292b413-5818-4390-bd1a-a0f422efc418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:38.239983 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292b413-5818-4390-bd1a-a0f422efc418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:38.240838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e6a9b-98fc-44f4-a7d4-fe1846624c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:38.241138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e6a9b-98fc-44f4-a7d4-fe1846624c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:38.241337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292b413-5818-4390-bd1a-a0f422efc418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:38.241436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e6a9b-98fc-44f4-a7d4-fe1846624c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:38.242308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e6a9b-98fc-44f4-a7d4-fe1846624c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:38.244092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292b413-5818-4390-bd1a-a0f422efc418 admin admin] PATH_INFO: `/v3/projects/e53ced8ad7174327ba269343d44fd658/users/09b44442310a4305ae471dfa7aaf948e/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:38.244223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e6a9b-98fc-44f4-a7d4-fe1846624c96 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:38.287331 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 905/1809] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:38.290321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e6a9b-98fc-44f4-a7d4-fe1846624c96 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:38.293127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292b413-5818-4390-bd1a-a0f422efc418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e53ced8ad7174327ba269343d44fd658, user_id=09b44442310a4305ae471dfa7aaf948e, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:38.302052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292b413-5818-4390-bd1a-a0f422efc418 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:38.337377 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 905/1810] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:38 2022] PUT /identity/v3/projects/e53ced8ad7174327ba269343d44fd658/users/09b44442310a4305ae471dfa7aaf948e/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:38.338085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e6a9b-98fc-44f4-a7d4-fe1846624c96 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:38.339483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292b413-5818-4390-bd1a-a0f422efc418 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:38.514542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292b413-5818-4390-bd1a-a0f422efc418 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:38.537433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cbbfd-5bb2-4a69-935a-f1bbf57b521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:38.538405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cbbfd-5bb2-4a69-935a-f1bbf57b521d admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:38.539015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cbbfd-5bb2-4a69-935a-f1bbf57b521d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:38.539108 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cbbfd-5bb2-4a69-935a-f1bbf57b521d admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:38.540516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cbbfd-5bb2-4a69-935a-f1bbf57b521d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:38.553133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cbbfd-5bb2-4a69-935a-f1bbf57b521d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:38.584344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 906/1811] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:38.585638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cbbfd-5bb2-4a69-935a-f1bbf57b521d admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:38.590822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d27cbbfd-5bb2-4a69-935a-f1bbf57b521d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:38.620863 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacb0ef-db0e-4536-a4c7-7415be32b38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:38.622988 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacb0ef-db0e-4536-a4c7-7415be32b38d admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:38.623271 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacb0ef-db0e-4536-a4c7-7415be32b38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:38.623549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacb0ef-db0e-4536-a4c7-7415be32b38d admin admin] PATH_INFO: `/v3/projects/74acc6dfb6ee4ba0900974f80c1082f7/users/9a626c7d2a934ee69b6b4790a50d49f5/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:38.642407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cbbfd-5bb2-4a69-935a-f1bbf57b521d admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:38.666260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:38.668291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:38.669347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:38.669667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] PATH_INFO: `/v3/projects/044ac939568b4b22afb5d1a16c731280` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:38.671166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=044ac939568b4b22afb5d1a16c731280)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:38.673819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:38.839287 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044ac939568b4b22afb5d1a16c731280', 'request_id': 'req-1c63365a-e552-40da-b101-fdf3d87f8681'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:38.865532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044ac939568b4b22afb5d1a16c731280', 'request_id': 'req-1c63365a-e552-40da-b101-fdf3d87f8681'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:38.871055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:38.890527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044ac939568b4b22afb5d1a16c731280', 'request_id': 'req-1c63365a-e552-40da-b101-fdf3d87f8681'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:38.949579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] The token cache is being invalidate because project 044ac939568b4b22afb5d1a16c731280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:38.950595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:38.952153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:38.956237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 907/1812] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:38 2022] DELETE /identity/v3/projects/044ac939568b4b22afb5d1a16c731280 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:38.958619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:38.967225 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:39.010495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccacb0ef-db0e-4536-a4c7-7415be32b38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74acc6dfb6ee4ba0900974f80c1082f7, user_id=9a626c7d2a934ee69b6b4790a50d49f5, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:39.013551 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccacb0ef-db0e-4536-a4c7-7415be32b38d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:39.047143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 906/1813] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:38 2022] PUT /identity/v3/projects/74acc6dfb6ee4ba0900974f80c1082f7/users/9a626c7d2a934ee69b6b4790a50d49f5/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:39.047143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b083348-213f-4df5-8ef3-4b5c2f408356 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:39.047143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b083348-213f-4df5-8ef3-4b5c2f408356 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:39.047143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b083348-213f-4df5-8ef3-4b5c2f408356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:39.097552 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-4b083348-213f-4df5-8ef3-4b5c2f408356 None None] MFA Rules not processed for user `4d0c6b46b5d248e5bed2b1bbdfa74f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:39.099110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-4b083348-213f-4df5-8ef3-4b5c2f408356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:39.227692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63365a-e552-40da-b101-fdf3d87f8681 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:39.232633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 907/1814] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Jul 7 07:20:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:39.234164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21976b-7f99-4f7c-a8bd-21d386eada46 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:39.234553 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21976b-7f99-4f7c-a8bd-21d386eada46 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:39.234834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21976b-7f99-4f7c-a8bd-21d386eada46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:39.261918 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:39.284071 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-de21976b-7f99-4f7c-a8bd-21d386eada46 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:39.285700 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-de21976b-7f99-4f7c-a8bd-21d386eada46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:39.365241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25388f-a40c-45b3-80a7-653536e975da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:39.373513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25388f-a40c-45b3-80a7-653536e975da admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:39.374064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25388f-a40c-45b3-80a7-653536e975da admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:39.375318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25388f-a40c-45b3-80a7-653536e975da admin admin] PATH_INFO: `/v3/projects/e53ced8ad7174327ba269343d44fd658/users/09b44442310a4305ae471dfa7aaf948e/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:39.385444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25388f-a40c-45b3-80a7-653536e975da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e53ced8ad7174327ba269343d44fd658, user_id=09b44442310a4305ae471dfa7aaf948e, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:39.402321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 908/1815] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:39.403557 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25388f-a40c-45b3-80a7-653536e975da admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:39.403681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21976b-7f99-4f7c-a8bd-21d386eada46 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:39.413152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-de21976b-7f99-4f7c-a8bd-21d386eada46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:39.430034 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21976b-7f99-4f7c-a8bd-21d386eada46 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:39.439553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 908/1816] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:38 2022] PUT /identity/v3/projects/e53ced8ad7174327ba269343d44fd658/users/09b44442310a4305ae471dfa7aaf948e/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:39.454545 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370af6f-8cd5-41db-bbba-d428b45f4847 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:39.456759 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370af6f-8cd5-41db-bbba-d428b45f4847 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:39.458274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370af6f-8cd5-41db-bbba-d428b45f4847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:39.521099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-f370af6f-8cd5-41db-bbba-d428b45f4847 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:39.522823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f370af6f-8cd5-41db-bbba-d428b45f4847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:39.606895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7caf09-639f-4447-bd4c-80a8de826e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:39.607698 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7caf09-639f-4447-bd4c-80a8de826e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:39.611686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7caf09-639f-4447-bd4c-80a8de826e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:39.612048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7caf09-639f-4447-bd4c-80a8de826e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:39.612858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7caf09-639f-4447-bd4c-80a8de826e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:39.614701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7caf09-639f-4447-bd4c-80a8de826e32 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:39.658954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 909/1817] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:39.660624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e1242-fec2-4ed2-981b-57d7030dc198 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:39.660926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e1242-fec2-4ed2-981b-57d7030dc198 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:39.663860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e1242-fec2-4ed2-981b-57d7030dc198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:39.708290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 909/1818] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:39.713845 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370af6f-8cd5-41db-bbba-d428b45f4847 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:39.730572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f370af6f-8cd5-41db-bbba-d428b45f4847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:39.742180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-892e1242-fec2-4ed2-981b-57d7030dc198 None None] MFA Rules not processed for user `09b44442310a4305ae471dfa7aaf948e`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:39.746056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-892e1242-fec2-4ed2-981b-57d7030dc198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:39.835993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:39.943865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370af6f-8cd5-41db-bbba-d428b45f4847 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:39.964435 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e022f6-6ead-43b8-8f7f-db2349604e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:39.967623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e022f6-6ead-43b8-8f7f-db2349604e25 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:39.967941 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e022f6-6ead-43b8-8f7f-db2349604e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:39.971031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e022f6-6ead-43b8-8f7f-db2349604e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:39.988336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 910/1819] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:39.988336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e1242-fec2-4ed2-981b-57d7030dc198 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:40.006822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e022f6-6ead-43b8-8f7f-db2349604e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:40.008973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e022f6-6ead-43b8-8f7f-db2349604e25 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:40.027573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e1242-fec2-4ed2-981b-57d7030dc198 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:40.036577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c7e09-5ce7-417f-9eec-f051d7fa4239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:40.044905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c7e09-5ce7-417f-9eec-f051d7fa4239 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:40.045251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c7e09-5ce7-417f-9eec-f051d7fa4239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:40.045557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c7e09-5ce7-417f-9eec-f051d7fa4239 admin admin] PATH_INFO: `/v3/projects/74acc6dfb6ee4ba0900974f80c1082f7/users/9a626c7d2a934ee69b6b4790a50d49f5/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:40.060323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c7e09-5ce7-417f-9eec-f051d7fa4239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74acc6dfb6ee4ba0900974f80c1082f7, user_id=9a626c7d2a934ee69b6b4790a50d49f5, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:40.063455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c7e09-5ce7-417f-9eec-f051d7fa4239 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:40.069113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 910/1820] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:40.076013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e022f6-6ead-43b8-8f7f-db2349604e25 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:40.095058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 911/1821] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:39 2022] PUT /identity/v3/projects/74acc6dfb6ee4ba0900974f80c1082f7/users/9a626c7d2a934ee69b6b4790a50d49f5/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:40.096075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c7e09-5ce7-417f-9eec-f051d7fa4239 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:40.106923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3e6c7e09-5ce7-417f-9eec-f051d7fa4239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:40.116254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e022f6-6ead-43b8-8f7f-db2349604e25 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:40.155073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:40.319310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c7e09-5ce7-417f-9eec-f051d7fa4239 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:40.326184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146ce8a-a4b1-486c-ba95-d080df235216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:40.327175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146ce8a-a4b1-486c-ba95-d080df235216 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:40.327562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146ce8a-a4b1-486c-ba95-d080df235216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:40.330444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146ce8a-a4b1-486c-ba95-d080df235216 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:40.331392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146ce8a-a4b1-486c-ba95-d080df235216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:40.331813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146ce8a-a4b1-486c-ba95-d080df235216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:40.332906 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662497ee-679f-4f2e-a447-86216756d2a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:40.333827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662497ee-679f-4f2e-a447-86216756d2a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:40.334279 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662497ee-679f-4f2e-a447-86216756d2a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:40.334729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662497ee-679f-4f2e-a447-86216756d2a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:40.338761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146ce8a-a4b1-486c-ba95-d080df235216 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:40.377597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 911/1822] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:40.380097 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1749523-9c4e-43e8-b57d-4f18ab8a238a None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:40.381114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1749523-9c4e-43e8-b57d-4f18ab8a238a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:40.381529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1749523-9c4e-43e8-b57d-4f18ab8a238a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:40.465134 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a1749523-9c4e-43e8-b57d-4f18ab8a238a None None] MFA Rules not processed for user `9a626c7d2a934ee69b6b4790a50d49f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:40.466984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a1749523-9c4e-43e8-b57d-4f18ab8a238a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:40.499192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662497ee-679f-4f2e-a447-86216756d2a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:40.506084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662497ee-679f-4f2e-a447-86216756d2a5 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:40.531531 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 912/1823] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:40 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:40.532505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662497ee-679f-4f2e-a447-86216756d2a5 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:40.730550 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662497ee-679f-4f2e-a447-86216756d2a5 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:40.748701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636be82-76c2-4b3d-93b5-bbf8d90b4e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:40.756019 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636be82-76c2-4b3d-93b5-bbf8d90b4e5a service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:40.756462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636be82-76c2-4b3d-93b5-bbf8d90b4e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:40.756853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636be82-76c2-4b3d-93b5-bbf8d90b4e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:40.791274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636be82-76c2-4b3d-93b5-bbf8d90b4e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:40.793066 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636be82-76c2-4b3d-93b5-bbf8d90b4e5a service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:40.843572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 912/1824] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:40.845083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1749523-9c4e-43e8-b57d-4f18ab8a238a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:40.858346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 913/1825] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:40.898496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1749523-9c4e-43e8-b57d-4f18ab8a238a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:40.929111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2a050-78bb-42b5-a452-b5091d838942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:40.930074 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2a050-78bb-42b5-a452-b5091d838942 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:40.930323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2a050-78bb-42b5-a452-b5091d838942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:40.930795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2a050-78bb-42b5-a452-b5091d838942 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:40.932116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2a050-78bb-42b5-a452-b5091d838942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:40.967080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2a050-78bb-42b5-a452-b5091d838942 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:40.986615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636be82-76c2-4b3d-93b5-bbf8d90b4e5a service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:40.998566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636be82-76c2-4b3d-93b5-bbf8d90b4e5a service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:41.032384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 913/1826] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:40 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:41.036196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff77b57-cb70-4e3e-a62b-d32cc0e83e4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:41.037158 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff77b57-cb70-4e3e-a62b-d32cc0e83e4e service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:41.037395 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2a050-78bb-42b5-a452-b5091d838942 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:41.037744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff77b57-cb70-4e3e-a62b-d32cc0e83e4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:41.038179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff77b57-cb70-4e3e-a62b-d32cc0e83e4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:41.053448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff77b57-cb70-4e3e-a62b-d32cc0e83e4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:41.065939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff77b57-cb70-4e3e-a62b-d32cc0e83e4e service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:41.103004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 914/1827] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:20:41.131017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:41.279957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2a050-78bb-42b5-a452-b5091d838942 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:41.303175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8a31f-4833-4fa7-8ca4-9e71f72b31a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:41.304056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8a31f-4833-4fa7-8ca4-9e71f72b31a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:41.304248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8a31f-4833-4fa7-8ca4-9e71f72b31a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:41.304414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8a31f-4833-4fa7-8ca4-9e71f72b31a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:41.305126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8a31f-4833-4fa7-8ca4-9e71f72b31a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:41.316453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8a31f-4833-4fa7-8ca4-9e71f72b31a0 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:41.365921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff77b57-cb70-4e3e-a62b-d32cc0e83e4e service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:41.377786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 914/1828] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:41 2022] POST /identity/v3/users => generated 292 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:41.379100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff77b57-cb70-4e3e-a62b-d32cc0e83e4e service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:41.383491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8a31f-4833-4fa7-8ca4-9e71f72b31a0 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:41.402481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8a31f-4833-4fa7-8ca4-9e71f72b31a0 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:41.432501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6f4c0-414a-4821-b1fc-9b739ac38c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:41.433234 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6f4c0-414a-4821-b1fc-9b739ac38c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:41.433590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6f4c0-414a-4821-b1fc-9b739ac38c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:41.434031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6f4c0-414a-4821-b1fc-9b739ac38c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:41.434799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6f4c0-414a-4821-b1fc-9b739ac38c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:41.436664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6f4c0-414a-4821-b1fc-9b739ac38c6c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:41.474797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 915/1829] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:20:41.481520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6f4c0-414a-4821-b1fc-9b739ac38c6c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:41.502316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6f4c0-414a-4821-b1fc-9b739ac38c6c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:41.519474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf327d-968b-481d-aba4-62cf755dd030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:41.520192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf327d-968b-481d-aba4-62cf755dd030 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:41.520450 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf327d-968b-481d-aba4-62cf755dd030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:41.520723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf327d-968b-481d-aba4-62cf755dd030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:41.521495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf327d-968b-481d-aba4-62cf755dd030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:41.523185 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf327d-968b-481d-aba4-62cf755dd030 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:41.556885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 916/1830] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:41.562036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf327d-968b-481d-aba4-62cf755dd030 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:41.580366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf327d-968b-481d-aba4-62cf755dd030 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:41.597403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1e2c0-8d06-41b5-9c01-434e54f031ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:41.598521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1e2c0-8d06-41b5-9c01-434e54f031ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:41.598813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1e2c0-8d06-41b5-9c01-434e54f031ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:41.599283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1e2c0-8d06-41b5-9c01-434e54f031ff admin admin] PATH_INFO: `/v3/projects/91d6a86d2f6e4846aa5d6c2f7b674d19/users/a28940b83aed4c4e81971e7fcc16eb24/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:41.652715 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1e2c0-8d06-41b5-9c01-434e54f031ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d6a86d2f6e4846aa5d6c2f7b674d19, user_id=a28940b83aed4c4e81971e7fcc16eb24, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:41.655643 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1e2c0-8d06-41b5-9c01-434e54f031ff admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:41.672858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d91359-205d-4951-b74f-85c440d9a418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:41.674209 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d91359-205d-4951-b74f-85c440d9a418 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:41.678023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d91359-205d-4951-b74f-85c440d9a418 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:41.679400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d91359-205d-4951-b74f-85c440d9a418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:41.685123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-60d91359-205d-4951-b74f-85c440d9a418 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:41.688993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 917/1831] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:41 2022] PUT /identity/v3/projects/91d6a86d2f6e4846aa5d6c2f7b674d19/users/a28940b83aed4c4e81971e7fcc16eb24/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:41.714588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54c672-dd87-40b2-82d9-00a23f563190 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:41.715145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54c672-dd87-40b2-82d9-00a23f563190 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:41.715426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54c672-dd87-40b2-82d9-00a23f563190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:41.721842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:41.775439 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1d54c672-dd87-40b2-82d9-00a23f563190 None None] MFA Rules not processed for user `a28940b83aed4c4e81971e7fcc16eb24`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:41.788255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1d54c672-dd87-40b2-82d9-00a23f563190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:42.050122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d91359-205d-4951-b74f-85c440d9a418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:42.061011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d91359-205d-4951-b74f-85c440d9a418 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:42.188363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 915/1832] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 822 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:20:42.201542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 918/1833] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:20:42.205810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d91359-205d-4951-b74f-85c440d9a418 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:42.286226 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d91359-205d-4951-b74f-85c440d9a418 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:42.557212 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62bde3-de8e-419b-b398-e0d5920184ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:42.558136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62bde3-de8e-419b-b398-e0d5920184ec admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:42.558623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62bde3-de8e-419b-b398-e0d5920184ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:42.559179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62bde3-de8e-419b-b398-e0d5920184ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:42.560040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62bde3-de8e-419b-b398-e0d5920184ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:42.563686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62bde3-de8e-419b-b398-e0d5920184ec admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:42.667914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 916/1834] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:42 2022] POST /identity/v3/projects => generated 381 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:42.668018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54c672-dd87-40b2-82d9-00a23f563190 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:42.695059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54c672-dd87-40b2-82d9-00a23f563190 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:42.968795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecd9e7-9531-463b-a574-a0370665c01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:42.981513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecd9e7-9531-463b-a574-a0370665c01e admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:42.981513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecd9e7-9531-463b-a574-a0370665c01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:42.981513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecd9e7-9531-463b-a574-a0370665c01e admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:42.981513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecd9e7-9531-463b-a574-a0370665c01e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:42.981513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecd9e7-9531-463b-a574-a0370665c01e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:43.018090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:43.045613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62bde3-de8e-419b-b398-e0d5920184ec admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:43.059596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 919/1835] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:42 2022] POST /identity/v3/users => generated 297 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:43.061605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62bde3-de8e-419b-b398-e0d5920184ec admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:43.089957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21232c-6a10-4a89-9acc-1c8938651511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:43.090657 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21232c-6a10-4a89-9acc-1c8938651511 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:43.090940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21232c-6a10-4a89-9acc-1c8938651511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:43.091217 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21232c-6a10-4a89-9acc-1c8938651511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:43.091985 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21232c-6a10-4a89-9acc-1c8938651511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:43.093679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21232c-6a10-4a89-9acc-1c8938651511 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:43.159009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 917/1836] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:43.164551 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecd9e7-9531-463b-a574-a0370665c01e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:43.185304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecd9e7-9531-463b-a574-a0370665c01e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:43.204052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b44e4-3050-4487-8907-ad1680028971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:43.205135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b44e4-3050-4487-8907-ad1680028971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:43.219294 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b44e4-3050-4487-8907-ad1680028971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:43.219615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b44e4-3050-4487-8907-ad1680028971 admin admin] PATH_INFO: `/v3/projects/234618e1d91549b59771d88344037b1f/users/d299299775a247739b69e7a23d9a3392/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:43.284199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b44e4-3050-4487-8907-ad1680028971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=234618e1d91549b59771d88344037b1f, user_id=d299299775a247739b69e7a23d9a3392, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:43.287791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b44e4-3050-4487-8907-ad1680028971 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:43.334759 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 920/1837] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:43 2022] PUT /identity/v3/projects/234618e1d91549b59771d88344037b1f/users/d299299775a247739b69e7a23d9a3392/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:43.339181 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21232c-6a10-4a89-9acc-1c8938651511 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:43.353468 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21232c-6a10-4a89-9acc-1c8938651511 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:43.646010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c819b-a241-4149-9eec-a5accd3eff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:43.646721 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c819b-a241-4149-9eec-a5accd3eff01 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:43.647008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c819b-a241-4149-9eec-a5accd3eff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:43.647293 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c819b-a241-4149-9eec-a5accd3eff01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:43.650000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c819b-a241-4149-9eec-a5accd3eff01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:43.658552 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c819b-a241-4149-9eec-a5accd3eff01 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:43.730959 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b44e4-3050-4487-8907-ad1680028971 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:43.740052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 918/1838] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:43.753348 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b44e4-3050-4487-8907-ad1680028971 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:43.783375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff9945-09f5-4094-8cf3-25a3dc91e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:43.784314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff9945-09f5-4094-8cf3-25a3dc91e202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:43.784596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff9945-09f5-4094-8cf3-25a3dc91e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:43.784889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff9945-09f5-4094-8cf3-25a3dc91e202 admin admin] PATH_INFO: `/v3/projects/234618e1d91549b59771d88344037b1f/users/d299299775a247739b69e7a23d9a3392/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:43.792543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff9945-09f5-4094-8cf3-25a3dc91e202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=234618e1d91549b59771d88344037b1f, user_id=d299299775a247739b69e7a23d9a3392, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:43.801685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff9945-09f5-4094-8cf3-25a3dc91e202 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:43.869721 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 921/1839] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:43 2022] PUT /identity/v3/projects/234618e1d91549b59771d88344037b1f/users/d299299775a247739b69e7a23d9a3392/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:43.871254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8e85-6a07-4082-9bbc-e7462306c90e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:43.871423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8e85-6a07-4082-9bbc-e7462306c90e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:43.871872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf8e85-6a07-4082-9bbc-e7462306c90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:43.925688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff9945-09f5-4094-8cf3-25a3dc91e202 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:43.927498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ccff9945-09f5-4094-8cf3-25a3dc91e202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:43.967872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-feaf8e85-6a07-4082-9bbc-e7462306c90e None None] MFA Rules not processed for user `d299299775a247739b69e7a23d9a3392`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:43.969180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-feaf8e85-6a07-4082-9bbc-e7462306c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:43.991728 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:44.246705 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff9945-09f5-4094-8cf3-25a3dc91e202 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:44.252304 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 919/1840] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:44.286621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf8e85-6a07-4082-9bbc-e7462306c90e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:44.287056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:44.288194 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-feaf8e85-6a07-4082-9bbc-e7462306c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:44.289485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:44.289991 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:44.290303 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] PATH_INFO: `/v3/users/cb17b3997e1947d2817b80d37c842403` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:44.296358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb17b3997e1947d2817b80d37c842403)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:44.298707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:44.495998 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb17b3997e1947d2817b80d37c842403'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:44.498095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb17b3997e1947d2817b80d37c842403'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:44.499555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb17b3997e1947d2817b80d37c842403'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:44.514876 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf8e85-6a07-4082-9bbc-e7462306c90e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:44.522675 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb17b3997e1947d2817b80d37c842403'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:44.528905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870aac78-9e8e-45a1-ac51-cbb173ee1310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:44.530440 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aac78-9e8e-45a1-ac51-cbb173ee1310 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:44.530961 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aac78-9e8e-45a1-ac51-cbb173ee1310 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:44.531824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aac78-9e8e-45a1-ac51-cbb173ee1310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:44.535545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-870aac78-9e8e-45a1-ac51-cbb173ee1310 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:44.544292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb17b3997e1947d2817b80d37c842403'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:44.555559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870aac78-9e8e-45a1-ac51-cbb173ee1310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:44.562185 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870aac78-9e8e-45a1-ac51-cbb173ee1310 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:44.604715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 920/1841] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:44.611466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 922/1842] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:43 2022] DELETE /identity/v3/users/cb17b3997e1947d2817b80d37c842403 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:44.616307 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31e515-aba7-400f-a0c0-e350c058539c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:44.616804 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31e515-aba7-400f-a0c0-e350c058539c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:44.617251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31e515-aba7-400f-a0c0-e350c058539c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:44.683979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-bd31e515-aba7-400f-a0c0-e350c058539c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:44.695423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-bd31e515-aba7-400f-a0c0-e350c058539c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:44.906156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:44.908189 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:44.913395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 921/1843] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:45.046841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31e515-aba7-400f-a0c0-e350c058539c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:45.049063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-bd31e515-aba7-400f-a0c0-e350c058539c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:45.064131 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:45.127468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c3605-873b-49c7-be50-89d4a86c62bb admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:45.148572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946483c9-206f-4385-8e09-0c1389bd750e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:45.149542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946483c9-206f-4385-8e09-0c1389bd750e service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:45.149990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946483c9-206f-4385-8e09-0c1389bd750e service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:45.150417 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946483c9-206f-4385-8e09-0c1389bd750e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:45.155899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-946483c9-206f-4385-8e09-0c1389bd750e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:45.157045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:45.193606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31e515-aba7-400f-a0c0-e350c058539c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:45.230906 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e65f28-fb5a-44fd-830b-ae674a7af9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:45.233158 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e65f28-fb5a-44fd-830b-ae674a7af9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:45.234752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e65f28-fb5a-44fd-830b-ae674a7af9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:45.236090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e65f28-fb5a-44fd-830b-ae674a7af9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:45.272227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e65f28-fb5a-44fd-830b-ae674a7af9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:45.289807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e65f28-fb5a-44fd-830b-ae674a7af9c2 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:45.294618 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946483c9-206f-4385-8e09-0c1389bd750e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:45.298015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946483c9-206f-4385-8e09-0c1389bd750e service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:45.320072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 923/1844] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:20:45.373428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 922/1845] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:20:46.222904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946483c9-206f-4385-8e09-0c1389bd750e service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:46.225236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-946483c9-206f-4385-8e09-0c1389bd750e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:46.262343 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946483c9-206f-4385-8e09-0c1389bd750e service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:46.274920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d4a46-bb33-416a-85fe-b61821208cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:46.275825 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d4a46-bb33-416a-85fe-b61821208cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:46.276114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d4a46-bb33-416a-85fe-b61821208cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:46.276393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d4a46-bb33-416a-85fe-b61821208cc5 admin admin] PATH_INFO: `/v3/users/a28940b83aed4c4e81971e7fcc16eb24` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:46.277738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d4a46-bb33-416a-85fe-b61821208cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a28940b83aed4c4e81971e7fcc16eb24)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:46.282009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d4a46-bb33-416a-85fe-b61821208cc5 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:46.297081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e65f28-fb5a-44fd-830b-ae674a7af9c2 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:46.299505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a2e65f28-fb5a-44fd-830b-ae674a7af9c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:46.359075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e65f28-fb5a-44fd-830b-ae674a7af9c2 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:46.386445 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1b97f-e5b7-4c41-a630-888383c570a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:46.387324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1b97f-e5b7-4c41-a630-888383c570a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:46.387610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1b97f-e5b7-4c41-a630-888383c570a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:46.387911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1b97f-e5b7-4c41-a630-888383c570a2 admin admin] PATH_INFO: `/v3/users/e10c4530d49241189513d6f4efead648` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:46.394227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1b97f-e5b7-4c41-a630-888383c570a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10c4530d49241189513d6f4efead648)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:46.396235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1b97f-e5b7-4c41-a630-888383c570a2 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:46.466223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d00d4a46-bb33-416a-85fe-b61821208cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a28940b83aed4c4e81971e7fcc16eb24'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:46.468527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d00d4a46-bb33-416a-85fe-b61821208cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a28940b83aed4c4e81971e7fcc16eb24'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:46.470485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d00d4a46-bb33-416a-85fe-b61821208cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a28940b83aed4c4e81971e7fcc16eb24'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:46.497403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d00d4a46-bb33-416a-85fe-b61821208cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a28940b83aed4c4e81971e7fcc16eb24'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:46.515266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d00d4a46-bb33-416a-85fe-b61821208cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a28940b83aed4c4e81971e7fcc16eb24'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:46.573115 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 924/1846] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:46 2022] DELETE /identity/v3/users/a28940b83aed4c4e81971e7fcc16eb24 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:46.575188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8207dd1-78e7-4a14-8579-4c358ee12b34 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:46.575645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8207dd1-78e7-4a14-8579-4c358ee12b34 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:46.576145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8207dd1-78e7-4a14-8579-4c358ee12b34 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:46.580731 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 925/1847] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:20:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:20:46.582615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556bd19-0734-4303-b3e9-0d988ef27a21 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:46.587497 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556bd19-0734-4303-b3e9-0d988ef27a21 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:46.588232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556bd19-0734-4303-b3e9-0d988ef27a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:46.619873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0556bd19-0734-4303-b3e9-0d988ef27a21 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:46.621576 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0556bd19-0734-4303-b3e9-0d988ef27a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:46.635614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-9ff1b97f-e5b7-4c41-a630-888383c570a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10c4530d49241189513d6f4efead648'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:46.636359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-9ff1b97f-e5b7-4c41-a630-888383c570a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10c4530d49241189513d6f4efead648'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:46.637398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-9ff1b97f-e5b7-4c41-a630-888383c570a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10c4530d49241189513d6f4efead648'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:46.673962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-9ff1b97f-e5b7-4c41-a630-888383c570a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10c4530d49241189513d6f4efead648'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:46.687580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-9ff1b97f-e5b7-4c41-a630-888383c570a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10c4530d49241189513d6f4efead648'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:46.709184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:46.731608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 926/1848] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:46.733383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474270f4-29c9-4b1b-a0d1-a6fb66fc4b4a None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:46.733843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474270f4-29c9-4b1b-a0d1-a6fb66fc4b4a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:46.734290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474270f4-29c9-4b1b-a0d1-a6fb66fc4b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:46.777488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 923/1849] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:46 2022] DELETE /identity/v3/users/e10c4530d49241189513d6f4efead648 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:46.784504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253685e5-4b73-42a1-858c-cce226d219c0 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:46.784719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253685e5-4b73-42a1-858c-cce226d219c0 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:46.790929 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253685e5-4b73-42a1-858c-cce226d219c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:46.794250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-474270f4-29c9-4b1b-a0d1-a6fb66fc4b4a None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:46.811232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-474270f4-29c9-4b1b-a0d1-a6fb66fc4b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:46.852121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-253685e5-4b73-42a1-858c-cce226d219c0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:46.855708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-253685e5-4b73-42a1-858c-cce226d219c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:47.076219 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 927/1850] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:20:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:47.077501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474270f4-29c9-4b1b-a0d1-a6fb66fc4b4a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:47.079681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-474270f4-29c9-4b1b-a0d1-a6fb66fc4b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:47.120332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 924/1851] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:47.121085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253685e5-4b73-42a1-858c-cce226d219c0 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:47.123700 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-253685e5-4b73-42a1-858c-cce226d219c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:47.141307 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253685e5-4b73-42a1-858c-cce226d219c0 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:47.151489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:47.153496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:47.170789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:47.171504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] PATH_INFO: `/v3/users/7c6d2bfa3b4749979f48a59a4915e224` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:47.182312 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6d2bfa3b4749979f48a59a4915e224)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:47.194862 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:47.260907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474270f4-29c9-4b1b-a0d1-a6fb66fc4b4a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:47.269507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35d008-94b5-4347-82c1-21c737ddb983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:47.270570 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35d008-94b5-4347-82c1-21c737ddb983 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:47.270570 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35d008-94b5-4347-82c1-21c737ddb983 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:47.270900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35d008-94b5-4347-82c1-21c737ddb983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:47.326530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35d008-94b5-4347-82c1-21c737ddb983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:47.333263 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35d008-94b5-4347-82c1-21c737ddb983 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:47.333836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6d2bfa3b4749979f48a59a4915e224'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:47.334606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6d2bfa3b4749979f48a59a4915e224'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:47.335227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6d2bfa3b4749979f48a59a4915e224'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:47.352522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:47.354702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 928/1852] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:47.378780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6d2bfa3b4749979f48a59a4915e224'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:47.380029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35d008-94b5-4347-82c1-21c737ddb983 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:47.388621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6d2bfa3b4749979f48a59a4915e224'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:47.448505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35d008-94b5-4347-82c1-21c737ddb983 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:47.462127 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 925/1853] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:47 2022] DELETE /identity/v3/users/7c6d2bfa3b4749979f48a59a4915e224 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:47.462331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1d369-b271-437c-bc73-ea8bb9d8f549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:47.473448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1d369-b271-437c-bc73-ea8bb9d8f549 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:47.473448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1d369-b271-437c-bc73-ea8bb9d8f549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:47.473643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:47.473719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1d369-b271-437c-bc73-ea8bb9d8f549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:47.473797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:47.473874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-47a1d369-b271-437c-bc73-ea8bb9d8f549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:47.513450 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1d369-b271-437c-bc73-ea8bb9d8f549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:47.515393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1d369-b271-437c-bc73-ea8bb9d8f549 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:47.546147 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 929/1854] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:47.554577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da19f6-f7cb-401e-a523-42c308297ec2 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:47.555206 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da19f6-f7cb-401e-a523-42c308297ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:47.558861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da19f6-f7cb-401e-a523-42c308297ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:47.597068 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-58da19f6-f7cb-401e-a523-42c308297ec2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:47.598890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-58da19f6-f7cb-401e-a523-42c308297ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:47.693204 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 930/1855] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:47.710319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a77ac1-53aa-4bb1-9372-4047fbcf7502 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:47.727402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffb23f-1aa7-4b6c-8415-a4fca7b079df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:47.728092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffb23f-1aa7-4b6c-8415-a4fca7b079df service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:47.728377 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffb23f-1aa7-4b6c-8415-a4fca7b079df service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:47.728660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffb23f-1aa7-4b6c-8415-a4fca7b079df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:47.730926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9dffb23f-1aa7-4b6c-8415-a4fca7b079df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:47.764819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffb23f-1aa7-4b6c-8415-a4fca7b079df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:47.766579 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffb23f-1aa7-4b6c-8415-a4fca7b079df service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:47.796649 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 926/1856] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:47.796800 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da19f6-f7cb-401e-a523-42c308297ec2 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:47.798165 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-58da19f6-f7cb-401e-a523-42c308297ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:47.870479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da19f6-f7cb-401e-a523-42c308297ec2 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:47.909577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:47.910849 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:47.911337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:47.911810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d admin admin] PATH_INFO: `/v3/projects/bbe45712a28c4cdc9bfe43e0df83dc5f` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:47.920648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffb23f-1aa7-4b6c-8415-a4fca7b079df service nova] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:47.922561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9dffb23f-1aa7-4b6c-8415-a4fca7b079df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:47.923248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe45712a28c4cdc9bfe43e0df83dc5f)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:47.925522 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:48.014200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:48.049741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffb23f-1aa7-4b6c-8415-a4fca7b079df service nova] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:48.064355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b26cb-90e4-4757-98e2-59edec0881bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:48.065246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b26cb-90e4-4757-98e2-59edec0881bd service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:48.065595 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b26cb-90e4-4757-98e2-59edec0881bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:48.065962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b26cb-90e4-4757-98e2-59edec0881bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:48.094580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b26cb-90e4-4757-98e2-59edec0881bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:48.096148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b26cb-90e4-4757-98e2-59edec0881bd service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:48.111612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe45712a28c4cdc9bfe43e0df83dc5f', 'request_id': 'req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:48.122873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe45712a28c4cdc9bfe43e0df83dc5f', 'request_id': 'req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:48.123066 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 927/1857] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:20:48.131104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe45712a28c4cdc9bfe43e0df83dc5f', 'request_id': 'req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:48.151405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d admin admin] The token cache is being invalidate because project bbe45712a28c4cdc9bfe43e0df83dc5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:48.151714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:48.153986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0dc4d794-c5a3-42f2-92c2-ce18ee2dbe7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:48.157667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 931/1858] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:47 2022] DELETE /identity/v3/projects/bbe45712a28c4cdc9bfe43e0df83dc5f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:20:48.161619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b26cb-90e4-4757-98e2-59edec0881bd service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:48.171994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b26cb-90e4-4757-98e2-59edec0881bd service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:48.329584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46f70f-f68d-4a42-8ee6-15afac53aa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:48.330926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46f70f-f68d-4a42-8ee6-15afac53aa3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:48.331215 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46f70f-f68d-4a42-8ee6-15afac53aa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:48.331587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46f70f-f68d-4a42-8ee6-15afac53aa3d admin admin] PATH_INFO: `/v3/users/6b9ee0c21e2f424d93ad76a3747caddc` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:48.332984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46f70f-f68d-4a42-8ee6-15afac53aa3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9ee0c21e2f424d93ad76a3747caddc)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:48.336214 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46f70f-f68d-4a42-8ee6-15afac53aa3d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:48.338032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:48.511863 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1c46f70f-f68d-4a42-8ee6-15afac53aa3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9ee0c21e2f424d93ad76a3747caddc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:48.513729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1c46f70f-f68d-4a42-8ee6-15afac53aa3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9ee0c21e2f424d93ad76a3747caddc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:48.516501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1c46f70f-f68d-4a42-8ee6-15afac53aa3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9ee0c21e2f424d93ad76a3747caddc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:48.538716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1c46f70f-f68d-4a42-8ee6-15afac53aa3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9ee0c21e2f424d93ad76a3747caddc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:48.560073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1c46f70f-f68d-4a42-8ee6-15afac53aa3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9ee0c21e2f424d93ad76a3747caddc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:48.604306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 928/1859] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:48 2022] DELETE /identity/v3/users/6b9ee0c21e2f424d93ad76a3747caddc => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:48.986844 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b3dc-19aa-4b8d-a85a-ad29f99babe2 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:48.987396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b3dc-19aa-4b8d-a85a-ad29f99babe2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:48.987396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b3dc-19aa-4b8d-a85a-ad29f99babe2 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:48.989252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 932/1860] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:20:49.019433 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a693cf-9a2e-4fe5-8cbd-a5e519285b33 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:49.020071 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a693cf-9a2e-4fe5-8cbd-a5e519285b33 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:49.020528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a693cf-9a2e-4fe5-8cbd-a5e519285b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:49.055307 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-b6a693cf-9a2e-4fe5-8cbd-a5e519285b33 None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:49.056808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b6a693cf-9a2e-4fe5-8cbd-a5e519285b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:49.214223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 929/1861] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:20:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:20:49.386324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b3dc-19aa-4b8d-a85a-ad29f99babe2 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:49.398239 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3813b3dc-19aa-4b8d-a85a-ad29f99babe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:49.439636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b3dc-19aa-4b8d-a85a-ad29f99babe2 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:49.451774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d1f71-9d61-4b25-a399-205d5988cbe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:49.452537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d1f71-9d61-4b25-a399-205d5988cbe0 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:49.452822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d1f71-9d61-4b25-a399-205d5988cbe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:49.453106 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d1f71-9d61-4b25-a399-205d5988cbe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:49.464185 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d1f71-9d61-4b25-a399-205d5988cbe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:49.467475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d1f71-9d61-4b25-a399-205d5988cbe0 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:49.495708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 933/1862] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:49.956854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a693cf-9a2e-4fe5-8cbd-a5e519285b33 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:49.958384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b6a693cf-9a2e-4fe5-8cbd-a5e519285b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:50.044774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d1f71-9d61-4b25-a399-205d5988cbe0 service nova] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:50.048596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ef3d1f71-9d61-4b25-a399-205d5988cbe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:50.117142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a693cf-9a2e-4fe5-8cbd-a5e519285b33 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:50.130610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:50.135142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:50.135142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:50.135142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] PATH_INFO: `/v3/projects/aac5d7d6216e42c1bee6f080e8441e23` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:50.135142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac5d7d6216e42c1bee6f080e8441e23)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:50.138784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:50.170289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:50.209481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d1f71-9d61-4b25-a399-205d5988cbe0 service nova] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:50.223569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac5d7d6216e42c1bee6f080e8441e23', 'request_id': 'req-79f464f8-fca7-4965-ba00-e1f5ef21d949'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.229440 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac5d7d6216e42c1bee6f080e8441e23', 'request_id': 'req-79f464f8-fca7-4965-ba00-e1f5ef21d949'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.237136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac5d7d6216e42c1bee6f080e8441e23', 'request_id': 'req-79f464f8-fca7-4965-ba00-e1f5ef21d949'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.248604 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] The token cache is being invalidate because project aac5d7d6216e42c1bee6f080e8441e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:50.248896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.249670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.251246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 930/1863] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:49 2022] DELETE /identity/v3/projects/aac5d7d6216e42c1bee6f080e8441e23 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:50.252004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:50.253528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:50.268810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:50.269746 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:50.270031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:50.270309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] PATH_INFO: `/v3/projects/77693dcccbc846f58224a39573c863a9` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:50.271611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=77693dcccbc846f58224a39573c863a9)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:50.273592 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:50.321273 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:50.322073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f464f8-fca7-4965-ba00-e1f5ef21d949 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:50.341869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77693dcccbc846f58224a39573c863a9', 'request_id': 'req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.352705 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77693dcccbc846f58224a39573c863a9', 'request_id': 'req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.360851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77693dcccbc846f58224a39573c863a9', 'request_id': 'req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.373782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] The token cache is being invalidate because project 77693dcccbc846f58224a39573c863a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:50.374113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.374967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.376314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 934/1864] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:50 2022] DELETE /identity/v3/projects/77693dcccbc846f58224a39573c863a9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:50.380591 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:50.381992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:50.399977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:50.401247 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:50.402182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:50.402434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] PATH_INFO: `/v3/projects/91d6a86d2f6e4846aa5d6c2f7b674d19` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:50.409728 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d6a86d2f6e4846aa5d6c2f7b674d19)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:50.412095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:50.459276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb768cfe-473d-4e2b-9e59-79fc97a35a1b admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:50.468146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba6234-faa4-48b0-bd93-bbe83aa83779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:50.469446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba6234-faa4-48b0-bd93-bbe83aa83779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:50.469883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba6234-faa4-48b0-bd93-bbe83aa83779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:50.470403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba6234-faa4-48b0-bd93-bbe83aa83779 admin admin] PATH_INFO: `/v3/projects/4a27e8a11c7f42ff8d4dfab4f1d2bc79` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:50.472056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba6234-faa4-48b0-bd93-bbe83aa83779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a27e8a11c7f42ff8d4dfab4f1d2bc79)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:50.474396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba6234-faa4-48b0-bd93-bbe83aa83779 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:50.513091 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d6a86d2f6e4846aa5d6c2f7b674d19', 'request_id': 'req-c5f3335f-e506-42bf-9fce-5c13057d7cc2'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.514616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:50.523302 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d6a86d2f6e4846aa5d6c2f7b674d19', 'request_id': 'req-c5f3335f-e506-42bf-9fce-5c13057d7cc2'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.533788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d6a86d2f6e4846aa5d6c2f7b674d19', 'request_id': 'req-c5f3335f-e506-42bf-9fce-5c13057d7cc2'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.542863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-78ba6234-faa4-48b0-bd93-bbe83aa83779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a27e8a11c7f42ff8d4dfab4f1d2bc79', 'request_id': 'req-78ba6234-faa4-48b0-bd93-bbe83aa83779'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.551402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] The token cache is being invalidate because project 91d6a86d2f6e4846aa5d6c2f7b674d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:50.552306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.552725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.555085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 931/1865] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:50 2022] DELETE /identity/v3/projects/91d6a86d2f6e4846aa5d6c2f7b674d19 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:50.555908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-78ba6234-faa4-48b0-bd93-bbe83aa83779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a27e8a11c7f42ff8d4dfab4f1d2bc79', 'request_id': 'req-78ba6234-faa4-48b0-bd93-bbe83aa83779'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.556031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:50.557610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:50.571087 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-78ba6234-faa4-48b0-bd93-bbe83aa83779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a27e8a11c7f42ff8d4dfab4f1d2bc79', 'request_id': 'req-78ba6234-faa4-48b0-bd93-bbe83aa83779'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.586353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-78ba6234-faa4-48b0-bd93-bbe83aa83779 admin admin] The token cache is being invalidate because project 4a27e8a11c7f42ff8d4dfab4f1d2bc79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:50.586844 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-78ba6234-faa4-48b0-bd93-bbe83aa83779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.587761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-78ba6234-faa4-48b0-bd93-bbe83aa83779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.592903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 935/1866] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:50 2022] DELETE /identity/v3/projects/4a27e8a11c7f42ff8d4dfab4f1d2bc79 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:50.592903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdedbad-1e5b-425d-b5c1-c1eb68d9bfd5 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:50.592903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdedbad-1e5b-425d-b5c1-c1eb68d9bfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:50.592903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdedbad-1e5b-425d-b5c1-c1eb68d9bfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:50.615176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-bbdedbad-1e5b-425d-b5c1-c1eb68d9bfd5 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:50.617186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-bbdedbad-1e5b-425d-b5c1-c1eb68d9bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:50.635848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3335f-e506-42bf-9fce-5c13057d7cc2 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:50.683766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:50.712055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:50.712971 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:50.713402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:50.713693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] PATH_INFO: `/v3/users/5b7fd5fe54744842a0dbe1af97da1ed7` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:50.715407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7fd5fe54744842a0dbe1af97da1ed7)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:50.724110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:50.736851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 936/1867] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:50.736851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdedbad-1e5b-425d-b5c1-c1eb68d9bfd5 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:50.736851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-bbdedbad-1e5b-425d-b5c1-c1eb68d9bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:50.755647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdedbad-1e5b-425d-b5c1-c1eb68d9bfd5 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:50.764308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347272e-36ca-4633-9788-2f05b57beb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:50.765443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347272e-36ca-4633-9788-2f05b57beb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:50.765818 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347272e-36ca-4633-9788-2f05b57beb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:50.766167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347272e-36ca-4633-9788-2f05b57beb76 admin admin] PATH_INFO: `/v3/users/d299299775a247739b69e7a23d9a3392` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:50.768081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347272e-36ca-4633-9788-2f05b57beb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d299299775a247739b69e7a23d9a3392)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:50.770259 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347272e-36ca-4633-9788-2f05b57beb76 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:50.791480 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7fd5fe54744842a0dbe1af97da1ed7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.792682 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7fd5fe54744842a0dbe1af97da1ed7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.793869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7fd5fe54744842a0dbe1af97da1ed7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.803329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7fd5fe54744842a0dbe1af97da1ed7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.816382 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7fd5fe54744842a0dbe1af97da1ed7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.836413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6347272e-36ca-4633-9788-2f05b57beb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd299299775a247739b69e7a23d9a3392'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.837254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6347272e-36ca-4633-9788-2f05b57beb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd299299775a247739b69e7a23d9a3392'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.841564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6347272e-36ca-4633-9788-2f05b57beb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd299299775a247739b69e7a23d9a3392'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.848994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 932/1868] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:50 2022] DELETE /identity/v3/users/5b7fd5fe54744842a0dbe1af97da1ed7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:50.850446 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:50.852196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:50.853534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6347272e-36ca-4633-9788-2f05b57beb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd299299775a247739b69e7a23d9a3392'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.859188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:50.868661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6347272e-36ca-4633-9788-2f05b57beb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd299299775a247739b69e7a23d9a3392'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:50.897184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 937/1869] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:50 2022] DELETE /identity/v3/users/d299299775a247739b69e7a23d9a3392 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:50.898511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6b94-e25d-46c9-beec-c0ec326035bd None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:50.898804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6b94-e25d-46c9-beec-c0ec326035bd None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:50.899081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6b94-e25d-46c9-beec-c0ec326035bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:50.922759 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e0bd6b94-e25d-46c9-beec-c0ec326035bd None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:50.924881 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e0bd6b94-e25d-46c9-beec-c0ec326035bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:50.944453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ac10d-5a8f-404f-ae2b-454188fd0f10 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:51.009641 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 938/1870] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:51.011377 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd6b94-e25d-46c9-beec-c0ec326035bd None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:51.030949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd6b94-e25d-46c9-beec-c0ec326035bd None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:51.038535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3be37-3947-4190-9f18-96b1a72d2bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:51.039234 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3be37-3947-4190-9f18-96b1a72d2bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:51.039522 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3be37-3947-4190-9f18-96b1a72d2bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:51.039802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3be37-3947-4190-9f18-96b1a72d2bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:51.040684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3be37-3947-4190-9f18-96b1a72d2bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:51.040838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3be37-3947-4190-9f18-96b1a72d2bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:51.041755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:51.042757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3be37-3947-4190-9f18-96b1a72d2bdd admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:51.043102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:51.043425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:51.043794 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] PATH_INFO: `/v3/users/09b44442310a4305ae471dfa7aaf948e` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:51.046259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b44442310a4305ae471dfa7aaf948e)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:51.048498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:51.063442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 939/1871] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:51.066669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3be37-3947-4190-9f18-96b1a72d2bdd admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:51.085910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3be37-3947-4190-9f18-96b1a72d2bdd admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:51.096428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbda02-7b95-4a76-9324-3b46c8fcb2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:51.096428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbda02-7b95-4a76-9324-3b46c8fcb2be admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:51.096428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbda02-7b95-4a76-9324-3b46c8fcb2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:51.097608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbda02-7b95-4a76-9324-3b46c8fcb2be admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:51.099543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbda02-7b95-4a76-9324-3b46c8fcb2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:51.102120 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbda02-7b95-4a76-9324-3b46c8fcb2be admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:51.142428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b44442310a4305ae471dfa7aaf948e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.143118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b44442310a4305ae471dfa7aaf948e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.143779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b44442310a4305ae471dfa7aaf948e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.153934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b44442310a4305ae471dfa7aaf948e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.166092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b44442310a4305ae471dfa7aaf948e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.168151 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 940/1872] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:51 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:51.186383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbda02-7b95-4a76-9324-3b46c8fcb2be admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:51.191040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-59fbda02-7b95-4a76-9324-3b46c8fcb2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:51.249062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 933/1873] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:50 2022] DELETE /identity/v3/users/09b44442310a4305ae471dfa7aaf948e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:51.325459 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:51.366673 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbda02-7b95-4a76-9324-3b46c8fcb2be admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:51.463308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774787f-e251-40e8-8264-0c44518aa76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:51.464137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774787f-e251-40e8-8264-0c44518aa76a admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:51.464359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774787f-e251-40e8-8264-0c44518aa76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:51.464826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774787f-e251-40e8-8264-0c44518aa76a admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:51.466145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774787f-e251-40e8-8264-0c44518aa76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:51.469624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774787f-e251-40e8-8264-0c44518aa76a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:51.489747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:51.491557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:51.514489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 941/1874] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:51 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:20:51.518408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774787f-e251-40e8-8264-0c44518aa76a admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:51.539223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07223a-ebd1-41bf-9d9c-3edd743993fc admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:51.555326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774787f-e251-40e8-8264-0c44518aa76a admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:51.557750 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:51.563723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f0e4d-c97a-4e0d-8a19-e7a1cead19a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:51.564633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f0e4d-c97a-4e0d-8a19-e7a1cead19a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:51.565310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:51.565992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:51.566530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] PATH_INFO: `/v3/projects/6e06635f0cf94c4dab22cf742f0e8a7d` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:51.566832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f0e4d-c97a-4e0d-8a19-e7a1cead19a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:51.567251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f0e4d-c97a-4e0d-8a19-e7a1cead19a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:51.568197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f0e4d-c97a-4e0d-8a19-e7a1cead19a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:51.569196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e06635f0cf94c4dab22cf742f0e8a7d)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:51.570301 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f0e4d-c97a-4e0d-8a19-e7a1cead19a2 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:51.574204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:51.603411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 942/1875] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:20:51.603411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f0e4d-c97a-4e0d-8a19-e7a1cead19a2 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:51.603876 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-761f0e4d-c97a-4e0d-8a19-e7a1cead19a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:51.628613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f0e4d-c97a-4e0d-8a19-e7a1cead19a2 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:51.635310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:51.638273 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:51.639039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:51.639662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:51.639662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] PATH_INFO: `/v3/projects/234618e1d91549b59771d88344037b1f` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:51.641016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=234618e1d91549b59771d88344037b1f)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:51.643157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:51.664446 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e06635f0cf94c4dab22cf742f0e8a7d', 'request_id': 'req-de65faa8-0ad5-42c1-82b4-4e7152cfafac'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.672734 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e06635f0cf94c4dab22cf742f0e8a7d', 'request_id': 'req-de65faa8-0ad5-42c1-82b4-4e7152cfafac'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.683505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e06635f0cf94c4dab22cf742f0e8a7d', 'request_id': 'req-de65faa8-0ad5-42c1-82b4-4e7152cfafac'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.702791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '234618e1d91549b59771d88344037b1f', 'request_id': 'req-0b849a12-698a-45f4-99c7-9e53f5b689a6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.705147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] The token cache is being invalidate because project 6e06635f0cf94c4dab22cf742f0e8a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:51.705475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.706145 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.707986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 934/1876] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:51 2022] DELETE /identity/v3/projects/6e06635f0cf94c4dab22cf742f0e8a7d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:51.708767 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:51.710148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:51.722868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '234618e1d91549b59771d88344037b1f', 'request_id': 'req-0b849a12-698a-45f4-99c7-9e53f5b689a6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.732419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '234618e1d91549b59771d88344037b1f', 'request_id': 'req-0b849a12-698a-45f4-99c7-9e53f5b689a6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.748777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] The token cache is being invalidate because project 234618e1d91549b59771d88344037b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:51.749411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.750421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.752554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 943/1877] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:51 2022] DELETE /identity/v3/projects/234618e1d91549b59771d88344037b1f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:51.753649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:51.755226 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:51.794350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65faa8-0ad5-42c1-82b4-4e7152cfafac admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:51.838821 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:51.869102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b849a12-698a-45f4-99c7-9e53f5b689a6 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:51.873690 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aea4ec-2f7f-442c-a395-c645f4cb2c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:51.874397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aea4ec-2f7f-442c-a395-c645f4cb2c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:51.874686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aea4ec-2f7f-442c-a395-c645f4cb2c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:51.875158 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aea4ec-2f7f-442c-a395-c645f4cb2c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:51.875918 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aea4ec-2f7f-442c-a395-c645f4cb2c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:51.877237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a56250-1094-4b3a-938d-2083456ed992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:51.878418 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aea4ec-2f7f-442c-a395-c645f4cb2c7c admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:51.878596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a56250-1094-4b3a-938d-2083456ed992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:51.879038 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a56250-1094-4b3a-938d-2083456ed992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:51.879353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a56250-1094-4b3a-938d-2083456ed992 admin admin] PATH_INFO: `/v3/users/9a626c7d2a934ee69b6b4790a50d49f5` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:51.881081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a56250-1094-4b3a-938d-2083456ed992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a626c7d2a934ee69b6b4790a50d49f5)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:51.884090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a56250-1094-4b3a-938d-2083456ed992 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:51.898530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 935/1878] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:51.900730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aea4ec-2f7f-442c-a395-c645f4cb2c7c admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:51.904701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-87aea4ec-2f7f-442c-a395-c645f4cb2c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:51.920402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aea4ec-2f7f-442c-a395-c645f4cb2c7c admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:51.926896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:51.930124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:51.930320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:51.930421 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] PATH_INFO: `/v3/projects/e53ced8ad7174327ba269343d44fd658` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:51.931858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e53ced8ad7174327ba269343d44fd658)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:51.935165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:51.952978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-13a56250-1094-4b3a-938d-2083456ed992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a626c7d2a934ee69b6b4790a50d49f5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.953794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-13a56250-1094-4b3a-938d-2083456ed992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a626c7d2a934ee69b6b4790a50d49f5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.954418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-13a56250-1094-4b3a-938d-2083456ed992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a626c7d2a934ee69b6b4790a50d49f5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.962102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-13a56250-1094-4b3a-938d-2083456ed992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a626c7d2a934ee69b6b4790a50d49f5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:51.970122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-13a56250-1094-4b3a-938d-2083456ed992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a626c7d2a934ee69b6b4790a50d49f5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:52.001416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 944/1879] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:51 2022] DELETE /identity/v3/users/9a626c7d2a934ee69b6b4790a50d49f5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:52.001416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d480efa-3609-4f6d-82dc-a4670f305e6e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.001416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d480efa-3609-4f6d-82dc-a4670f305e6e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.002353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d480efa-3609-4f6d-82dc-a4670f305e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.009999 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e53ced8ad7174327ba269343d44fd658', 'request_id': 'req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:52.013149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:52.025277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e53ced8ad7174327ba269343d44fd658', 'request_id': 'req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:52.035098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-9d480efa-3609-4f6d-82dc-a4670f305e6e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:52.035439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e53ced8ad7174327ba269343d44fd658', 'request_id': 'req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:52.038554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-9d480efa-3609-4f6d-82dc-a4670f305e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:52.051422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] The token cache is being invalidate because project e53ced8ad7174327ba269343d44fd658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:52.052090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:52.052739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:52.055110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 936/1880] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:51 2022] DELETE /identity/v3/projects/e53ced8ad7174327ba269343d44fd658 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:52.056125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:52.057681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:52.135448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 945/1881] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:52.137592 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654647d-c7b5-4fe8-93fb-b72207390324 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.138121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654647d-c7b5-4fe8-93fb-b72207390324 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.138603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654647d-c7b5-4fe8-93fb-b72207390324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.157620 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520bcec-6b58-43bb-bdcb-3fbe1af6dad2 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:52.163038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060c3b4-ffa1-4ec9-b871-bba2e1546f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:52.163987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060c3b4-ffa1-4ec9-b871-bba2e1546f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.164340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060c3b4-ffa1-4ec9-b871-bba2e1546f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.164608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060c3b4-ffa1-4ec9-b871-bba2e1546f7b admin admin] PATH_INFO: `/v3/projects/623c673a37c04c1b88d00f1b68673154/users/92f51de043d24b809bf81a87453afdfd/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.170779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-4654647d-c7b5-4fe8-93fb-b72207390324 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:52.173036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4654647d-c7b5-4fe8-93fb-b72207390324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:52.182401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060c3b4-ffa1-4ec9-b871-bba2e1546f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=623c673a37c04c1b88d00f1b68673154, user_id=92f51de043d24b809bf81a87453afdfd, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:52.183612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 946/1882] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:52.185571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1bb36-628e-4182-b6c0-0cb8a6e4fd7f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.186269 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1bb36-628e-4182-b6c0-0cb8a6e4fd7f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.186834 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1bb36-628e-4182-b6c0-0cb8a6e4fd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.193505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060c3b4-ffa1-4ec9-b871-bba2e1546f7b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:52.213036 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 937/1883] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:52 2022] PUT /identity/v3/projects/623c673a37c04c1b88d00f1b68673154/users/92f51de043d24b809bf81a87453afdfd/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:52.221639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9c518-dbd3-43f2-8157-0d47b38bcf27 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.221639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9c518-dbd3-43f2-8157-0d47b38bcf27 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.221639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9c518-dbd3-43f2-8157-0d47b38bcf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.223391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a6e1bb36-628e-4182-b6c0-0cb8a6e4fd7f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:52.225639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a6e1bb36-628e-4182-b6c0-0cb8a6e4fd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:52.273358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-f4b9c518-dbd3-43f2-8157-0d47b38bcf27 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:52.274643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f4b9c518-dbd3-43f2-8157-0d47b38bcf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:52.309734 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:52.329260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 947/1884] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:52.330639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861870f-8d11-4b8b-be4f-756aa24d8dec None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.330918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861870f-8d11-4b8b-be4f-756aa24d8dec None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.331203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861870f-8d11-4b8b-be4f-756aa24d8dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.361834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 938/1885] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:52.363114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9c518-dbd3-43f2-8157-0d47b38bcf27 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:52.367978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-b861870f-8d11-4b8b-be4f-756aa24d8dec None None] MFA Rules not processed for user `92f51de043d24b809bf81a87453afdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:52.369331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b861870f-8d11-4b8b-be4f-756aa24d8dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:52.377587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9c518-dbd3-43f2-8157-0d47b38bcf27 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:52.385553 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2e01f-87a1-49fa-8fb1-c1b3b9ade6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:52.387170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2e01f-87a1-49fa-8fb1-c1b3b9ade6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.387658 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2e01f-87a1-49fa-8fb1-c1b3b9ade6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.388213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2e01f-87a1-49fa-8fb1-c1b3b9ade6ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.389643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2e01f-87a1-49fa-8fb1-c1b3b9ade6ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:52.390197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2e01f-87a1-49fa-8fb1-c1b3b9ade6ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:52.392647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2e01f-87a1-49fa-8fb1-c1b3b9ade6ee admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:52.407263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 939/1886] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:52.408270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2e01f-87a1-49fa-8fb1-c1b3b9ade6ee admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:52.420063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2e01f-87a1-49fa-8fb1-c1b3b9ade6ee admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:52.425784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d67c9f-9e05-45d7-81e2-6cb7b26ae8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:52.426206 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d67c9f-9e05-45d7-81e2-6cb7b26ae8cc admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.426651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d67c9f-9e05-45d7-81e2-6cb7b26ae8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.426948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d67c9f-9e05-45d7-81e2-6cb7b26ae8cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.427676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d67c9f-9e05-45d7-81e2-6cb7b26ae8cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:52.427987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d67c9f-9e05-45d7-81e2-6cb7b26ae8cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:52.429677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d67c9f-9e05-45d7-81e2-6cb7b26ae8cc admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:52.444859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 940/1887] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:52.445873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d67c9f-9e05-45d7-81e2-6cb7b26ae8cc admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:52.447898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-12d67c9f-9e05-45d7-81e2-6cb7b26ae8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:52.461782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d67c9f-9e05-45d7-81e2-6cb7b26ae8cc admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:52.466835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:52.467710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.468089 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.468274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] PATH_INFO: `/v3/projects/74acc6dfb6ee4ba0900974f80c1082f7` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.469522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74acc6dfb6ee4ba0900974f80c1082f7)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:52.471505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:52.473943 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 948/1888] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:52.474848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861870f-8d11-4b8b-be4f-756aa24d8dec None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:52.489580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861870f-8d11-4b8b-be4f-756aa24d8dec None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:52.495909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30733fad-1c2f-4488-baad-b6a06c7bdb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:52.496574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30733fad-1c2f-4488-baad-b6a06c7bdb07 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.496867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30733fad-1c2f-4488-baad-b6a06c7bdb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.497142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30733fad-1c2f-4488-baad-b6a06c7bdb07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.497883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30733fad-1c2f-4488-baad-b6a06c7bdb07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:52.499802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30733fad-1c2f-4488-baad-b6a06c7bdb07 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:52.518610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:52.532548 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74acc6dfb6ee4ba0900974f80c1082f7', 'request_id': 'req-a6c52f53-ccda-4023-bc60-98e589bf5622'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:52.539477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74acc6dfb6ee4ba0900974f80c1082f7', 'request_id': 'req-a6c52f53-ccda-4023-bc60-98e589bf5622'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:52.547873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 949/1889] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:52 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:52.548986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30733fad-1c2f-4488-baad-b6a06c7bdb07 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:52.550614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74acc6dfb6ee4ba0900974f80c1082f7', 'request_id': 'req-a6c52f53-ccda-4023-bc60-98e589bf5622'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:52.570850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] The token cache is being invalidate because project 74acc6dfb6ee4ba0900974f80c1082f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:52.571259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:52.572153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:52.574459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 941/1890] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:52 2022] DELETE /identity/v3/projects/74acc6dfb6ee4ba0900974f80c1082f7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:52.575528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:52.577521 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:52.637515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30733fad-1c2f-4488-baad-b6a06c7bdb07 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:52.643231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3e90d-5f01-4c4a-ab7c-9c60f3cb5738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:52.643918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3e90d-5f01-4c4a-ab7c-9c60f3cb5738 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.644316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3e90d-5f01-4c4a-ab7c-9c60f3cb5738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.644480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3e90d-5f01-4c4a-ab7c-9c60f3cb5738 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.645601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3e90d-5f01-4c4a-ab7c-9c60f3cb5738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:52.648782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3e90d-5f01-4c4a-ab7c-9c60f3cb5738 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:52.685005 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c52f53-ccda-4023-bc60-98e589bf5622 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:52.691948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 950/1891] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:52 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:52.691948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3e90d-5f01-4c4a-ab7c-9c60f3cb5738 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:52.694514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-00c3e90d-5f01-4c4a-ab7c-9c60f3cb5738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:52.783837 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec7149-a092-41fb-8f66-a21c8d97552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:52.784694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec7149-a092-41fb-8f66-a21c8d97552e admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.785599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec7149-a092-41fb-8f66-a21c8d97552e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.785954 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec7149-a092-41fb-8f66-a21c8d97552e admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.789425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec7149-a092-41fb-8f66-a21c8d97552e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:52.793716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec7149-a092-41fb-8f66-a21c8d97552e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:52.811326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:52.840022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 942/1892] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:52 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:52.843807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700d587-3e1e-49f8-afbd-c5b2b140edb9 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.844124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3e90d-5f01-4c4a-ab7c-9c60f3cb5738 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:52.845361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700d587-3e1e-49f8-afbd-c5b2b140edb9 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.846832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700d587-3e1e-49f8-afbd-c5b2b140edb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.878035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-f700d587-3e1e-49f8-afbd-c5b2b140edb9 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:52.879584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f700d587-3e1e-49f8-afbd-c5b2b140edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:52.955028 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:52.960663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ff3e-1186-4360-835c-5a8613ace546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:52.961421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ff3e-1186-4360-835c-5a8613ace546 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:52.961740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ff3e-1186-4360-835c-5a8613ace546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:52.962029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ff3e-1186-4360-835c-5a8613ace546 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:52.963127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656ff3e-1186-4360-835c-5a8613ace546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:52.965987 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656ff3e-1186-4360-835c-5a8613ace546 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:52.995292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 943/1893] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:52.996676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700d587-3e1e-49f8-afbd-c5b2b140edb9 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:52.998710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f700d587-3e1e-49f8-afbd-c5b2b140edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:53.012487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 951/1894] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:52 2022] POST /identity/v3/users => generated 292 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:53.014656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ff3e-1186-4360-835c-5a8613ace546 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.019376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700d587-3e1e-49f8-afbd-c5b2b140edb9 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.027147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571d12b-ccae-403e-82c9-063243635cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.027995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571d12b-ccae-403e-82c9-063243635cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.030394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571d12b-ccae-403e-82c9-063243635cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.030964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571d12b-ccae-403e-82c9-063243635cfd admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.031838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571d12b-ccae-403e-82c9-063243635cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.035484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571d12b-ccae-403e-82c9-063243635cfd admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.042895 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ff3e-1186-4360-835c-5a8613ace546 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.055632 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88623f69-6bfa-4beb-a3b3-dee52083696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.055994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88623f69-6bfa-4beb-a3b3-dee52083696e admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.056279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88623f69-6bfa-4beb-a3b3-dee52083696e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.056556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88623f69-6bfa-4beb-a3b3-dee52083696e admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.057412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88623f69-6bfa-4beb-a3b3-dee52083696e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.060175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88623f69-6bfa-4beb-a3b3-dee52083696e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.095755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 944/1895] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:52 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:53.095755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de951-10b3-4d00-9348-f42a73574bf3 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.095755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de951-10b3-4d00-9348-f42a73574bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.096455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de951-10b3-4d00-9348-f42a73574bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.119193 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 952/1896] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:53 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:53.125150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88623f69-6bfa-4beb-a3b3-dee52083696e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.127226 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-1c5de951-10b3-4d00-9348-f42a73574bf3 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:53.128558 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1c5de951-10b3-4d00-9348-f42a73574bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:53.144233 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88623f69-6bfa-4beb-a3b3-dee52083696e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.155948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 945/1897] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:53.156415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf7095-98d0-4997-98ee-5d71bb293dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.157473 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7095-98d0-4997-98ee-5d71bb293dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.157755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7095-98d0-4997-98ee-5d71bb293dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.158086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7095-98d0-4997-98ee-5d71bb293dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.158841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf7095-98d0-4997-98ee-5d71bb293dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.159259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de951-10b3-4d00-9348-f42a73574bf3 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.161581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf7095-98d0-4997-98ee-5d71bb293dd6 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.176585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de951-10b3-4d00-9348-f42a73574bf3 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.177712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 953/1898] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:53.178654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf7095-98d0-4997-98ee-5d71bb293dd6 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.194578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20cd7-39fd-468e-8966-4f51795616e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.197610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20cd7-39fd-468e-8966-4f51795616e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.198108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20cd7-39fd-468e-8966-4f51795616e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.198241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf7095-98d0-4997-98ee-5d71bb293dd6 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.198657 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20cd7-39fd-468e-8966-4f51795616e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.200469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b20cd7-39fd-468e-8966-4f51795616e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.204716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d3cc0-2c9c-4ba5-8c30-fe94e96282de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.205479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d3cc0-2c9c-4ba5-8c30-fe94e96282de admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.205683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b20cd7-39fd-468e-8966-4f51795616e2 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.205801 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d3cc0-2c9c-4ba5-8c30-fe94e96282de admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.206179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d3cc0-2c9c-4ba5-8c30-fe94e96282de admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.208899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d3cc0-2c9c-4ba5-8c30-fe94e96282de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.211530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d3cc0-2c9c-4ba5-8c30-fe94e96282de admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.227793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 954/1899] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:53.227793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d3cc0-2c9c-4ba5-8c30-fe94e96282de admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.229772 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 946/1900] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:53.231120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20cd7-39fd-468e-8966-4f51795616e2 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.246938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d3cc0-2c9c-4ba5-8c30-fe94e96282de admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.247354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20cd7-39fd-468e-8966-4f51795616e2 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.252356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de7a23-b66f-4084-adae-27c123dbd83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.253154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de7a23-b66f-4084-adae-27c123dbd83b admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.253537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de7a23-b66f-4084-adae-27c123dbd83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.253886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de7a23-b66f-4084-adae-27c123dbd83b admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.254327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654dfc5-d8ed-4983-a803-3e4142bb3593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.254671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de7a23-b66f-4084-adae-27c123dbd83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.255468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654dfc5-d8ed-4983-a803-3e4142bb3593 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.255967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654dfc5-d8ed-4983-a803-3e4142bb3593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.256291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de7a23-b66f-4084-adae-27c123dbd83b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.256465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654dfc5-d8ed-4983-a803-3e4142bb3593 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.257841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654dfc5-d8ed-4983-a803-3e4142bb3593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:53.258380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654dfc5-d8ed-4983-a803-3e4142bb3593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.261507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654dfc5-d8ed-4983-a803-3e4142bb3593 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.267395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 947/1901] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:53.268325 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de7a23-b66f-4084-adae-27c123dbd83b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.279302 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de7a23-b66f-4084-adae-27c123dbd83b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.287573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 955/1902] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:53.288110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598073b-4283-45b0-9b7a-3a484b12eeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.288110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598073b-4283-45b0-9b7a-3a484b12eeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.288323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654dfc5-d8ed-4983-a803-3e4142bb3593 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.288424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598073b-4283-45b0-9b7a-3a484b12eeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.288424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598073b-4283-45b0-9b7a-3a484b12eeb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.288424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598073b-4283-45b0-9b7a-3a484b12eeb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.288681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598073b-4283-45b0-9b7a-3a484b12eeb3 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.301105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 948/1903] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:53.302482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598073b-4283-45b0-9b7a-3a484b12eeb3 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.302778 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654dfc5-d8ed-4983-a803-3e4142bb3593 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.309118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b9f62-1d3e-44aa-9051-4e6509ed10b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.309812 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b9f62-1d3e-44aa-9051-4e6509ed10b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.310095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b9f62-1d3e-44aa-9051-4e6509ed10b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.310584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b9f62-1d3e-44aa-9051-4e6509ed10b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.312479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b9f62-1d3e-44aa-9051-4e6509ed10b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.314195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598073b-4283-45b0-9b7a-3a484b12eeb3 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.314713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b9f62-1d3e-44aa-9051-4e6509ed10b5 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.320805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c062fb4-54a8-4d7d-aa9e-1268a17ce6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.321948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c062fb4-54a8-4d7d-aa9e-1268a17ce6a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.323086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c062fb4-54a8-4d7d-aa9e-1268a17ce6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.323086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c062fb4-54a8-4d7d-aa9e-1268a17ce6a1 admin admin] PATH_INFO: `/v3/projects/b9b1494a99f94df2a26831712c7d0091/users/1c8c5da2954542119cfe155abf2ca204/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.332292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 956/1904] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:53.333277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b9f62-1d3e-44aa-9051-4e6509ed10b5 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.344351 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c062fb4-54a8-4d7d-aa9e-1268a17ce6a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b1494a99f94df2a26831712c7d0091, user_id=1c8c5da2954542119cfe155abf2ca204, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.347472 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c062fb4-54a8-4d7d-aa9e-1268a17ce6a1 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.348284 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b9f62-1d3e-44aa-9051-4e6509ed10b5 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.354883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c29ffc-9cbe-4780-a2f5-db7180f393fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.355808 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c29ffc-9cbe-4780-a2f5-db7180f393fa admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.356164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c29ffc-9cbe-4780-a2f5-db7180f393fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.356653 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c29ffc-9cbe-4780-a2f5-db7180f393fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.357937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c29ffc-9cbe-4780-a2f5-db7180f393fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.360992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c29ffc-9cbe-4780-a2f5-db7180f393fa admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.380067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 949/1905] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:53 2022] PUT /identity/v3/projects/b9b1494a99f94df2a26831712c7d0091/users/1c8c5da2954542119cfe155abf2ca204/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:53.381095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c062fb4-54a8-4d7d-aa9e-1268a17ce6a1 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.401300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 957/1906] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:53 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:53.402628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c29ffc-9cbe-4780-a2f5-db7180f393fa admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.464824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c062fb4-54a8-4d7d-aa9e-1268a17ce6a1 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.479296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c29ffc-9cbe-4780-a2f5-db7180f393fa admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.486406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e111b-b1ea-4751-91fb-3095bbade0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.487606 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e111b-b1ea-4751-91fb-3095bbade0b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.487905 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e111b-b1ea-4751-91fb-3095bbade0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.488178 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e111b-b1ea-4751-91fb-3095bbade0b5 admin admin] PATH_INFO: `/v3/projects/cfc9bc528ea64256a37d9ace1daf50b1/users/456372c47f48448a9c93f317a292ba06/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.498418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:53.512614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e111b-b1ea-4751-91fb-3095bbade0b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc9bc528ea64256a37d9ace1daf50b1, user_id=456372c47f48448a9c93f317a292ba06, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.516003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e111b-b1ea-4751-91fb-3095bbade0b5 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.531513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 958/1907] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:53 2022] PUT /identity/v3/projects/cfc9bc528ea64256a37d9ace1daf50b1/users/456372c47f48448a9c93f317a292ba06/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:53.532933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e62888-ef67-45e8-b589-d9b15c53e126 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.533252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e62888-ef67-45e8-b589-d9b15c53e126 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.533527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e62888-ef67-45e8-b589-d9b15c53e126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.550131 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970ba65-ee04-4d77-ad3f-63b8af719397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.551803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970ba65-ee04-4d77-ad3f-63b8af719397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.552304 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970ba65-ee04-4d77-ad3f-63b8af719397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.552808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970ba65-ee04-4d77-ad3f-63b8af719397 admin admin] PATH_INFO: `/v3/projects/88c0db2bd8484883ae8e71d1964108f7/users/b2f3c38c09844e72aa4a89042938ec2c/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.569116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-b2e62888-ef67-45e8-b589-d9b15c53e126 None None] MFA Rules not processed for user `1c8c5da2954542119cfe155abf2ca204`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:53.570634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b2e62888-ef67-45e8-b589-d9b15c53e126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:53.579074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970ba65-ee04-4d77-ad3f-63b8af719397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c0db2bd8484883ae8e71d1964108f7, user_id=b2f3c38c09844e72aa4a89042938ec2c, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.581300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970ba65-ee04-4d77-ad3f-63b8af719397 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.601427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 950/1908] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:53 2022] PUT /identity/v3/projects/88c0db2bd8484883ae8e71d1964108f7/users/b2f3c38c09844e72aa4a89042938ec2c/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:53.602968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970ba65-ee04-4d77-ad3f-63b8af719397 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.615185 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:53.655398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 959/1909] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:53.656718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe49ef-5717-438c-9ae3-2572d8b77d18 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.657009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe49ef-5717-438c-9ae3-2572d8b77d18 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.657590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe49ef-5717-438c-9ae3-2572d8b77d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.683681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970ba65-ee04-4d77-ad3f-63b8af719397 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.685440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-33fe49ef-5717-438c-9ae3-2572d8b77d18 None None] MFA Rules not processed for user `456372c47f48448a9c93f317a292ba06`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:53.686654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-33fe49ef-5717-438c-9ae3-2572d8b77d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:53.689059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae070a-a7f7-467f-af2f-7a3390c50f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.689943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae070a-a7f7-467f-af2f-7a3390c50f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.690331 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae070a-a7f7-467f-af2f-7a3390c50f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.690711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae070a-a7f7-467f-af2f-7a3390c50f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.691505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae070a-a7f7-467f-af2f-7a3390c50f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.693840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae070a-a7f7-467f-af2f-7a3390c50f48 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.719875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 951/1910] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:53 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:53.721425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9c9ec-a640-413b-bdf9-14348c9f989b None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.721815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9c9ec-a640-413b-bdf9-14348c9f989b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.722193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9c9ec-a640-413b-bdf9-14348c9f989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.759683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-55e9c9ec-a640-413b-bdf9-14348c9f989b None None] MFA Rules not processed for user `b2f3c38c09844e72aa4a89042938ec2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:53.761934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-55e9c9ec-a640-413b-bdf9-14348c9f989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:53.768410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 960/1911] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:53.769396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe49ef-5717-438c-9ae3-2572d8b77d18 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.770762 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-33fe49ef-5717-438c-9ae3-2572d8b77d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:53.844890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe49ef-5717-438c-9ae3-2572d8b77d18 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.848491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 952/1912] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:53.849334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9c9ec-a640-413b-bdf9-14348c9f989b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.850589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5238c5e-e5cd-4e5d-8469-45f325a7336e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.851505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5238c5e-e5cd-4e5d-8469-45f325a7336e service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.852232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5238c5e-e5cd-4e5d-8469-45f325a7336e service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.852516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5238c5e-e5cd-4e5d-8469-45f325a7336e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.863792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9c9ec-a640-413b-bdf9-14348c9f989b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.868636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699199dc-cb07-47fc-a14f-429ed7a1ed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.869418 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699199dc-cb07-47fc-a14f-429ed7a1ed45 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.869780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699199dc-cb07-47fc-a14f-429ed7a1ed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.869980 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699199dc-cb07-47fc-a14f-429ed7a1ed45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.870784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699199dc-cb07-47fc-a14f-429ed7a1ed45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.872573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699199dc-cb07-47fc-a14f-429ed7a1ed45 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.873969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:53.886382 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 953/1913] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:53.886382 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699199dc-cb07-47fc-a14f-429ed7a1ed45 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.895867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699199dc-cb07-47fc-a14f-429ed7a1ed45 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:53.906726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb5a21-2223-4801-9c40-79d1562be128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:53.907397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb5a21-2223-4801-9c40-79d1562be128 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:53.907684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb5a21-2223-4801-9c40-79d1562be128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:53.907961 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb5a21-2223-4801-9c40-79d1562be128 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:53.908689 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb5a21-2223-4801-9c40-79d1562be128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.910647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb5a21-2223-4801-9c40-79d1562be128 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.927683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5238c5e-e5cd-4e5d-8469-45f325a7336e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:53.937368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5238c5e-e5cd-4e5d-8469-45f325a7336e service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:53.952699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 961/1914] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:53.953468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5238c5e-e5cd-4e5d-8469-45f325a7336e service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.957138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 954/1915] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:53 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:53.957138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb5a21-2223-4801-9c40-79d1562be128 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:53.968402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5238c5e-e5cd-4e5d-8469-45f325a7336e service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.018625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:54.037884 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb5a21-2223-4801-9c40-79d1562be128 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.044503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28cd6e-c6ff-4cc5-aa89-6bc235974203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.046148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28cd6e-c6ff-4cc5-aa89-6bc235974203 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.046445 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28cd6e-c6ff-4cc5-aa89-6bc235974203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.047620 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28cd6e-c6ff-4cc5-aa89-6bc235974203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.056184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d57c5-f51e-4f67-9361-10cf9422157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.056609 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d57c5-f51e-4f67-9361-10cf9422157f admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.056834 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d57c5-f51e-4f67-9361-10cf9422157f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.057256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d57c5-f51e-4f67-9361-10cf9422157f admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.058332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d57c5-f51e-4f67-9361-10cf9422157f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.059967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28cd6e-c6ff-4cc5-aa89-6bc235974203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.060203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d57c5-f51e-4f67-9361-10cf9422157f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.065411 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28cd6e-c6ff-4cc5-aa89-6bc235974203 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.081414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 955/1916] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:54.084467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28cd6e-c6ff-4cc5-aa89-6bc235974203 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:54.101312 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28cd6e-c6ff-4cc5-aa89-6bc235974203 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.108102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa07146-448c-458d-aefc-f03fddc01050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.108455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa07146-448c-458d-aefc-f03fddc01050 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.108763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa07146-448c-458d-aefc-f03fddc01050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.109050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa07146-448c-458d-aefc-f03fddc01050 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.109873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa07146-448c-458d-aefc-f03fddc01050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.111943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa07146-448c-458d-aefc-f03fddc01050 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.119542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 962/1917] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:53 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:54.120642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d57c5-f51e-4f67-9361-10cf9422157f admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:54.154396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 956/1918] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:54 2022] POST /identity/v3/users => generated 290 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:54.154396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa07146-448c-458d-aefc-f03fddc01050 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:54.163465 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa07146-448c-458d-aefc-f03fddc01050 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.236342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d57c5-f51e-4f67-9361-10cf9422157f admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.248793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.260650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.260936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.261392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] PATH_INFO: `/v3/users/1c8c5da2954542119cfe155abf2ca204` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.266757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c8c5da2954542119cfe155abf2ca204)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.270282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9340-2967-40df-910d-cd2c4472f457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.271500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9340-2967-40df-910d-cd2c4472f457 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.272110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9340-2967-40df-910d-cd2c4472f457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.272600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.273039 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9340-2967-40df-910d-cd2c4472f457 admin admin] PATH_INFO: `/v3/projects/97727eadd2db48ff8f610cc8f759fec9/users/53a527396ec84ca3872015d165453e64/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.296447 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e9340-2967-40df-910d-cd2c4472f457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97727eadd2db48ff8f610cc8f759fec9, user_id=53a527396ec84ca3872015d165453e64, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.299891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e9340-2967-40df-910d-cd2c4472f457 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.344609 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c8c5da2954542119cfe155abf2ca204'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:54.345502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c8c5da2954542119cfe155abf2ca204'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:54.346218 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c8c5da2954542119cfe155abf2ca204'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:54.347785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:54.352468 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 957/1919] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:54 2022] PUT /identity/v3/projects/97727eadd2db48ff8f610cc8f759fec9/users/53a527396ec84ca3872015d165453e64/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:54.354485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9340-2967-40df-910d-cd2c4472f457 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:54.356744 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c8c5da2954542119cfe155abf2ca204'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:54.356871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-623e9340-2967-40df-910d-cd2c4472f457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:54.366674 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c8c5da2954542119cfe155abf2ca204'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:54.406848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 963/1920] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:20:54 2022] DELETE /identity/v3/users/1c8c5da2954542119cfe155abf2ca204 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:54.406848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:54.414900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:54.468246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9340-2967-40df-910d-cd2c4472f457 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.530426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf2f14-d74e-4197-afc8-75548006ce52 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.538021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0883613-f68d-440f-bf03-fae694a9a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.538986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883613-f68d-440f-bf03-fae694a9a998 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.539849 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883613-f68d-440f-bf03-fae694a9a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.540099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883613-f68d-440f-bf03-fae694a9a998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.541805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0883613-f68d-440f-bf03-fae694a9a998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.543466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:54.544077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0883613-f68d-440f-bf03-fae694a9a998 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.555156 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afc929-b98c-401d-906c-244b7a662593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.556102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afc929-b98c-401d-906c-244b7a662593 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.556498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afc929-b98c-401d-906c-244b7a662593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.556866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afc929-b98c-401d-906c-244b7a662593 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.557684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afc929-b98c-401d-906c-244b7a662593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.560069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afc929-b98c-401d-906c-244b7a662593 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.564454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 964/1921] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:54.565946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcdcad-4c0c-46e3-a3a6-d8c22ae29585 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.566245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcdcad-4c0c-46e3-a3a6-d8c22ae29585 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.566530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcdcad-4c0c-46e3-a3a6-d8c22ae29585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.595509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 958/1922] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:54 2022] POST /identity/v3/users => generated 300 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:54.596968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637ce76-886f-490a-8179-97a5a1969ecf None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.597580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637ce76-886f-490a-8179-97a5a1969ecf None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.597980 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637ce76-886f-490a-8179-97a5a1969ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.609382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-79fcdcad-4c0c-46e3-a3a6-d8c22ae29585 None None] MFA Rules not processed for user `53a527396ec84ca3872015d165453e64`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:54.610710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-79fcdcad-4c0c-46e3-a3a6-d8c22ae29585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:54.618763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c637ce76-886f-490a-8179-97a5a1969ecf None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:54.620146 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c637ce76-886f-490a-8179-97a5a1969ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:54.630371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 959/1923] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:54.631452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637ce76-886f-490a-8179-97a5a1969ecf None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:54.653958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637ce76-886f-490a-8179-97a5a1969ecf None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.661513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcef5a-286d-4853-a5eb-a5f697cdaf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.663121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcef5a-286d-4853-a5eb-a5f697cdaf24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.663681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcef5a-286d-4853-a5eb-a5f697cdaf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.664239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcef5a-286d-4853-a5eb-a5f697cdaf24 admin admin] PATH_INFO: `/v3/projects/116a83e1fa014b47bba339ebee56655e/users/e34c665a2470490581f25e254de228d8/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.683972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcef5a-286d-4853-a5eb-a5f697cdaf24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=116a83e1fa014b47bba339ebee56655e, user_id=e34c665a2470490581f25e254de228d8, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.687394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcef5a-286d-4853-a5eb-a5f697cdaf24 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.699975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 965/1924] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:54.703582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcdcad-4c0c-46e3-a3a6-d8c22ae29585 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:54.708965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 960/1925] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:54 2022] PUT /identity/v3/projects/116a83e1fa014b47bba339ebee56655e/users/e34c665a2470490581f25e254de228d8/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:54.708965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcef5a-286d-4853-a5eb-a5f697cdaf24 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:54.708965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9ddcef5a-286d-4853-a5eb-a5f697cdaf24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:54.718325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcdcad-4c0c-46e3-a3a6-d8c22ae29585 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.780676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:54.790456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcef5a-286d-4853-a5eb-a5f697cdaf24 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.797911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af4853-d0ff-4573-9a49-50bc8414fb18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.798576 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af4853-d0ff-4573-9a49-50bc8414fb18 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.798855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af4853-d0ff-4573-9a49-50bc8414fb18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.799130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af4853-d0ff-4573-9a49-50bc8414fb18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.801344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db93ec-6459-4d70-9e95-d6e1f1606aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.802050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db93ec-6459-4d70-9e95-d6e1f1606aff admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.802331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db93ec-6459-4d70-9e95-d6e1f1606aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.802605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db93ec-6459-4d70-9e95-d6e1f1606aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.803331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db93ec-6459-4d70-9e95-d6e1f1606aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.804995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db93ec-6459-4d70-9e95-d6e1f1606aff admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.816651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af4853-d0ff-4573-9a49-50bc8414fb18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.818449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af4853-d0ff-4573-9a49-50bc8414fb18 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.826701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 966/1926] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:54.827569 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db93ec-6459-4d70-9e95-d6e1f1606aff admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:54.832310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d0db93ec-6459-4d70-9e95-d6e1f1606aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:54.846136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db93ec-6459-4d70-9e95-d6e1f1606aff admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.850995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7ff2-3137-43ad-9981-da34b11d58b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.851665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7ff2-3137-43ad-9981-da34b11d58b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.851942 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7ff2-3137-43ad-9981-da34b11d58b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.852215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7ff2-3137-43ad-9981-da34b11d58b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.852919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a7ff2-3137-43ad-9981-da34b11d58b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.855073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a7ff2-3137-43ad-9981-da34b11d58b3 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.869295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 961/1927] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:54.873696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af4853-d0ff-4573-9a49-50bc8414fb18 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:54.890204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af4853-d0ff-4573-9a49-50bc8414fb18 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.895995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88162653-cbb3-417d-b5d0-e67635b41e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.905437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88162653-cbb3-417d-b5d0-e67635b41e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.905437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88162653-cbb3-417d-b5d0-e67635b41e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.905437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88162653-cbb3-417d-b5d0-e67635b41e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.905437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88162653-cbb3-417d-b5d0-e67635b41e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.905437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88162653-cbb3-417d-b5d0-e67635b41e15 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.932800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 962/1928] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:54.932800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88162653-cbb3-417d-b5d0-e67635b41e15 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:54.950731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88162653-cbb3-417d-b5d0-e67635b41e15 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:54.950731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fcae7-8433-423c-97dc-b53fce2bec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:54.950731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fcae7-8433-423c-97dc-b53fce2bec46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:54.950731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fcae7-8433-423c-97dc-b53fce2bec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:54.951393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fcae7-8433-423c-97dc-b53fce2bec46 admin admin] PATH_INFO: `/v3/projects/8610fcbc4b24440ca5a37f331a8ddc2c/users/72696d58deca488092e6f1f7f7ff23d5/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:54.968649 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344fcae7-8433-423c-97dc-b53fce2bec46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8610fcbc4b24440ca5a37f331a8ddc2c, user_id=72696d58deca488092e6f1f7f7ff23d5, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:54.968939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344fcae7-8433-423c-97dc-b53fce2bec46 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:54.980471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 967/1929] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:54 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:54.981855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7ff2-3137-43ad-9981-da34b11d58b3 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:54.995464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 963/1930] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:54 2022] PUT /identity/v3/projects/8610fcbc4b24440ca5a37f331a8ddc2c/users/72696d58deca488092e6f1f7f7ff23d5/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:54.996792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fcae7-8433-423c-97dc-b53fce2bec46 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:55.061740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7ff2-3137-43ad-9981-da34b11d58b3 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:55.064349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fcae7-8433-423c-97dc-b53fce2bec46 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:55.067511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451e339-942a-456d-8e92-6829606acfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:55.068183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451e339-942a-456d-8e92-6829606acfe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:55.068544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451e339-942a-456d-8e92-6829606acfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:55.068887 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451e339-942a-456d-8e92-6829606acfe3 admin admin] PATH_INFO: `/v3/projects/116a83e1fa014b47bba339ebee56655e/users/e34c665a2470490581f25e254de228d8/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:55.070112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898da8f-b6dd-4c2b-a237-63238219afa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:55.070792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898da8f-b6dd-4c2b-a237-63238219afa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:55.071121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898da8f-b6dd-4c2b-a237-63238219afa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:55.071241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451e339-942a-456d-8e92-6829606acfe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=116a83e1fa014b47bba339ebee56655e, user_id=e34c665a2470490581f25e254de228d8, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:55.071451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898da8f-b6dd-4c2b-a237-63238219afa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:55.072458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898da8f-b6dd-4c2b-a237-63238219afa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:55.074335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451e339-942a-456d-8e92-6829606acfe3 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:55.074469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898da8f-b6dd-4c2b-a237-63238219afa9 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:55.087498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 968/1931] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:54 2022] PUT /identity/v3/projects/116a83e1fa014b47bba339ebee56655e/users/e34c665a2470490581f25e254de228d8/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:55.088508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451e339-942a-456d-8e92-6829606acfe3 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:55.115219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 964/1932] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:54 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:55.117822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a908123-6cb8-41e8-8e49-93a7bad44743 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:55.118340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a908123-6cb8-41e8-8e49-93a7bad44743 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:55.118859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a908123-6cb8-41e8-8e49-93a7bad44743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:55.151423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:55.155654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-1a908123-6cb8-41e8-8e49-93a7bad44743 None None] MFA Rules not processed for user `e34c665a2470490581f25e254de228d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:55.157209 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1a908123-6cb8-41e8-8e49-93a7bad44743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:55.205089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451e339-942a-456d-8e92-6829606acfe3 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:55.212991 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ca615-963c-4a0d-8758-b84686773dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:55.216593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ca615-963c-4a0d-8758-b84686773dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:55.216593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ca615-963c-4a0d-8758-b84686773dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:55.216593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ca615-963c-4a0d-8758-b84686773dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:55.216944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ca615-963c-4a0d-8758-b84686773dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:55.219364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ca615-963c-4a0d-8758-b84686773dcb admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:55.239393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 969/1933] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:55.240990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ca615-963c-4a0d-8758-b84686773dcb admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:55.252253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 965/1934] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:55 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:55.253038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a908123-6cb8-41e8-8e49-93a7bad44743 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:55.258155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ca615-963c-4a0d-8758-b84686773dcb admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:55.265051 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6c3e9-de3b-45d9-823b-c99f2aaa4c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:55.265454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6c3e9-de3b-45d9-823b-c99f2aaa4c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:55.265739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6c3e9-de3b-45d9-823b-c99f2aaa4c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:55.266012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6c3e9-de3b-45d9-823b-c99f2aaa4c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:55.266803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6c3e9-de3b-45d9-823b-c99f2aaa4c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:55.268087 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a908123-6cb8-41e8-8e49-93a7bad44743 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:55.268973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6c3e9-de3b-45d9-823b-c99f2aaa4c29 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:55.274539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23245b27-75ca-4ade-8a61-3a57ac5b0dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:55.276824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23245b27-75ca-4ade-8a61-3a57ac5b0dff admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:55.279318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23245b27-75ca-4ade-8a61-3a57ac5b0dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:55.279644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23245b27-75ca-4ade-8a61-3a57ac5b0dff admin admin] PATH_INFO: `/v3/projects/8610fcbc4b24440ca5a37f331a8ddc2c/users/72696d58deca488092e6f1f7f7ff23d5/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:55.283116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23245b27-75ca-4ade-8a61-3a57ac5b0dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8610fcbc4b24440ca5a37f331a8ddc2c, user_id=72696d58deca488092e6f1f7f7ff23d5, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:55.286523 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23245b27-75ca-4ade-8a61-3a57ac5b0dff admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:55.288975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 970/1935] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:55.289245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6c3e9-de3b-45d9-823b-c99f2aaa4c29 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:55.292810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-20d6c3e9-de3b-45d9-823b-c99f2aaa4c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:55.304017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 966/1936] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:55 2022] PUT /identity/v3/projects/8610fcbc4b24440ca5a37f331a8ddc2c/users/72696d58deca488092e6f1f7f7ff23d5/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:55.305277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23245b27-75ca-4ade-8a61-3a57ac5b0dff admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:55.370038 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:55.387860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6c3e9-de3b-45d9-823b-c99f2aaa4c29 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:55.437406 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23245b27-75ca-4ade-8a61-3a57ac5b0dff admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:55.443431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b7e93-cb93-4286-8097-7e4d09cba81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:55.444569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b7e93-cb93-4286-8097-7e4d09cba81f admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:55.445266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b7e93-cb93-4286-8097-7e4d09cba81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:55.445544 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b7e93-cb93-4286-8097-7e4d09cba81f admin admin] PATH_INFO: `/v3/projects/e39068ca64854096be2690fb9209d732/users/def4ab015b794cf1af96d315cc5cb141/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:55.456594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca339dcb-1ff1-4f97-bd10-10749bd07c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:55.457317 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339dcb-1ff1-4f97-bd10-10749bd07c42 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:55.457697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339dcb-1ff1-4f97-bd10-10749bd07c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:55.458034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339dcb-1ff1-4f97-bd10-10749bd07c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:55.466635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b7e93-cb93-4286-8097-7e4d09cba81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39068ca64854096be2690fb9209d732, user_id=def4ab015b794cf1af96d315cc5cb141, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:55.478007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b7e93-cb93-4286-8097-7e4d09cba81f admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:55.501329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 967/1937] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:55 2022] PUT /identity/v3/projects/e39068ca64854096be2690fb9209d732/users/def4ab015b794cf1af96d315cc5cb141/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:55.503179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47dd28-67ff-4bc0-975d-e5533b90443f None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:55.503478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47dd28-67ff-4bc0-975d-e5533b90443f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:55.504399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47dd28-67ff-4bc0-975d-e5533b90443f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:55.555277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca339dcb-1ff1-4f97-bd10-10749bd07c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:55.556835 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca339dcb-1ff1-4f97-bd10-10749bd07c42 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:55.563043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-1b47dd28-67ff-4bc0-975d-e5533b90443f None None] MFA Rules not processed for user `72696d58deca488092e6f1f7f7ff23d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:55.564396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1b47dd28-67ff-4bc0-975d-e5533b90443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:55.571321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 971/1938] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:55 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:55.572255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca339dcb-1ff1-4f97-bd10-10749bd07c42 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:55.583175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca339dcb-1ff1-4f97-bd10-10749bd07c42 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:55.661860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:55.682389 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 968/1939] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:55.683498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47dd28-67ff-4bc0-975d-e5533b90443f None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:55.684964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1b47dd28-67ff-4bc0-975d-e5533b90443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:55.698746 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d446672-6830-4fe3-b1f6-bbe0a0acf9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:55.700222 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d446672-6830-4fe3-b1f6-bbe0a0acf9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:55.701289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d446672-6830-4fe3-b1f6-bbe0a0acf9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:55.701651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d446672-6830-4fe3-b1f6-bbe0a0acf9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:55.704411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d446672-6830-4fe3-b1f6-bbe0a0acf9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:55.707500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d446672-6830-4fe3-b1f6-bbe0a0acf9ab admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:55.728218 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 972/1940] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:55.729158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d446672-6830-4fe3-b1f6-bbe0a0acf9ab admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:55.820276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47dd28-67ff-4bc0-975d-e5533b90443f None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:55.836035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89936ee-891c-4b2a-a7d6-8f719e42963b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:55.836885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89936ee-891c-4b2a-a7d6-8f719e42963b service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:55.838346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89936ee-891c-4b2a-a7d6-8f719e42963b service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:55.838739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89936ee-891c-4b2a-a7d6-8f719e42963b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:55.844080 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d89936ee-891c-4b2a-a7d6-8f719e42963b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:55.907408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:55.944097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89936ee-891c-4b2a-a7d6-8f719e42963b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:55.945817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d446672-6830-4fe3-b1f6-bbe0a0acf9ab admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:55.946169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89936ee-891c-4b2a-a7d6-8f719e42963b service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:55.961767 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f887f-3862-4309-9f83-9d18b4e08c27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:55.962653 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f887f-3862-4309-9f83-9d18b4e08c27 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:55.963099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f887f-3862-4309-9f83-9d18b4e08c27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:55.963563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f887f-3862-4309-9f83-9d18b4e08c27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:55.972053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 969/1941] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:55.973081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89936ee-891c-4b2a-a7d6-8f719e42963b service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:55.999932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89936ee-891c-4b2a-a7d6-8f719e42963b service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:56.013508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f887f-3862-4309-9f83-9d18b4e08c27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:56.015757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f887f-3862-4309-9f83-9d18b4e08c27 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:56.016047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71142a6c-7d4c-433e-90f7-8c9ba1cd3ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:56.017443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142a6c-7d4c-433e-90f7-8c9ba1cd3ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:56.017732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142a6c-7d4c-433e-90f7-8c9ba1cd3ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:56.018015 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142a6c-7d4c-433e-90f7-8c9ba1cd3ba4 admin admin] PATH_INFO: `/v3/projects/e39068ca64854096be2690fb9209d732/users/def4ab015b794cf1af96d315cc5cb141/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:56.026350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71142a6c-7d4c-433e-90f7-8c9ba1cd3ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39068ca64854096be2690fb9209d732, user_id=def4ab015b794cf1af96d315cc5cb141, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:56.034760 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71142a6c-7d4c-433e-90f7-8c9ba1cd3ba4 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:56.040989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 973/1942] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:56.076578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 970/1943] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:55 2022] PUT /identity/v3/projects/e39068ca64854096be2690fb9209d732/users/def4ab015b794cf1af96d315cc5cb141/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:56.079391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078f5c8-8d7e-4924-ac2f-ac23cac3be62 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:56.079881 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078f5c8-8d7e-4924-ac2f-ac23cac3be62 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:56.080300 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078f5c8-8d7e-4924-ac2f-ac23cac3be62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:56.115476 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1078f5c8-8d7e-4924-ac2f-ac23cac3be62 None None] MFA Rules not processed for user `def4ab015b794cf1af96d315cc5cb141`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:56.117387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1078f5c8-8d7e-4924-ac2f-ac23cac3be62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:56.267478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d7a79-fbff-4383-a43d-0e5308321398 None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:56.269538 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d7a79-fbff-4383-a43d-0e5308321398 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:56.270109 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d7a79-fbff-4383-a43d-0e5308321398 None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:56.272890 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 971/1944] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:20:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:20:56.298344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 974/1945] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:56.318259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1ad2e-5306-4a7b-8285-3f590e296832 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:56.318901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1ad2e-5306-4a7b-8285-3f590e296832 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:56.319464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1ad2e-5306-4a7b-8285-3f590e296832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:56.360724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-f7c1ad2e-5306-4a7b-8285-3f590e296832 None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:56.364179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f7c1ad2e-5306-4a7b-8285-3f590e296832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:56.447494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078f5c8-8d7e-4924-ac2f-ac23cac3be62 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:56.524422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 972/1946] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:20:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:56.604930 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078f5c8-8d7e-4924-ac2f-ac23cac3be62 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:56.609792 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99471b-4782-449a-9898-a7715da7b471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:56.610297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99471b-4782-449a-9898-a7715da7b471 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:56.610609 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99471b-4782-449a-9898-a7715da7b471 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:56.610913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99471b-4782-449a-9898-a7715da7b471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:56.758982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99471b-4782-449a-9898-a7715da7b471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:56.761009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99471b-4782-449a-9898-a7715da7b471 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:56.785797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 975/1947] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:56.949040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1ad2e-5306-4a7b-8285-3f590e296832 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:56.950655 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f7c1ad2e-5306-4a7b-8285-3f590e296832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:57.006181 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:57.084737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1ad2e-5306-4a7b-8285-3f590e296832 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:57.101144 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:57.102506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99471b-4782-449a-9898-a7715da7b471 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:57.103904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:57.104277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:57.105733 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6 admin admin] PATH_INFO: `/v3/projects/b9b1494a99f94df2a26831712c7d0091` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:57.106539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cb99471b-4782-449a-9898-a7715da7b471 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:57.107471 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b1494a99f94df2a26831712c7d0091)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:57.111385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:57.128347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99471b-4782-449a-9898-a7715da7b471 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:57.134404 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ff9f1-a148-420b-abb4-13ae70746796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:57.135217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ff9f1-a148-420b-abb4-13ae70746796 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:57.135503 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ff9f1-a148-420b-abb4-13ae70746796 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:57.135781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ff9f1-a148-420b-abb4-13ae70746796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:57.147168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ff9f1-a148-420b-abb4-13ae70746796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:57.149315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ff9f1-a148-420b-abb4-13ae70746796 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:57.188717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 976/1948] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:20:57.232348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b1494a99f94df2a26831712c7d0091', 'request_id': 'req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:57.258448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b1494a99f94df2a26831712c7d0091', 'request_id': 'req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:57.270738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ff9f1-a148-420b-abb4-13ae70746796 service nova] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:57.272069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b1494a99f94df2a26831712c7d0091', 'request_id': 'req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:57.282181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ff9f1-a148-420b-abb4-13ae70746796 service nova] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:57.304659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6 admin admin] The token cache is being invalidate because project b9b1494a99f94df2a26831712c7d0091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:20:57.305106 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:57.306371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6cc3a7fd-73e8-4d32-873d-3e5ae1c84af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:20:57.308973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 973/1949] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:20:56 2022] DELETE /identity/v3/projects/b9b1494a99f94df2a26831712c7d0091 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:57.311444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:57.315928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51609254-a5d1-47a3-9750-62eb1aec8b2e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:57.316224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51609254-a5d1-47a3-9750-62eb1aec8b2e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:57.316640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51609254-a5d1-47a3-9750-62eb1aec8b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:57.351099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-51609254-a5d1-47a3-9750-62eb1aec8b2e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:57.352139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-51609254-a5d1-47a3-9750-62eb1aec8b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:57.426597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1badf-0311-452c-b340-8e3979b02d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:57.430912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1badf-0311-452c-b340-8e3979b02d6f service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:57.431577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1badf-0311-452c-b340-8e3979b02d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:57.432231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1badf-0311-452c-b340-8e3979b02d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:57.436378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-78a1badf-0311-452c-b340-8e3979b02d6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:57.530415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1badf-0311-452c-b340-8e3979b02d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:57.532482 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1badf-0311-452c-b340-8e3979b02d6f service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:57.533457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 974/1950] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:20:57.543096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419275-2ffc-45de-ab71-f4198a784c52 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:57.543659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419275-2ffc-45de-ab71-f4198a784c52 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:57.544184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419275-2ffc-45de-ab71-f4198a784c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:57.569703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-46419275-2ffc-45de-ab71-f4198a784c52 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:57.572060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-46419275-2ffc-45de-ab71-f4198a784c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:57.572796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 977/1951] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:57.587124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 975/1952] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:57.591318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1badf-0311-452c-b340-8e3979b02d6f service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:57.606502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1badf-0311-452c-b340-8e3979b02d6f service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:57.612167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f3450-4ed4-40ea-ac45-721e29105d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:57.613095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f3450-4ed4-40ea-ac45-721e29105d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:57.613358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f3450-4ed4-40ea-ac45-721e29105d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:57.613647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f3450-4ed4-40ea-ac45-721e29105d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:57.614450 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f3450-4ed4-40ea-ac45-721e29105d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:20:57.614791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f3450-4ed4-40ea-ac45-721e29105d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:57.616676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f3450-4ed4-40ea-ac45-721e29105d2b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:57.635334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 978/1953] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:20:57.636503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46419275-2ffc-45de-ab71-f4198a784c52 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:57.680175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46419275-2ffc-45de-ab71-f4198a784c52 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:57.707006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eced7a0-662e-4c6c-aac9-ddd2cdf60731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:57.708385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eced7a0-662e-4c6c-aac9-ddd2cdf60731 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:57.711203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eced7a0-662e-4c6c-aac9-ddd2cdf60731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:57.712026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eced7a0-662e-4c6c-aac9-ddd2cdf60731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:57.716711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eced7a0-662e-4c6c-aac9-ddd2cdf60731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:57.723029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eced7a0-662e-4c6c-aac9-ddd2cdf60731 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:57.787920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 976/1954] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:20:57 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:57.793497 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f3450-4ed4-40ea-ac45-721e29105d2b admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:57.804969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f3450-4ed4-40ea-ac45-721e29105d2b admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:57.919026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d5bd8-fc08-4d40-a682-6f8eb4d9e86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:57.921029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d5bd8-fc08-4d40-a682-6f8eb4d9e86a admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:57.921667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d5bd8-fc08-4d40-a682-6f8eb4d9e86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:57.922129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d5bd8-fc08-4d40-a682-6f8eb4d9e86a admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:57.923319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d5bd8-fc08-4d40-a682-6f8eb4d9e86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:57.926023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d5bd8-fc08-4d40-a682-6f8eb4d9e86a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:57.980642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eced7a0-662e-4c6c-aac9-ddd2cdf60731 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:57.986503 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 979/1955] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:20:57 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:20:57.995040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eced7a0-662e-4c6c-aac9-ddd2cdf60731 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:58.004174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e83f91-8241-48f8-b0c0-d71fe56553ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:58.008225 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e83f91-8241-48f8-b0c0-d71fe56553ad admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:58.010212 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e83f91-8241-48f8-b0c0-d71fe56553ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:58.011057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e83f91-8241-48f8-b0c0-d71fe56553ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:58.013983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e83f91-8241-48f8-b0c0-d71fe56553ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:58.023827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e83f91-8241-48f8-b0c0-d71fe56553ad admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:58.066426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d5bd8-fc08-4d40-a682-6f8eb4d9e86a admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:58.076255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 977/1956] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:58.089097 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d5bd8-fc08-4d40-a682-6f8eb4d9e86a admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:58.101359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1ba2f-4404-453a-af45-446ca82df7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:58.104307 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1ba2f-4404-453a-af45-446ca82df7cf admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:58.105656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1ba2f-4404-453a-af45-446ca82df7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:58.106461 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1ba2f-4404-453a-af45-446ca82df7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:58.109988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1ba2f-4404-453a-af45-446ca82df7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:58.114103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1ba2f-4404-453a-af45-446ca82df7cf admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:58.174155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e83f91-8241-48f8-b0c0-d71fe56553ad admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:58.189021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 980/1957] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:20:58.212416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e83f91-8241-48f8-b0c0-d71fe56553ad admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:58.232352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890578be-dcc2-4d70-9dd7-cf4dd2c85f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:58.237271 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890578be-dcc2-4d70-9dd7-cf4dd2c85f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:58.237678 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890578be-dcc2-4d70-9dd7-cf4dd2c85f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:58.238139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890578be-dcc2-4d70-9dd7-cf4dd2c85f43 admin admin] PATH_INFO: `/v3/projects/559507d94a984b9f9663ed9f127668fb/users/2e6e49df0e254b4284950e4bbe65ab45/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:58.358941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890578be-dcc2-4d70-9dd7-cf4dd2c85f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559507d94a984b9f9663ed9f127668fb, user_id=2e6e49df0e254b4284950e4bbe65ab45, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:58.364281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890578be-dcc2-4d70-9dd7-cf4dd2c85f43 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:58.379404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:58.436186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 978/1958] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:20:58 2022] PUT /identity/v3/projects/559507d94a984b9f9663ed9f127668fb/users/2e6e49df0e254b4284950e4bbe65ab45/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:20:58.446264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed85b01-9798-4c03-9c7d-f593ee29596d None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:58.447321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed85b01-9798-4c03-9c7d-f593ee29596d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:58.448031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed85b01-9798-4c03-9c7d-f593ee29596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:58.490452 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-7ed85b01-9798-4c03-9c7d-f593ee29596d None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:58.492134 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7ed85b01-9798-4c03-9c7d-f593ee29596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:58.599166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:58.647293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 981/1959] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:58.662556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890578be-dcc2-4d70-9dd7-cf4dd2c85f43 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:58.665350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-890578be-dcc2-4d70-9dd7-cf4dd2c85f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:58.742649 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890578be-dcc2-4d70-9dd7-cf4dd2c85f43 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:20:58.749725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83624de1-bca8-43ba-8901-b887a68118d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:20:58.750407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83624de1-bca8-43ba-8901-b887a68118d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:58.750693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83624de1-bca8-43ba-8901-b887a68118d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:58.751749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83624de1-bca8-43ba-8901-b887a68118d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:58.763449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83624de1-bca8-43ba-8901-b887a68118d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:20:58.765237 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83624de1-bca8-43ba-8901-b887a68118d3 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:20:58.777769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 979/1960] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:20:59.669004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1c8a-9ab0-41f9-935f-7bc771bbc864 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:20:59.669584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1c8a-9ab0-41f9-935f-7bc771bbc864 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:20:59.670064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1c8a-9ab0-41f9-935f-7bc771bbc864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:20:59.723137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-816a1c8a-9ab0-41f9-935f-7bc771bbc864 None None] MFA Rules not processed for user `2e6e49df0e254b4284950e4bbe65ab45`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:20:59.726263 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-816a1c8a-9ab0-41f9-935f-7bc771bbc864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:20:59.945543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 982/1961] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:20:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:20:59.962003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83624de1-bca8-43ba-8901-b887a68118d3 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:20:59.973698 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-83624de1-bca8-43ba-8901-b887a68118d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:00.055842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83624de1-bca8-43ba-8901-b887a68118d3 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:00.060128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559893-0ba3-4402-8230-779d88496830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:00.060820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559893-0ba3-4402-8230-779d88496830 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:00.061186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559893-0ba3-4402-8230-779d88496830 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:00.061719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559893-0ba3-4402-8230-779d88496830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:00.072314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559893-0ba3-4402-8230-779d88496830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:00.073869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559893-0ba3-4402-8230-779d88496830 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:00.089895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 980/1962] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:20:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:01.049550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1c8a-9ab0-41f9-935f-7bc771bbc864 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:01.051879 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-816a1c8a-9ab0-41f9-935f-7bc771bbc864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:01.075883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1c8a-9ab0-41f9-935f-7bc771bbc864 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:01.085617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:01.086833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:01.087365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:01.087848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] PATH_INFO: `/v3/users/456372c47f48448a9c93f317a292ba06` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:01.089853 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456372c47f48448a9c93f317a292ba06)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:01.095008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:01.164665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456372c47f48448a9c93f317a292ba06'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:01.166290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456372c47f48448a9c93f317a292ba06'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:01.168412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456372c47f48448a9c93f317a292ba06'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:01.178413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456372c47f48448a9c93f317a292ba06'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:01.191225 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456372c47f48448a9c93f317a292ba06'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:01.257136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 983/1963] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:01 2022] DELETE /identity/v3/users/456372c47f48448a9c93f317a292ba06 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:01.261829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f44f34-cf7d-4932-b1a6-a2aa9974d64f None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:01.262368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f44f34-cf7d-4932-b1a6-a2aa9974d64f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:01.262470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f44f34-cf7d-4932-b1a6-a2aa9974d64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:01.300463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-d0f44f34-cf7d-4932-b1a6-a2aa9974d64f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:01.301770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d0f44f34-cf7d-4932-b1a6-a2aa9974d64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:01.388726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 981/1964] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:01.399310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:01.400713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:01.467153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:01.485822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e0e9-9530-492c-a378-b7c11cc9d773 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:01.490060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa947e-b945-4cb2-b8aa-2ba9d2cc936c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:01.490742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa947e-b945-4cb2-b8aa-2ba9d2cc936c service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:01.491026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa947e-b945-4cb2-b8aa-2ba9d2cc936c service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:01.491291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa947e-b945-4cb2-b8aa-2ba9d2cc936c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:01.501807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa947e-b945-4cb2-b8aa-2ba9d2cc936c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:01.503273 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa947e-b945-4cb2-b8aa-2ba9d2cc936c service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:01.518109 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 984/1965] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:21:01.642014 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcddcd3-d05a-49f3-b628-290ae26e3040 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:01.642385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcddcd3-d05a-49f3-b628-290ae26e3040 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:01.642890 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcddcd3-d05a-49f3-b628-290ae26e3040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:01.666756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-dbcddcd3-d05a-49f3-b628-290ae26e3040 None None] MFA Rules not processed for user `2e6e49df0e254b4284950e4bbe65ab45`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:01.668487 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-dbcddcd3-d05a-49f3-b628-290ae26e3040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:01.720393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:01.746076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 982/1966] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:01.883747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa947e-b945-4cb2-b8aa-2ba9d2cc936c service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:01.887950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7baa947e-b945-4cb2-b8aa-2ba9d2cc936c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:01.928166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa947e-b945-4cb2-b8aa-2ba9d2cc936c service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:01.942569 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:01.943505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:01.943922 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:01.944195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] PATH_INFO: `/v3/projects/cfc9bc528ea64256a37d9ace1daf50b1` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:01.945498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc9bc528ea64256a37d9ace1daf50b1)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:01.947517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:02.021240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc9bc528ea64256a37d9ace1daf50b1', 'request_id': 'req-70720835-8670-4a59-928e-7ae866e4c9e9'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:02.032879 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc9bc528ea64256a37d9ace1daf50b1', 'request_id': 'req-70720835-8670-4a59-928e-7ae866e4c9e9'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:02.041471 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcddcd3-d05a-49f3-b628-290ae26e3040 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:02.043570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-dbcddcd3-d05a-49f3-b628-290ae26e3040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:02.053652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc9bc528ea64256a37d9ace1daf50b1', 'request_id': 'req-70720835-8670-4a59-928e-7ae866e4c9e9'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:02.077099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] The token cache is being invalidate because project cfc9bc528ea64256a37d9ace1daf50b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:02.077746 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:02.078894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:02.082098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 985/1967] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:01 2022] DELETE /identity/v3/projects/cfc9bc528ea64256a37d9ace1daf50b1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:02.086694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:02.089735 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:02.115197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcddcd3-d05a-49f3-b628-290ae26e3040 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:02.212298 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80b5a3-25f9-421c-ba99-e639fe1dc268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:02.213325 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80b5a3-25f9-421c-ba99-e639fe1dc268 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:02.214583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80b5a3-25f9-421c-ba99-e639fe1dc268 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:02.214887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80b5a3-25f9-421c-ba99-e639fe1dc268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:02.217513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3c80b5a3-25f9-421c-ba99-e639fe1dc268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:02.218614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70720835-8670-4a59-928e-7ae866e4c9e9 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:02.224148 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:02.225041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:02.225451 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:02.225728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] PATH_INFO: `/v3/users/e34c665a2470490581f25e254de228d8` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:02.227126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34c665a2470490581f25e254de228d8)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:02.229191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:02.330190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80b5a3-25f9-421c-ba99-e639fe1dc268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:02.332379 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80b5a3-25f9-421c-ba99-e639fe1dc268 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:02.338267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34c665a2470490581f25e254de228d8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:02.338890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34c665a2470490581f25e254de228d8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:02.340334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34c665a2470490581f25e254de228d8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:02.346828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 983/1968] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:02.360274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34c665a2470490581f25e254de228d8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:02.372277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34c665a2470490581f25e254de228d8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:02.379187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:02.421412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 986/1969] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:02 2022] DELETE /identity/v3/users/e34c665a2470490581f25e254de228d8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:02.621855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80b5a3-25f9-421c-ba99-e639fe1dc268 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:02.625090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3c80b5a3-25f9-421c-ba99-e639fe1dc268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:02.661507 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80b5a3-25f9-421c-ba99-e639fe1dc268 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:02.749121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd060a-c2c8-4e2c-96fc-8d958187fcb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:02.750254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd060a-c2c8-4e2c-96fc-8d958187fcb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:02.751000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd060a-c2c8-4e2c-96fc-8d958187fcb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:02.751473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd060a-c2c8-4e2c-96fc-8d958187fcb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:02.754098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-eebd060a-c2c8-4e2c-96fc-8d958187fcb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:02.773538 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:02.965212 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd060a-c2c8-4e2c-96fc-8d958187fcb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:02.968321 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd060a-c2c8-4e2c-96fc-8d958187fcb4 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:02.995392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 984/1970] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:03.611296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:03.614058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:03.754479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17804bc7-a00f-4e96-9492-4cdbd0f29f06 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:03.760747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:03.761912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:03.762276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:03.762636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77 admin admin] PATH_INFO: `/v3/projects/116a83e1fa014b47bba339ebee56655e` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:03.764368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=116a83e1fa014b47bba339ebee56655e)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:03.767289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:03.861343 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '116a83e1fa014b47bba339ebee56655e', 'request_id': 'req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:03.879314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '116a83e1fa014b47bba339ebee56655e', 'request_id': 'req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:03.897621 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '116a83e1fa014b47bba339ebee56655e', 'request_id': 'req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:03.926154 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77 admin admin] The token cache is being invalidate because project 116a83e1fa014b47bba339ebee56655e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:03.926686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:03.928292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-8ea702ba-d5a0-438e-8dda-05a2ece1bc77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:03.931999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 987/1971] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:03 2022] DELETE /identity/v3/projects/116a83e1fa014b47bba339ebee56655e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:03.940508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbfb61-b492-4405-810e-9f2ba4ccbb63 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:03.941580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbfb61-b492-4405-810e-9f2ba4ccbb63 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:03.941580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbfb61-b492-4405-810e-9f2ba4ccbb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:03.966078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-19cbfb61-b492-4405-810e-9f2ba4ccbb63 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:03.967055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-19cbfb61-b492-4405-810e-9f2ba4ccbb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:04.045828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 985/1972] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:04.065409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62218-8ecb-479b-8e0c-e80f6db66e92 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:04.065915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62218-8ecb-479b-8e0c-e80f6db66e92 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:04.066203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62218-8ecb-479b-8e0c-e80f6db66e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:04.095283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a3b62218-8ecb-479b-8e0c-e80f6db66e92 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:04.096577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a3b62218-8ecb-479b-8e0c-e80f6db66e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:04.109449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 988/1973] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:04.115522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbfb61-b492-4405-810e-9f2ba4ccbb63 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:04.127357 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbfb61-b492-4405-810e-9f2ba4ccbb63 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:04.133132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866bc2c-e0f7-4cb1-8793-1683305ba068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:04.134718 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866bc2c-e0f7-4cb1-8793-1683305ba068 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:04.135007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866bc2c-e0f7-4cb1-8793-1683305ba068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:04.135283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866bc2c-e0f7-4cb1-8793-1683305ba068 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:04.136112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866bc2c-e0f7-4cb1-8793-1683305ba068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:21:04.136481 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866bc2c-e0f7-4cb1-8793-1683305ba068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:04.138358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866bc2c-e0f7-4cb1-8793-1683305ba068 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:04.156060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 986/1974] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:21:04.160517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b62218-8ecb-479b-8e0c-e80f6db66e92 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:04.171493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b62218-8ecb-479b-8e0c-e80f6db66e92 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:04.187448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd40f9f-e0cb-4730-9cbb-166f887dc984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:04.187448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd40f9f-e0cb-4730-9cbb-166f887dc984 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:04.187448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd40f9f-e0cb-4730-9cbb-166f887dc984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:04.187448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd40f9f-e0cb-4730-9cbb-166f887dc984 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:04.188140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd40f9f-e0cb-4730-9cbb-166f887dc984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:04.188140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd40f9f-e0cb-4730-9cbb-166f887dc984 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:04.265540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 989/1975] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:04 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:21:04.269457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866bc2c-e0f7-4cb1-8793-1683305ba068 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:04.284718 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866bc2c-e0f7-4cb1-8793-1683305ba068 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:04.423429 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425bda5-08b7-4d1a-9049-39aaf58b7ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:04.424157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425bda5-08b7-4d1a-9049-39aaf58b7ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:04.424337 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425bda5-08b7-4d1a-9049-39aaf58b7ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:04.424641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425bda5-08b7-4d1a-9049-39aaf58b7ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:04.425731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425bda5-08b7-4d1a-9049-39aaf58b7ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:04.427957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425bda5-08b7-4d1a-9049-39aaf58b7ef3 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:04.462251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 987/1976] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:04 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:21:04.463555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd40f9f-e0cb-4730-9cbb-166f887dc984 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:04.479747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd40f9f-e0cb-4730-9cbb-166f887dc984 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:04.492904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b81b7-a9a1-459d-a313-c384cc4a9fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:04.495897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b81b7-a9a1-459d-a313-c384cc4a9fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:04.495897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b81b7-a9a1-459d-a313-c384cc4a9fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:04.495897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b81b7-a9a1-459d-a313-c384cc4a9fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:04.495897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b81b7-a9a1-459d-a313-c384cc4a9fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:04.497933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b81b7-a9a1-459d-a313-c384cc4a9fc7 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:04.530953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 990/1977] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:04.536905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425bda5-08b7-4d1a-9049-39aaf58b7ef3 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:04.580146 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425bda5-08b7-4d1a-9049-39aaf58b7ef3 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:04.597536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2457f-b829-4a4a-831e-cf3351699d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:04.602098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2457f-b829-4a4a-831e-cf3351699d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:04.603520 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2457f-b829-4a4a-831e-cf3351699d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:04.606501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2457f-b829-4a4a-831e-cf3351699d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:04.608411 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2457f-b829-4a4a-831e-cf3351699d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:04.614140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2457f-b829-4a4a-831e-cf3351699d82 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:04.660225 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 988/1978] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:04.667732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b81b7-a9a1-459d-a313-c384cc4a9fc7 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:04.682493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b81b7-a9a1-459d-a313-c384cc4a9fc7 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:04.698967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676adb41-4c36-4158-bdea-a57f9fb3627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:04.701040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676adb41-4c36-4158-bdea-a57f9fb3627a admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:04.701483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676adb41-4c36-4158-bdea-a57f9fb3627a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:04.701941 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676adb41-4c36-4158-bdea-a57f9fb3627a admin admin] PATH_INFO: `/v3/projects/30b44b0effc145d9ab110fd592e3ee05/users/096e61c406f34ce8b1f2049675332e1b/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:04.739769 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676adb41-4c36-4158-bdea-a57f9fb3627a admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b44b0effc145d9ab110fd592e3ee05, user_id=096e61c406f34ce8b1f2049675332e1b, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:04.746116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676adb41-4c36-4158-bdea-a57f9fb3627a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:04.792110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 991/1979] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:04 2022] PUT /identity/v3/projects/30b44b0effc145d9ab110fd592e3ee05/users/096e61c406f34ce8b1f2049675332e1b/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:04.798919 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec86da-d440-4a4b-9d76-76a519be9040 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:04.799717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec86da-d440-4a4b-9d76-76a519be9040 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:04.800547 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec86da-d440-4a4b-9d76-76a519be9040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:04.857991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:04.898123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-88ec86da-d440-4a4b-9d76-76a519be9040 None None] MFA Rules not processed for user `096e61c406f34ce8b1f2049675332e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:04.914898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-88ec86da-d440-4a4b-9d76-76a519be9040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:05.045989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 989/1980] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:05.050159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676adb41-4c36-4158-bdea-a57f9fb3627a admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:05.070770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:05.146105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676adb41-4c36-4158-bdea-a57f9fb3627a admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:05.151634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d33641-b7ec-43f3-8a0c-e04cf310079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:05.152454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d33641-b7ec-43f3-8a0c-e04cf310079d admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:05.152744 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d33641-b7ec-43f3-8a0c-e04cf310079d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:05.153067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d33641-b7ec-43f3-8a0c-e04cf310079d admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:05.153925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d33641-b7ec-43f3-8a0c-e04cf310079d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:05.155953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d33641-b7ec-43f3-8a0c-e04cf310079d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:05.199738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 992/1981] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:05 2022] POST /identity/v3/projects => generated 391 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:05.203881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec86da-d440-4a4b-9d76-76a519be9040 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:05.217406 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec86da-d440-4a4b-9d76-76a519be9040 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:05.287331 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b2b0f-4bc6-4899-9ab4-effa5bd64909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:05.288134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b2b0f-4bc6-4899-9ab4-effa5bd64909 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:05.290267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b2b0f-4bc6-4899-9ab4-effa5bd64909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:05.290267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b2b0f-4bc6-4899-9ab4-effa5bd64909 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:05.290267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b2b0f-4bc6-4899-9ab4-effa5bd64909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:05.297144 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b2b0f-4bc6-4899-9ab4-effa5bd64909 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:05.317068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 990/1982] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:05 2022] POST /identity/v3/users => generated 302 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:21:05.321848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d33641-b7ec-43f3-8a0c-e04cf310079d admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:05.334202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d33641-b7ec-43f3-8a0c-e04cf310079d admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:05.339080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739f6bf-6c1d-4b86-b726-4c4cf476edee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:05.339819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739f6bf-6c1d-4b86-b726-4c4cf476edee admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:05.340048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739f6bf-6c1d-4b86-b726-4c4cf476edee admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:05.340727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739f6bf-6c1d-4b86-b726-4c4cf476edee admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:05.341666 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739f6bf-6c1d-4b86-b726-4c4cf476edee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:05.343331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739f6bf-6c1d-4b86-b726-4c4cf476edee admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:05.356953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 993/1983] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:05.362539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b2b0f-4bc6-4899-9ab4-effa5bd64909 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:05.383721 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b2b0f-4bc6-4899-9ab4-effa5bd64909 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:05.391050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e9a17-6fb8-45e7-a340-3d755feb9763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:05.392189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e9a17-6fb8-45e7-a340-3d755feb9763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:05.392795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e9a17-6fb8-45e7-a340-3d755feb9763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:05.393062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e9a17-6fb8-45e7-a340-3d755feb9763 admin admin] PATH_INFO: `/v3/projects/fecb3a3f962f4f668aee767162fabd89/users/724ae3dcb23d4711bbbad85d25dd0684/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:05.411221 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e9a17-6fb8-45e7-a340-3d755feb9763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fecb3a3f962f4f668aee767162fabd89, user_id=724ae3dcb23d4711bbbad85d25dd0684, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:05.417757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e9a17-6fb8-45e7-a340-3d755feb9763 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:05.447484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 991/1984] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:05 2022] PUT /identity/v3/projects/fecb3a3f962f4f668aee767162fabd89/users/724ae3dcb23d4711bbbad85d25dd0684/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:05.447716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739f6bf-6c1d-4b86-b726-4c4cf476edee admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:05.465077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739f6bf-6c1d-4b86-b726-4c4cf476edee admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:05.572827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745863c4-2d8d-41c1-aa92-c1ceb3f7e51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:05.573670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745863c4-2d8d-41c1-aa92-c1ceb3f7e51f admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:05.573998 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745863c4-2d8d-41c1-aa92-c1ceb3f7e51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:05.574526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745863c4-2d8d-41c1-aa92-c1ceb3f7e51f admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:05.575423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745863c4-2d8d-41c1-aa92-c1ceb3f7e51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:05.577152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745863c4-2d8d-41c1-aa92-c1ceb3f7e51f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:05.590314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 994/1985] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:05.594726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e9a17-6fb8-45e7-a340-3d755feb9763 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:05.606623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e9a17-6fb8-45e7-a340-3d755feb9763 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:05.614018 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cd178-7835-4eb7-942b-25c3be64386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:05.615820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cd178-7835-4eb7-942b-25c3be64386b admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:05.616436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cd178-7835-4eb7-942b-25c3be64386b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:05.616965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cd178-7835-4eb7-942b-25c3be64386b admin admin] PATH_INFO: `/v3/projects/fecb3a3f962f4f668aee767162fabd89/users/724ae3dcb23d4711bbbad85d25dd0684/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:05.620688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cd178-7835-4eb7-942b-25c3be64386b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fecb3a3f962f4f668aee767162fabd89, user_id=724ae3dcb23d4711bbbad85d25dd0684, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:05.624757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cd178-7835-4eb7-942b-25c3be64386b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:05.639397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 992/1986] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:05 2022] PUT /identity/v3/projects/fecb3a3f962f4f668aee767162fabd89/users/724ae3dcb23d4711bbbad85d25dd0684/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:05.650775 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440202-055e-4c61-81f0-d8520e4b88e4 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:05.651081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440202-055e-4c61-81f0-d8520e4b88e4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:05.651469 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440202-055e-4c61-81f0-d8520e4b88e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:05.683587 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-80440202-055e-4c61-81f0-d8520e4b88e4 None None] MFA Rules not processed for user `724ae3dcb23d4711bbbad85d25dd0684`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:05.684879 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-80440202-055e-4c61-81f0-d8520e4b88e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:05.831796 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cd178-7835-4eb7-942b-25c3be64386b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:05.834989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e36cd178-7835-4eb7-942b-25c3be64386b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:05.835425 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 995/1987] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:05.916688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cd178-7835-4eb7-942b-25c3be64386b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:05.923717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427f824-6078-4b5c-8d84-8fa7b50e39d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:05.924516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427f824-6078-4b5c-8d84-8fa7b50e39d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:05.924873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427f824-6078-4b5c-8d84-8fa7b50e39d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:05.925253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427f824-6078-4b5c-8d84-8fa7b50e39d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:05.934921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:05.938392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427f824-6078-4b5c-8d84-8fa7b50e39d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:05.940175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427f824-6078-4b5c-8d84-8fa7b50e39d7 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:05.955688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 993/1988] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:06.112558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440202-055e-4c61-81f0-d8520e4b88e4 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:06.120086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:06.126493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440202-055e-4c61-81f0-d8520e4b88e4 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:06.134150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d1d56-7d87-4eb1-8800-3a4da01702b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:06.134907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d1d56-7d87-4eb1-8800-3a4da01702b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:06.135206 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d1d56-7d87-4eb1-8800-3a4da01702b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:06.135464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d1d56-7d87-4eb1-8800-3a4da01702b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:06.293385 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d1d56-7d87-4eb1-8800-3a4da01702b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:06.295196 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d1d56-7d87-4eb1-8800-3a4da01702b3 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:06.308370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 996/1989] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:06.989528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427f824-6078-4b5c-8d84-8fa7b50e39d7 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:06.991167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1427f824-6078-4b5c-8d84-8fa7b50e39d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:07.228050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427f824-6078-4b5c-8d84-8fa7b50e39d7 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:07.242559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:07.244975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:07.247699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:07.248014 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] PATH_INFO: `/v3/users/92f51de043d24b809bf81a87453afdfd` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:07.253981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f51de043d24b809bf81a87453afdfd)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:07.256053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:07.361631 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f51de043d24b809bf81a87453afdfd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:07.364621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f51de043d24b809bf81a87453afdfd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:07.366301 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f51de043d24b809bf81a87453afdfd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:07.386609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f51de043d24b809bf81a87453afdfd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:07.417847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f51de043d24b809bf81a87453afdfd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:07.482714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 994/1990] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:06 2022] DELETE /identity/v3/users/92f51de043d24b809bf81a87453afdfd => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:07.484812 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e556-cccf-4544-9a70-f0f2070aac3d None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:07.485682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e556-cccf-4544-9a70-f0f2070aac3d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:07.485682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e556-cccf-4544-9a70-f0f2070aac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:07.527550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1a16e556-cccf-4544-9a70-f0f2070aac3d None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:07.529912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1a16e556-cccf-4544-9a70-f0f2070aac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:07.713105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 997/1991] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:07.731636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:07.733624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:07.880921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32693344-72df-40b1-bbd2-491f89b2e667 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:07.887732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b892a-4485-46ae-a756-97b91111fb23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:07.889257 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b892a-4485-46ae-a756-97b91111fb23 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:07.889771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b892a-4485-46ae-a756-97b91111fb23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:07.890177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b892a-4485-46ae-a756-97b91111fb23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:07.905934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b892a-4485-46ae-a756-97b91111fb23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:07.907970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b892a-4485-46ae-a756-97b91111fb23 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:07.925455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 995/1992] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:21:08.744903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16e556-cccf-4544-9a70-f0f2070aac3d None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:08.746526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1a16e556-cccf-4544-9a70-f0f2070aac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:08.767381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16e556-cccf-4544-9a70-f0f2070aac3d None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:08.781871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:08.784916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:08.785880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:08.786468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] PATH_INFO: `/v3/users/53a527396ec84ca3872015d165453e64` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:08.789658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a527396ec84ca3872015d165453e64)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:08.794551 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:08.893540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a527396ec84ca3872015d165453e64'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:08.894343 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a527396ec84ca3872015d165453e64'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:08.895581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a527396ec84ca3872015d165453e64'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:08.910948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a527396ec84ca3872015d165453e64'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:08.926474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a527396ec84ca3872015d165453e64'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:09.000586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 998/1993] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:08 2022] DELETE /identity/v3/users/53a527396ec84ca3872015d165453e64 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:09.008975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fe536-e431-4a0e-b03c-e48bb59d8a9d None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:09.010178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fe536-e431-4a0e-b03c-e48bb59d8a9d None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:09.011120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fe536-e431-4a0e-b03c-e48bb59d8a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:09.049834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-797fe536-e431-4a0e-b03c-e48bb59d8a9d None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:09.051658 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-797fe536-e431-4a0e-b03c-e48bb59d8a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:09.100048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:09.233366 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 996/1994] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:09.254198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:09.260595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:09.301093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:09.307435 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fe536-e431-4a0e-b03c-e48bb59d8a9d None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:09.310695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-797fe536-e431-4a0e-b03c-e48bb59d8a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:09.364892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fe536-e431-4a0e-b03c-e48bb59d8a9d None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:09.365176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9542790-1e27-48d6-996d-a4abe613a509 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:09.370556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b71288-d4e4-47b0-9c0e-91c23914e51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:09.371247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b71288-d4e4-47b0-9c0e-91c23914e51e service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:09.371530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b71288-d4e4-47b0-9c0e-91c23914e51e service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:09.371857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b71288-d4e4-47b0-9c0e-91c23914e51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:09.385822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b71288-d4e4-47b0-9c0e-91c23914e51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:09.387481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b71288-d4e4-47b0-9c0e-91c23914e51e service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:09.419367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:09.420979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:09.427978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 999/1995] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:09.430362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:09.431957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] PATH_INFO: `/v3/projects/623c673a37c04c1b88d00f1b68673154` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:09.436138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=623c673a37c04c1b88d00f1b68673154)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:09.451330 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:09.606326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623c673a37c04c1b88d00f1b68673154', 'request_id': 'req-af3e6429-f760-473f-9ebe-d2b0b81f8a51'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:09.619810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623c673a37c04c1b88d00f1b68673154', 'request_id': 'req-af3e6429-f760-473f-9ebe-d2b0b81f8a51'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:09.633996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623c673a37c04c1b88d00f1b68673154', 'request_id': 'req-af3e6429-f760-473f-9ebe-d2b0b81f8a51'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:09.670158 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] The token cache is being invalidate because project 623c673a37c04c1b88d00f1b68673154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:09.670684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:09.672292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:09.675957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 997/1996] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:09 2022] DELETE /identity/v3/projects/623c673a37c04c1b88d00f1b68673154 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:09.681278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b71288-d4e4-47b0-9c0e-91c23914e51e service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:09.703603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b71288-d4e4-47b0-9c0e-91c23914e51e service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:09.917663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:09.919582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:09.919725 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:09.920201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] PATH_INFO: `/v3/users/b2f3c38c09844e72aa4a89042938ec2c` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:09.931666 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f3c38c09844e72aa4a89042938ec2c)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:09.931666 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:10.074936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f3c38c09844e72aa4a89042938ec2c'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:10.076582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f3c38c09844e72aa4a89042938ec2c'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:10.077049 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f3c38c09844e72aa4a89042938ec2c'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:10.113816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f3c38c09844e72aa4a89042938ec2c'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:10.128607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f3c38c09844e72aa4a89042938ec2c'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:10.153192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1000/1997] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:09 2022] DELETE /identity/v3/users/b2f3c38c09844e72aa4a89042938ec2c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:10.704551 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:10.710089 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:10.783632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e6429-f760-473f-9ebe-d2b0b81f8a51 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:10.889152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:10.890102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:10.890392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:10.890669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] PATH_INFO: `/v3/projects/97727eadd2db48ff8f610cc8f759fec9` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:10.892378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] RBAC: Authorizing `identity:delete_project(project_id=97727eadd2db48ff8f610cc8f759fec9)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:10.893869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:10.955178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:10.962791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97727eadd2db48ff8f610cc8f759fec9', 'request_id': 'req-1f2732d1-beeb-4df6-8509-9e1781ad208f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:10.973113 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97727eadd2db48ff8f610cc8f759fec9', 'request_id': 'req-1f2732d1-beeb-4df6-8509-9e1781ad208f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:10.985796 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97727eadd2db48ff8f610cc8f759fec9', 'request_id': 'req-1f2732d1-beeb-4df6-8509-9e1781ad208f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.006021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] The token cache is being invalidate because project 97727eadd2db48ff8f610cc8f759fec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:11.006820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.007951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.013052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 998/1998] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:10 2022] DELETE /identity/v3/projects/97727eadd2db48ff8f610cc8f759fec9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:11.017031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:11.018582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:11.044198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b21a3c-a0fd-4eea-a766-04dc96412f8b admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:11.129175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:11.177533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:11.179349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:11.180186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:11.180681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] PATH_INFO: `/v3/users/def4ab015b794cf1af96d315cc5cb141` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:11.184111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def4ab015b794cf1af96d315cc5cb141)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:11.188356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:11.287028 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def4ab015b794cf1af96d315cc5cb141'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.287901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def4ab015b794cf1af96d315cc5cb141'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.288943 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def4ab015b794cf1af96d315cc5cb141'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.299735 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def4ab015b794cf1af96d315cc5cb141'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.314400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def4ab015b794cf1af96d315cc5cb141'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.342208 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1001/1999] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:11 2022] DELETE /identity/v3/users/def4ab015b794cf1af96d315cc5cb141 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:11.501270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:11.502978 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:11.525080 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2732d1-beeb-4df6-8509-9e1781ad208f admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:11.697404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:11.700248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:11.700558 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:11.700810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] PATH_INFO: `/v3/projects/88c0db2bd8484883ae8e71d1964108f7` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:11.706588 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c0db2bd8484883ae8e71d1964108f7)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:11.710848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:11.845006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c0db2bd8484883ae8e71d1964108f7', 'request_id': 'req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.857754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c0db2bd8484883ae8e71d1964108f7', 'request_id': 'req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.876624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c0db2bd8484883ae8e71d1964108f7', 'request_id': 'req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.895666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] The token cache is being invalidate because project 88c0db2bd8484883ae8e71d1964108f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:11.895961 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.896759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:11.902016 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 999/2000] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:11 2022] DELETE /identity/v3/projects/88c0db2bd8484883ae8e71d1964108f7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:11.903129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:11.904635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:11.917806 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:11.919309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:11.934261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9641f-955b-4893-bcac-2e516887a231 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:12.073610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1396d6f-4fbc-4b12-84eb-48cf2fce5320 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:12.077056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b294c5f-ff29-4d90-8041-150e0b1413f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:12.078669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b294c5f-ff29-4d90-8041-150e0b1413f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:12.079149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b294c5f-ff29-4d90-8041-150e0b1413f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:12.079950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b294c5f-ff29-4d90-8041-150e0b1413f1 admin admin] PATH_INFO: `/v3/users/72696d58deca488092e6f1f7f7ff23d5` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:12.081479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b294c5f-ff29-4d90-8041-150e0b1413f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72696d58deca488092e6f1f7f7ff23d5)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:12.083701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b294c5f-ff29-4d90-8041-150e0b1413f1 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:12.092935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:12.109480 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:12.109822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:12.110043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] PATH_INFO: `/v3/users/096e61c406f34ce8b1f2049675332e1b` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:12.115232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=096e61c406f34ce8b1f2049675332e1b)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:12.117459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:12.124721 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:12.197817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1b294c5f-ff29-4d90-8041-150e0b1413f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72696d58deca488092e6f1f7f7ff23d5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.201490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1b294c5f-ff29-4d90-8041-150e0b1413f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72696d58deca488092e6f1f7f7ff23d5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.205079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1b294c5f-ff29-4d90-8041-150e0b1413f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72696d58deca488092e6f1f7f7ff23d5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.222678 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1b294c5f-ff29-4d90-8041-150e0b1413f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72696d58deca488092e6f1f7f7ff23d5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.228091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:12.232084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096e61c406f34ce8b1f2049675332e1b'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.233168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096e61c406f34ce8b1f2049675332e1b'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.234445 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096e61c406f34ce8b1f2049675332e1b'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.249933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1b294c5f-ff29-4d90-8041-150e0b1413f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72696d58deca488092e6f1f7f7ff23d5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.263649 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096e61c406f34ce8b1f2049675332e1b'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.286293 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096e61c406f34ce8b1f2049675332e1b'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.311826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1002/2001] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:11 2022] DELETE /identity/v3/users/72696d58deca488092e6f1f7f7ff23d5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:12.328933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1000/2002] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:11 2022] DELETE /identity/v3/users/096e61c406f34ce8b1f2049675332e1b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:12.334329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea2118-63c8-406a-95f8-53789251571c None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:12.335328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea2118-63c8-406a-95f8-53789251571c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:12.335858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea2118-63c8-406a-95f8-53789251571c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:12.386091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-c8ea2118-63c8-406a-95f8-53789251571c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:12.389911 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c8ea2118-63c8-406a-95f8-53789251571c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:12.435343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:12.437303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:12.502373 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1003/2003] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:12.516065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea2118-63c8-406a-95f8-53789251571c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:12.518237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c8ea2118-63c8-406a-95f8-53789251571c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:12.559486 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14c249-52f4-410e-8e4b-02eb05196786 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:12.567870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d9141-80c5-4755-bd2a-05537114749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:12.568777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d9141-80c5-4755-bd2a-05537114749e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:12.569250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d9141-80c5-4755-bd2a-05537114749e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:12.569822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d9141-80c5-4755-bd2a-05537114749e admin admin] PATH_INFO: `/v3/projects/e39068ca64854096be2690fb9209d732` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:12.571771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d9141-80c5-4755-bd2a-05537114749e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39068ca64854096be2690fb9209d732)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:12.575025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d9141-80c5-4755-bd2a-05537114749e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:12.620050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea2118-63c8-406a-95f8-53789251571c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:12.631256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59718178-9f48-419a-bbe0-e81b5f707146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:12.633892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59718178-9f48-419a-bbe0-e81b5f707146 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:12.634525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59718178-9f48-419a-bbe0-e81b5f707146 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:12.634988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59718178-9f48-419a-bbe0-e81b5f707146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:12.652058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59718178-9f48-419a-bbe0-e81b5f707146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:12.654382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59718178-9f48-419a-bbe0-e81b5f707146 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:12.678749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-dc7d9141-80c5-4755-bd2a-05537114749e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39068ca64854096be2690fb9209d732', 'request_id': 'req-dc7d9141-80c5-4755-bd2a-05537114749e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.688319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1004/2004] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:12.697431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-dc7d9141-80c5-4755-bd2a-05537114749e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39068ca64854096be2690fb9209d732', 'request_id': 'req-dc7d9141-80c5-4755-bd2a-05537114749e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.709719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-dc7d9141-80c5-4755-bd2a-05537114749e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39068ca64854096be2690fb9209d732', 'request_id': 'req-dc7d9141-80c5-4755-bd2a-05537114749e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.730048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-dc7d9141-80c5-4755-bd2a-05537114749e admin admin] The token cache is being invalidate because project e39068ca64854096be2690fb9209d732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:12.730390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-dc7d9141-80c5-4755-bd2a-05537114749e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.731151 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-dc7d9141-80c5-4755-bd2a-05537114749e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:12.737505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1001/2005] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:12 2022] DELETE /identity/v3/projects/e39068ca64854096be2690fb9209d732 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:12.740757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba41e5e-b17e-4260-bcc4-aad75a804919 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:12.741053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba41e5e-b17e-4260-bcc4-aad75a804919 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:12.741367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba41e5e-b17e-4260-bcc4-aad75a804919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:12.770420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-dba41e5e-b17e-4260-bcc4-aad75a804919 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:12.772027 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-dba41e5e-b17e-4260-bcc4-aad75a804919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:12.896156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1005/2006] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:12.898102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa601d-eefe-4565-b6d6-1c21097e3344 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:12.898398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa601d-eefe-4565-b6d6-1c21097e3344 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:12.898697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa601d-eefe-4565-b6d6-1c21097e3344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:12.930040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c8aa601d-eefe-4565-b6d6-1c21097e3344 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:12.933022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c8aa601d-eefe-4565-b6d6-1c21097e3344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:12.955719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1002/2007] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:12.957002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba41e5e-b17e-4260-bcc4-aad75a804919 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:12.974765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba41e5e-b17e-4260-bcc4-aad75a804919 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:12.988250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d82be-7ae3-4913-9e15-f012705e8d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:12.989059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d82be-7ae3-4913-9e15-f012705e8d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:12.990029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d82be-7ae3-4913-9e15-f012705e8d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:12.990029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d82be-7ae3-4913-9e15-f012705e8d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:12.990571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d82be-7ae3-4913-9e15-f012705e8d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:21:12.990896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d82be-7ae3-4913-9e15-f012705e8d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:12.993920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d82be-7ae3-4913-9e15-f012705e8d88 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:13.018783 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1006/2008] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:21:13.020072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa601d-eefe-4565-b6d6-1c21097e3344 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:13.030782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:13.039349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa601d-eefe-4565-b6d6-1c21097e3344 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:13.047209 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780f0c1-bf1c-42b5-ae7e-d5c2085ff7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:13.048075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f0c1-bf1c-42b5-ae7e-d5c2085ff7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:13.048427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f0c1-bf1c-42b5-ae7e-d5c2085ff7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:13.048812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f0c1-bf1c-42b5-ae7e-d5c2085ff7d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:13.050508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780f0c1-bf1c-42b5-ae7e-d5c2085ff7d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:13.053028 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780f0c1-bf1c-42b5-ae7e-d5c2085ff7d1 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:13.099363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1003/2009] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:13 2022] POST /identity/v3/projects => generated 363 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:21:13.100874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d82be-7ae3-4913-9e15-f012705e8d88 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:13.113728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d82be-7ae3-4913-9e15-f012705e8d88 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:13.118796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:13.274875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a1836-8c7c-413e-8467-229e816f1d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:13.275694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a1836-8c7c-413e-8467-229e816f1d57 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:13.276105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a1836-8c7c-413e-8467-229e816f1d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:13.276541 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a1836-8c7c-413e-8467-229e816f1d57 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:13.277709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a1836-8c7c-413e-8467-229e816f1d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:13.280132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a1836-8c7c-413e-8467-229e816f1d57 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:13.317262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1007/2010] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:13 2022] POST /identity/v3/users => generated 282 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:13.318559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780f0c1-bf1c-42b5-ae7e-d5c2085ff7d1 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:13.337407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780f0c1-bf1c-42b5-ae7e-d5c2085ff7d1 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:13.344305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0c4dc-af01-4ef5-a6dd-1480a4a4fff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:13.345442 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0c4dc-af01-4ef5-a6dd-1480a4a4fff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:13.346513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0c4dc-af01-4ef5-a6dd-1480a4a4fff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:13.346963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0c4dc-af01-4ef5-a6dd-1480a4a4fff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:13.348197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0c4dc-af01-4ef5-a6dd-1480a4a4fff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:13.350851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0c4dc-af01-4ef5-a6dd-1480a4a4fff0 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:13.381590 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1004/2011] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:13.386056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a1836-8c7c-413e-8467-229e816f1d57 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:13.406545 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a1836-8c7c-413e-8467-229e816f1d57 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:13.419745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f1e1f-8a02-4d76-bce2-5b4653568478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:13.421618 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f1e1f-8a02-4d76-bce2-5b4653568478 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:13.421999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f1e1f-8a02-4d76-bce2-5b4653568478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:13.422420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f1e1f-8a02-4d76-bce2-5b4653568478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:13.423191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f1e1f-8a02-4d76-bce2-5b4653568478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:13.426733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f1e1f-8a02-4d76-bce2-5b4653568478 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:13.441943 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1008/2012] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:13.448077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0c4dc-af01-4ef5-a6dd-1480a4a4fff0 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:13.460708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0c4dc-af01-4ef5-a6dd-1480a4a4fff0 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:13.466151 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcac7c6-9e74-4ac7-9c5b-54dd29b8725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:13.468206 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f1e1f-8a02-4d76-bce2-5b4653568478 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:13.470129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-146f1e1f-8a02-4d76-bce2-5b4653568478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:13.475078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcac7c6-9e74-4ac7-9c5b-54dd29b8725d admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:13.478849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcac7c6-9e74-4ac7-9c5b-54dd29b8725d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:13.480173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcac7c6-9e74-4ac7-9c5b-54dd29b8725d admin admin] PATH_INFO: `/v3/projects/9367f5eb594c40ae908bc1c165680d8e/users/cc5c8f94e3ca433e9f022781e5d7e85d/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:13.494785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f1e1f-8a02-4d76-bce2-5b4653568478 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:13.505465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0371325-a01b-4b6e-89f2-e236d1152913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:13.506566 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371325-a01b-4b6e-89f2-e236d1152913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:13.506925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371325-a01b-4b6e-89f2-e236d1152913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:13.507283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371325-a01b-4b6e-89f2-e236d1152913 admin admin] PATH_INFO: `/v3/projects/8610fcbc4b24440ca5a37f331a8ddc2c` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:13.510427 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0371325-a01b-4b6e-89f2-e236d1152913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8610fcbc4b24440ca5a37f331a8ddc2c)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:13.515331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0371325-a01b-4b6e-89f2-e236d1152913 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:13.518075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcac7c6-9e74-4ac7-9c5b-54dd29b8725d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9367f5eb594c40ae908bc1c165680d8e, user_id=cc5c8f94e3ca433e9f022781e5d7e85d, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:13.523144 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcac7c6-9e74-4ac7-9c5b-54dd29b8725d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:13.545319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1005/2013] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:13 2022] PUT /identity/v3/projects/9367f5eb594c40ae908bc1c165680d8e/users/cc5c8f94e3ca433e9f022781e5d7e85d/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:13.568296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf69a7-4244-410e-9ede-a4330e7cd764 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:13.568759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf69a7-4244-410e-9ede-a4330e7cd764 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:13.569052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf69a7-4244-410e-9ede-a4330e7cd764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:13.623224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-8baf69a7-4244-410e-9ede-a4330e7cd764 None None] MFA Rules not processed for user `cc5c8f94e3ca433e9f022781e5d7e85d`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:13.624594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8baf69a7-4244-410e-9ede-a4330e7cd764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:13.643561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f0371325-a01b-4b6e-89f2-e236d1152913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8610fcbc4b24440ca5a37f331a8ddc2c', 'request_id': 'req-f0371325-a01b-4b6e-89f2-e236d1152913'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:13.655797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f0371325-a01b-4b6e-89f2-e236d1152913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8610fcbc4b24440ca5a37f331a8ddc2c', 'request_id': 'req-f0371325-a01b-4b6e-89f2-e236d1152913'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:13.673271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f0371325-a01b-4b6e-89f2-e236d1152913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8610fcbc4b24440ca5a37f331a8ddc2c', 'request_id': 'req-f0371325-a01b-4b6e-89f2-e236d1152913'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:13.698865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f0371325-a01b-4b6e-89f2-e236d1152913 admin admin] The token cache is being invalidate because project 8610fcbc4b24440ca5a37f331a8ddc2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:13.699543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f0371325-a01b-4b6e-89f2-e236d1152913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:13.700559 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f0371325-a01b-4b6e-89f2-e236d1152913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:13.702873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1009/2014] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:13 2022] DELETE /identity/v3/projects/8610fcbc4b24440ca5a37f331a8ddc2c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:13.709173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad8592-8d41-43bc-ae1e-c2892a4cf840 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:13.709863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad8592-8d41-43bc-ae1e-c2892a4cf840 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:13.710448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad8592-8d41-43bc-ae1e-c2892a4cf840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:13.720992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1006/2015] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:13.735457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf69a7-4244-410e-9ede-a4330e7cd764 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:13.737007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8baf69a7-4244-410e-9ede-a4330e7cd764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:13.747170 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-f1ad8592-8d41-43bc-ae1e-c2892a4cf840 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:13.748525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f1ad8592-8d41-43bc-ae1e-c2892a4cf840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:13.811792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf69a7-4244-410e-9ede-a4330e7cd764 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:13.817543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3380a-96a1-4448-b2a4-0a0912dafdf4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6af41d833941debd6afcecd952af0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:13.817777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3380a-96a1-4448-b2a4-0a0912dafdf4 service glance] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:13.818119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3380a-96a1-4448-b2a4-0a0912dafdf4 service glance] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:13.818404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3380a-96a1-4448-b2a4-0a0912dafdf4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:13.833047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f7f3380a-96a1-4448-b2a4-0a0912dafdf4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:13.848785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3380a-96a1-4448-b2a4-0a0912dafdf4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:13.850580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3380a-96a1-4448-b2a4-0a0912dafdf4 service glance] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:13.853800 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1010/2016] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:13.854946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad8592-8d41-43bc-ae1e-c2892a4cf840 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:13.856228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f1ad8592-8d41-43bc-ae1e-c2892a4cf840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:13.866998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1007/2017] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:13 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:13.868370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad8592-8d41-43bc-ae1e-c2892a4cf840 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:13.870324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813ca5-b210-4261-a6b6-f082918353df None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:13.871619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813ca5-b210-4261-a6b6-f082918353df None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:13.871917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813ca5-b210-4261-a6b6-f082918353df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:13.873473 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:13.874526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:13.875298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:13.875728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] PATH_INFO: `/v3/projects/30b44b0effc145d9ab110fd592e3ee05` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:13.878112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b44b0effc145d9ab110fd592e3ee05)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:13.880222 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:13.883169 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:13.903700 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-6a813ca5-b210-4261-a6b6-f082918353df None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:13.913587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6a813ca5-b210-4261-a6b6-f082918353df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:13.946497 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1008/2018] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:13.947588 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813ca5-b210-4261-a6b6-f082918353df None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:13.961340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813ca5-b210-4261-a6b6-f082918353df None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:13.963012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b44b0effc145d9ab110fd592e3ee05', 'request_id': 'req-da187961-10b1-491c-a73c-595868cd367a'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:13.981547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b44b0effc145d9ab110fd592e3ee05', 'request_id': 'req-da187961-10b1-491c-a73c-595868cd367a'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:13.993146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b44b0effc145d9ab110fd592e3ee05', 'request_id': 'req-da187961-10b1-491c-a73c-595868cd367a'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:13.997844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:14.008192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] The token cache is being invalidate because project 30b44b0effc145d9ab110fd592e3ee05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:14.008512 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:14.009186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:14.013797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1011/2019] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:13 2022] DELETE /identity/v3/projects/30b44b0effc145d9ab110fd592e3ee05 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:14.014954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.016409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:14.038001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a3dce-fd37-4eb6-aa4f-2c4b04ed3cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.039255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a3dce-fd37-4eb6-aa4f-2c4b04ed3cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.039255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a3dce-fd37-4eb6-aa4f-2c4b04ed3cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.039633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a3dce-fd37-4eb6-aa4f-2c4b04ed3cd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.040344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a3dce-fd37-4eb6-aa4f-2c4b04ed3cd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:21:14.040792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a3dce-fd37-4eb6-aa4f-2c4b04ed3cd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:14.042629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a3dce-fd37-4eb6-aa4f-2c4b04ed3cd2 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:14.061632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1009/2020] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:21:14.064291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a3dce-fd37-4eb6-aa4f-2c4b04ed3cd2 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.066756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-528a3dce-fd37-4eb6-aa4f-2c4b04ed3cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:14.086589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a3dce-fd37-4eb6-aa4f-2c4b04ed3cd2 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:14.093502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc36cae-cca8-4c09-b0d6-16c5bd544435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.093815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc36cae-cca8-4c09-b0d6-16c5bd544435 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.094178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc36cae-cca8-4c09-b0d6-16c5bd544435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.094471 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc36cae-cca8-4c09-b0d6-16c5bd544435 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.095180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc36cae-cca8-4c09-b0d6-16c5bd544435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:14.097541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc36cae-cca8-4c09-b0d6-16c5bd544435 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:14.128050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da187961-10b1-491c-a73c-595868cd367a admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:14.139022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.139967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.140345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.140516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] PATH_INFO: `/v3/users/724ae3dcb23d4711bbbad85d25dd0684` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.141851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=724ae3dcb23d4711bbbad85d25dd0684)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:14.145288 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1010/2021] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:14 2022] POST /identity/v3/projects => generated 407 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:14.145522 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:14.151175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc36cae-cca8-4c09-b0d6-16c5bd544435 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.214958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724ae3dcb23d4711bbbad85d25dd0684'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:14.216313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724ae3dcb23d4711bbbad85d25dd0684'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:14.217696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724ae3dcb23d4711bbbad85d25dd0684'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:14.227132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724ae3dcb23d4711bbbad85d25dd0684'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:14.230058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc36cae-cca8-4c09-b0d6-16c5bd544435 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:14.236358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724ae3dcb23d4711bbbad85d25dd0684'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:14.237917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e77de-4dc1-4cc4-8f29-ba50554e00e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.238970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e77de-4dc1-4cc4-8f29-ba50554e00e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.238970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e77de-4dc1-4cc4-8f29-ba50554e00e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.239353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e77de-4dc1-4cc4-8f29-ba50554e00e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.239957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e77de-4dc1-4cc4-8f29-ba50554e00e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:14.242610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e77de-4dc1-4cc4-8f29-ba50554e00e4 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:14.263160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1012/2022] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:14 2022] DELETE /identity/v3/users/724ae3dcb23d4711bbbad85d25dd0684 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:14.266389 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1011/2023] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:14 2022] POST /identity/v3/users => generated 304 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:14.271360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.274784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:14.300793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:14.404456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57e44-2747-4873-a733-cb2691dcd010 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:14.411488 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d64b23-20ba-4eb3-8154-f176e6e1e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.412605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64b23-20ba-4eb3-8154-f176e6e1e569 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.412963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64b23-20ba-4eb3-8154-f176e6e1e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.413308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64b23-20ba-4eb3-8154-f176e6e1e569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.414344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d64b23-20ba-4eb3-8154-f176e6e1e569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:14.416412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d64b23-20ba-4eb3-8154-f176e6e1e569 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:14.428793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1013/2024] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:14.432836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e77de-4dc1-4cc4-8f29-ba50554e00e4 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.459552 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e77de-4dc1-4cc4-8f29-ba50554e00e4 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:14.477425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d9394-1f69-484c-83d5-bb0c8d059258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.478167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9394-1f69-484c-83d5-bb0c8d059258 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.478394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9394-1f69-484c-83d5-bb0c8d059258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.478684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9394-1f69-484c-83d5-bb0c8d059258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.479462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d9394-1f69-484c-83d5-bb0c8d059258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:14.481085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d9394-1f69-484c-83d5-bb0c8d059258 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:14.497035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1012/2025] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:14.497961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d64b23-20ba-4eb3-8154-f176e6e1e569 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.517620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d64b23-20ba-4eb3-8154-f176e6e1e569 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:14.523659 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b14ac5-8c35-4b5f-ad01-65e7b0b086bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.524659 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b14ac5-8c35-4b5f-ad01-65e7b0b086bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.525463 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b14ac5-8c35-4b5f-ad01-65e7b0b086bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.525463 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b14ac5-8c35-4b5f-ad01-65e7b0b086bf admin admin] PATH_INFO: `/v3/projects/03106f0387f74253bdfb11d2cabf5c56/users/bbf3613d51e547e3a5d43ededd2804c1/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.549514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b14ac5-8c35-4b5f-ad01-65e7b0b086bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=03106f0387f74253bdfb11d2cabf5c56, user_id=bbf3613d51e547e3a5d43ededd2804c1, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:14.552956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b14ac5-8c35-4b5f-ad01-65e7b0b086bf admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:14.571869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1014/2026] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:14 2022] PUT /identity/v3/projects/03106f0387f74253bdfb11d2cabf5c56/users/bbf3613d51e547e3a5d43ededd2804c1/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:14.585001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8ab70-0ef8-4a97-89f7-94495f1b5467 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.585317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8ab70-0ef8-4a97-89f7-94495f1b5467 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.585602 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8ab70-0ef8-4a97-89f7-94495f1b5467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.620017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-04c8ab70-0ef8-4a97-89f7-94495f1b5467 None None] MFA Rules not processed for user `bbf3613d51e547e3a5d43ededd2804c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:14.621408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-04c8ab70-0ef8-4a97-89f7-94495f1b5467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:14.623649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b14ac5-8c35-4b5f-ad01-65e7b0b086bf admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.625532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f9b14ac5-8c35-4b5f-ad01-65e7b0b086bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:14.697822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b14ac5-8c35-4b5f-ad01-65e7b0b086bf admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:14.698446 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1013/2027] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:14.703200 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8ab70-0ef8-4a97-89f7-94495f1b5467 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.711228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b29c5-cf7b-43d8-bfc9-19b54f712321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.712280 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b29c5-cf7b-43d8-bfc9-19b54f712321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.712684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b29c5-cf7b-43d8-bfc9-19b54f712321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.713109 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b29c5-cf7b-43d8-bfc9-19b54f712321 admin admin] PATH_INFO: `/v3/projects/fecb3a3f962f4f668aee767162fabd89` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.714499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b29c5-cf7b-43d8-bfc9-19b54f712321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fecb3a3f962f4f668aee767162fabd89)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:14.716375 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8ab70-0ef8-4a97-89f7-94495f1b5467 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:14.716652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b29c5-cf7b-43d8-bfc9-19b54f712321 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:14.721669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d81eab-4c5a-46fe-83bc-dc265b86dee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.723300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d81eab-4c5a-46fe-83bc-dc265b86dee4 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.723684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d81eab-4c5a-46fe-83bc-dc265b86dee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.724037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d81eab-4c5a-46fe-83bc-dc265b86dee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.724811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d81eab-4c5a-46fe-83bc-dc265b86dee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:14.727350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d81eab-4c5a-46fe-83bc-dc265b86dee4 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:14.739435 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:14.776388 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1014/2028] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:14 2022] POST /identity/v3/projects => generated 407 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:14.778246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d81eab-4c5a-46fe-83bc-dc265b86dee4 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.789113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-387b29c5-cf7b-43d8-bfc9-19b54f712321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fecb3a3f962f4f668aee767162fabd89', 'request_id': 'req-387b29c5-cf7b-43d8-bfc9-19b54f712321'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:14.801880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-387b29c5-cf7b-43d8-bfc9-19b54f712321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fecb3a3f962f4f668aee767162fabd89', 'request_id': 'req-387b29c5-cf7b-43d8-bfc9-19b54f712321'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:14.812188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-387b29c5-cf7b-43d8-bfc9-19b54f712321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fecb3a3f962f4f668aee767162fabd89', 'request_id': 'req-387b29c5-cf7b-43d8-bfc9-19b54f712321'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:14.831804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-387b29c5-cf7b-43d8-bfc9-19b54f712321 admin admin] The token cache is being invalidate because project fecb3a3f962f4f668aee767162fabd89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:14.832271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-387b29c5-cf7b-43d8-bfc9-19b54f712321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:14.833295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-387b29c5-cf7b-43d8-bfc9-19b54f712321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:14.837316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1015/2029] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:14 2022] DELETE /identity/v3/projects/fecb3a3f962f4f668aee767162fabd89 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:14.843572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3dac7-33f2-4478-9fe6-6abed7df4e97 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.844325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3dac7-33f2-4478-9fe6-6abed7df4e97 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.845074 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3dac7-33f2-4478-9fe6-6abed7df4e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.877255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-08e3dac7-33f2-4478-9fe6-6abed7df4e97 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:14.879425 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-08e3dac7-33f2-4478-9fe6-6abed7df4e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:14.884838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d81eab-4c5a-46fe-83bc-dc265b86dee4 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:14.893704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e64d9-242a-4e9d-9408-ea0be972e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.894543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e64d9-242a-4e9d-9408-ea0be972e93b admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.894933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e64d9-242a-4e9d-9408-ea0be972e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.895308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e64d9-242a-4e9d-9408-ea0be972e93b admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.896118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e64d9-242a-4e9d-9408-ea0be972e93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:14.897590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1016/2030] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:14.898560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e64d9-242a-4e9d-9408-ea0be972e93b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:14.907612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c1963-b205-4804-a6f7-63b6afd13aa9 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.907902 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c1963-b205-4804-a6f7-63b6afd13aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.917842 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c1963-b205-4804-a6f7-63b6afd13aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.925253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:14.928452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1015/2031] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:14 2022] POST /identity/v3/users => generated 310 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:14.929443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e64d9-242a-4e9d-9408-ea0be972e93b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.931714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-048c1963-b205-4804-a6f7-63b6afd13aa9 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:14.931947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ff7e64d9-242a-4e9d-9408-ea0be972e93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:14.933840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-048c1963-b205-4804-a6f7-63b6afd13aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:14.945250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1017/2032] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:14.947561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e64d9-242a-4e9d-9408-ea0be972e93b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:14.947945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c1963-b205-4804-a6f7-63b6afd13aa9 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.953617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880e9b4-1377-4404-9355-ba8ff7f3b057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.954371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e9b4-1377-4404-9355-ba8ff7f3b057 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.954723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e9b4-1377-4404-9355-ba8ff7f3b057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.955191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e9b4-1377-4404-9355-ba8ff7f3b057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.955996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e9b4-1377-4404-9355-ba8ff7f3b057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:14.958135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e9b4-1377-4404-9355-ba8ff7f3b057 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:14.958244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c1963-b205-4804-a6f7-63b6afd13aa9 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:14.963178 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a9d17-1300-4c4c-b0b2-d0dabb4ed6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.963989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9d17-1300-4c4c-b0b2-d0dabb4ed6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.964245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9d17-1300-4c4c-b0b2-d0dabb4ed6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.964527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9d17-1300-4c4c-b0b2-d0dabb4ed6e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.965285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a9d17-1300-4c4c-b0b2-d0dabb4ed6e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:21:14.965597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a9d17-1300-4c4c-b0b2-d0dabb4ed6e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:14.967197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a9d17-1300-4c4c-b0b2-d0dabb4ed6e8 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:14.972755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1016/2033] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:14.973849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880e9b4-1377-4404-9355-ba8ff7f3b057 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.986326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1018/2034] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:21:14.986540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880e9b4-1377-4404-9355-ba8ff7f3b057 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:14.987276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a9d17-1300-4c4c-b0b2-d0dabb4ed6e8 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:14.988594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570725c-736e-4c1b-870c-37c6c4dbaedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:14.989514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570725c-736e-4c1b-870c-37c6c4dbaedb admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:14.989798 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570725c-736e-4c1b-870c-37c6c4dbaedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:14.990076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570725c-736e-4c1b-870c-37c6c4dbaedb admin admin] PATH_INFO: `/v3/projects/c3c2149c769b4011991f6b1436dfd930/users/2bb65708a0bd4841a0c7e1827c3e7d0c/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:14.998007 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a9d17-1300-4c4c-b0b2-d0dabb4ed6e8 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:15.002775 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0c3fd-9d72-4760-ab55-595518100fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:15.003397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0c3fd-9d72-4760-ab55-595518100fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.003680 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0c3fd-9d72-4760-ab55-595518100fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.003958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0c3fd-9d72-4760-ab55-595518100fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.004649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0c3fd-9d72-4760-ab55-595518100fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:15.006037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570725c-736e-4c1b-870c-37c6c4dbaedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c2149c769b4011991f6b1436dfd930, user_id=2bb65708a0bd4841a0c7e1827c3e7d0c, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:15.006580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0c3fd-9d72-4760-ab55-595518100fe1 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:15.008734 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570725c-736e-4c1b-870c-37c6c4dbaedb admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:15.023774 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1017/2035] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:14 2022] PUT /identity/v3/projects/c3c2149c769b4011991f6b1436dfd930/users/2bb65708a0bd4841a0c7e1827c3e7d0c/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:15.027994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570725c-736e-4c1b-870c-37c6c4dbaedb admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:15.035834 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1019/2036] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:14 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:21:15.039986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0c3fd-9d72-4760-ab55-595518100fe1 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:15.094387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570725c-736e-4c1b-870c-37c6c4dbaedb admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:15.128866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0c3fd-9d72-4760-ab55-595518100fe1 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:15.134387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0355b9f-7d6a-4df9-9fa2-8422d97c2959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:15.135242 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0355b9f-7d6a-4df9-9fa2-8422d97c2959 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.135574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0355b9f-7d6a-4df9-9fa2-8422d97c2959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.135900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0355b9f-7d6a-4df9-9fa2-8422d97c2959 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.136703 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0355b9f-7d6a-4df9-9fa2-8422d97c2959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:15.139167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0355b9f-7d6a-4df9-9fa2-8422d97c2959 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:15.148808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:15.161526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411532e-f174-4144-aae9-91249e1e0de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:15.162369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411532e-f174-4144-aae9-91249e1e0de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.162660 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411532e-f174-4144-aae9-91249e1e0de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.162953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411532e-f174-4144-aae9-91249e1e0de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.163681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411532e-f174-4144-aae9-91249e1e0de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:15.165369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411532e-f174-4144-aae9-91249e1e0de7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:15.172282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1020/2037] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:15 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:21:15.174054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0355b9f-7d6a-4df9-9fa2-8422d97c2959 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:15.181829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1018/2038] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:15.185787 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411532e-f174-4144-aae9-91249e1e0de7 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:15.187083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0355b9f-7d6a-4df9-9fa2-8422d97c2959 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:15.196483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2af29-98e6-4678-bbfa-bb652923d0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:15.197791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2af29-98e6-4678-bbfa-bb652923d0df admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.199307 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2af29-98e6-4678-bbfa-bb652923d0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.199307 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2af29-98e6-4678-bbfa-bb652923d0df admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.199727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2af29-98e6-4678-bbfa-bb652923d0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:15.201950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2af29-98e6-4678-bbfa-bb652923d0df admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:15.210357 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411532e-f174-4144-aae9-91249e1e0de7 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:15.219610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fff0b-eb1f-4f50-8bfc-d0422e9bb85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:15.220956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fff0b-eb1f-4f50-8bfc-d0422e9bb85e admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.221376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fff0b-eb1f-4f50-8bfc-d0422e9bb85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.221942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fff0b-eb1f-4f50-8bfc-d0422e9bb85e admin admin] PATH_INFO: `/v3/projects/c3c2149c769b4011991f6b1436dfd930/users/2bb65708a0bd4841a0c7e1827c3e7d0c/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.226002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fff0b-eb1f-4f50-8bfc-d0422e9bb85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c2149c769b4011991f6b1436dfd930, user_id=2bb65708a0bd4841a0c7e1827c3e7d0c, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:15.228836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fff0b-eb1f-4f50-8bfc-d0422e9bb85e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:15.234835 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1021/2039] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:15.236454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2af29-98e6-4678-bbfa-bb652923d0df admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:15.240849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1019/2040] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:15 2022] PUT /identity/v3/projects/c3c2149c769b4011991f6b1436dfd930/users/2bb65708a0bd4841a0c7e1827c3e7d0c/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:15.249751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2af29-98e6-4678-bbfa-bb652923d0df admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:15.255000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33aece-7491-40c8-8438-855a31f009e6 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.255293 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33aece-7491-40c8-8438-855a31f009e6 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.255577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33aece-7491-40c8-8438-855a31f009e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.295019 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ba33aece-7491-40c8-8438-855a31f009e6 None None] MFA Rules not processed for user `2bb65708a0bd4841a0c7e1827c3e7d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:15.296308 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ba33aece-7491-40c8-8438-855a31f009e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:15.336774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba637c-c0b4-47fb-8a62-2d0eabb1ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:15.337518 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba637c-c0b4-47fb-8a62-2d0eabb1ad36 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.337806 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba637c-c0b4-47fb-8a62-2d0eabb1ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.339554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba637c-c0b4-47fb-8a62-2d0eabb1ad36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.340413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba637c-c0b4-47fb-8a62-2d0eabb1ad36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:15.342083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba637c-c0b4-47fb-8a62-2d0eabb1ad36 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:15.356548 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1022/2041] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:15.357560 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba637c-c0b4-47fb-8a62-2d0eabb1ad36 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:15.368157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba637c-c0b4-47fb-8a62-2d0eabb1ad36 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:15.377003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11dc58-daaa-473c-95e5-b89981ccbcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:15.377994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11dc58-daaa-473c-95e5-b89981ccbcf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.378302 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11dc58-daaa-473c-95e5-b89981ccbcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.378566 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11dc58-daaa-473c-95e5-b89981ccbcf1 admin admin] PATH_INFO: `/v3/projects/fa7c935724574ffd8112de84cb6318d6/users/b614f741702844dc87c991dd7da0a703/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.391527 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1020/2042] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:15 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:15.404832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33aece-7491-40c8-8438-855a31f009e6 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:15.406470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ba33aece-7491-40c8-8438-855a31f009e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:15.414330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11dc58-daaa-473c-95e5-b89981ccbcf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7c935724574ffd8112de84cb6318d6, user_id=b614f741702844dc87c991dd7da0a703, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:15.417755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11dc58-daaa-473c-95e5-b89981ccbcf1 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:15.434783 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1023/2043] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:15 2022] PUT /identity/v3/projects/fa7c935724574ffd8112de84cb6318d6/users/b614f741702844dc87c991dd7da0a703/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:15.447396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c8cab-5243-4160-a102-f2ccf4538b49 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.447988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c8cab-5243-4160-a102-f2ccf4538b49 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.448291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c8cab-5243-4160-a102-f2ccf4538b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.480383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-815c8cab-5243-4160-a102-f2ccf4538b49 None None] MFA Rules not processed for user `b614f741702844dc87c991dd7da0a703`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:15.481774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-815c8cab-5243-4160-a102-f2ccf4538b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:15.486260 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33aece-7491-40c8-8438-855a31f009e6 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:15.486408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:15.538144 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ba05f-bfd6-431f-b299-b8fee3e3ef25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:15.538819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ba05f-bfd6-431f-b299-b8fee3e3ef25 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.539193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ba05f-bfd6-431f-b299-b8fee3e3ef25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.539485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ba05f-bfd6-431f-b299-b8fee3e3ef25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.566048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1024/2044] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:15.582402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c8cab-5243-4160-a102-f2ccf4538b49 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:15.584852 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-815c8cab-5243-4160-a102-f2ccf4538b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:15.590485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:15.599066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c8cab-5243-4160-a102-f2ccf4538b49 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:15.603917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44580f81-e2a0-4449-9f1c-1fdf3305b19b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:15.604719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44580f81-e2a0-4449-9f1c-1fdf3305b19b service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.605001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44580f81-e2a0-4449-9f1c-1fdf3305b19b service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.605709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44580f81-e2a0-4449-9f1c-1fdf3305b19b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.615709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44580f81-e2a0-4449-9f1c-1fdf3305b19b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:15.617520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44580f81-e2a0-4449-9f1c-1fdf3305b19b service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:15.628835 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1025/2045] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:15.633625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ba05f-bfd6-431f-b299-b8fee3e3ef25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:15.635313 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ba05f-bfd6-431f-b299-b8fee3e3ef25 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:15.649817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1021/2046] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:15 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:15.657745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44580f81-e2a0-4449-9f1c-1fdf3305b19b service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:15.739379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44580f81-e2a0-4449-9f1c-1fdf3305b19b service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:15.746587 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38225ac-c3af-49c5-9b4c-2a70652e9ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:15.748338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38225ac-c3af-49c5-9b4c-2a70652e9ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.748338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38225ac-c3af-49c5-9b4c-2a70652e9ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.753270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38225ac-c3af-49c5-9b4c-2a70652e9ae2 admin admin] PATH_INFO: `/v3/users/b614f741702844dc87c991dd7da0a703` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.753270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38225ac-c3af-49c5-9b4c-2a70652e9ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b614f741702844dc87c991dd7da0a703)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:15.763294 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38225ac-c3af-49c5-9b4c-2a70652e9ae2 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:15.835304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c38225ac-c3af-49c5-9b4c-2a70652e9ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b614f741702844dc87c991dd7da0a703'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:15.836346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c38225ac-c3af-49c5-9b4c-2a70652e9ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b614f741702844dc87c991dd7da0a703'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:15.837561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c38225ac-c3af-49c5-9b4c-2a70652e9ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b614f741702844dc87c991dd7da0a703'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:15.849446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c38225ac-c3af-49c5-9b4c-2a70652e9ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b614f741702844dc87c991dd7da0a703'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:15.862346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c38225ac-c3af-49c5-9b4c-2a70652e9ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b614f741702844dc87c991dd7da0a703'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:15.869157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ba05f-bfd6-431f-b299-b8fee3e3ef25 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:15.896041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ba05f-bfd6-431f-b299-b8fee3e3ef25 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:15.906825 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1026/2047] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:15 2022] DELETE /identity/v3/users/b614f741702844dc87c991dd7da0a703 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:15.908627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0613f-9ddd-4f72-a4c9-3ebecf9cc570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:15.909334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0613f-9ddd-4f72-a4c9-3ebecf9cc570 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.909737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0613f-9ddd-4f72-a4c9-3ebecf9cc570 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.910009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0613f-9ddd-4f72-a4c9-3ebecf9cc570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.911719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6152-eaa4-42ac-81cf-e31fcb7c1145 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:15.911966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-72c0613f-9ddd-4f72-a4c9-3ebecf9cc570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:15.912082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6152-eaa4-42ac-81cf-e31fcb7c1145 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:15.912251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6152-eaa4-42ac-81cf-e31fcb7c1145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:15.960714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a46b6152-eaa4-42ac-81cf-e31fcb7c1145 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:15.963114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a46b6152-eaa4-42ac-81cf-e31fcb7c1145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:15.970803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:16.009038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0613f-9ddd-4f72-a4c9-3ebecf9cc570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:16.013632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0613f-9ddd-4f72-a4c9-3ebecf9cc570 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:16.027861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1022/2048] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:21:16.065282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1027/2049] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:16.075282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0613f-9ddd-4f72-a4c9-3ebecf9cc570 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:16.076951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-72c0613f-9ddd-4f72-a4c9-3ebecf9cc570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:16.164363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0613f-9ddd-4f72-a4c9-3ebecf9cc570 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:16.237344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc21be0-4917-4736-9137-f3f4e899d4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:16.238745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21be0-4917-4736-9137-f3f4e899d4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:16.239206 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21be0-4917-4736-9137-f3f4e899d4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:16.239642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21be0-4917-4736-9137-f3f4e899d4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:16.253006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc21be0-4917-4736-9137-f3f4e899d4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:16.254537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc21be0-4917-4736-9137-f3f4e899d4b6 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:16.265878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1023/2050] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:16.642274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b6152-eaa4-42ac-81cf-e31fcb7c1145 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:16.644165 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a46b6152-eaa4-42ac-81cf-e31fcb7c1145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:16.659070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b6152-eaa4-42ac-81cf-e31fcb7c1145 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:16.664162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc750e-5121-4d9f-9c55-aa3a1430aa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:16.665059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc750e-5121-4d9f-9c55-aa3a1430aa17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:16.665378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc750e-5121-4d9f-9c55-aa3a1430aa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:16.665654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc750e-5121-4d9f-9c55-aa3a1430aa17 admin admin] PATH_INFO: `/v3/projects/fa7c935724574ffd8112de84cb6318d6` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:16.666900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc750e-5121-4d9f-9c55-aa3a1430aa17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa7c935724574ffd8112de84cb6318d6)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:16.670911 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc750e-5121-4d9f-9c55-aa3a1430aa17 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:16.722132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-34dc750e-5121-4d9f-9c55-aa3a1430aa17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa7c935724574ffd8112de84cb6318d6', 'request_id': 'req-34dc750e-5121-4d9f-9c55-aa3a1430aa17'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:16.730133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-34dc750e-5121-4d9f-9c55-aa3a1430aa17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa7c935724574ffd8112de84cb6318d6', 'request_id': 'req-34dc750e-5121-4d9f-9c55-aa3a1430aa17'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:16.736557 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-34dc750e-5121-4d9f-9c55-aa3a1430aa17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa7c935724574ffd8112de84cb6318d6', 'request_id': 'req-34dc750e-5121-4d9f-9c55-aa3a1430aa17'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:16.748805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-34dc750e-5121-4d9f-9c55-aa3a1430aa17 admin admin] The token cache is being invalidate because project fa7c935724574ffd8112de84cb6318d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:16.749092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-34dc750e-5121-4d9f-9c55-aa3a1430aa17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:16.749877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-34dc750e-5121-4d9f-9c55-aa3a1430aa17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:16.751676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1028/2051] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:16 2022] DELETE /identity/v3/projects/fa7c935724574ffd8112de84cb6318d6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:16.756825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0821872-6d9d-4aac-9444-05aa95ba7b9c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:16.757115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0821872-6d9d-4aac-9444-05aa95ba7b9c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:16.757516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0821872-6d9d-4aac-9444-05aa95ba7b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:16.776896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-f0821872-6d9d-4aac-9444-05aa95ba7b9c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:16.778145 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f0821872-6d9d-4aac-9444-05aa95ba7b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:16.798970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:16.852779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1024/2052] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:16.860709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102ba7-d40d-4355-816a-aaf90ba3f370 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:16.860932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102ba7-d40d-4355-816a-aaf90ba3f370 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:16.861224 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102ba7-d40d-4355-816a-aaf90ba3f370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:16.880737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-32102ba7-d40d-4355-816a-aaf90ba3f370 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:16.882070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-32102ba7-d40d-4355-816a-aaf90ba3f370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:16.890458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1029/2053] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:16.895107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0821872-6d9d-4aac-9444-05aa95ba7b9c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:16.905467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0821872-6d9d-4aac-9444-05aa95ba7b9c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:16.910142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadaa0c-d146-44ee-b096-666051b016ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:16.910845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadaa0c-d146-44ee-b096-666051b016ba admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:16.911129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadaa0c-d146-44ee-b096-666051b016ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:16.911408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadaa0c-d146-44ee-b096-666051b016ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:16.912157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadaa0c-d146-44ee-b096-666051b016ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:21:16.912470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadaa0c-d146-44ee-b096-666051b016ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:16.914162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadaa0c-d146-44ee-b096-666051b016ba admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:16.927297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1025/2054] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:21:16.931254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32102ba7-d40d-4355-816a-aaf90ba3f370 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:16.944250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32102ba7-d40d-4355-816a-aaf90ba3f370 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:16.950459 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46528934-0188-4ec6-8909-22762fbd2ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:16.951153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46528934-0188-4ec6-8909-22762fbd2ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:16.951430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46528934-0188-4ec6-8909-22762fbd2ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:16.951701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46528934-0188-4ec6-8909-22762fbd2ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:16.952433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46528934-0188-4ec6-8909-22762fbd2ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:16.954406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46528934-0188-4ec6-8909-22762fbd2ecf admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:16.983612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1030/2055] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:16 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:16.988862 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadaa0c-d146-44ee-b096-666051b016ba admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:17.001803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadaa0c-d146-44ee-b096-666051b016ba admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:17.065729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8f644-0327-48d0-8bf7-6f36705271b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:17.066395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8f644-0327-48d0-8bf7-6f36705271b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:17.066722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8f644-0327-48d0-8bf7-6f36705271b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:17.067033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8f644-0327-48d0-8bf7-6f36705271b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:17.067985 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8f644-0327-48d0-8bf7-6f36705271b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:17.070405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8f644-0327-48d0-8bf7-6f36705271b0 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:17.091844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1026/2056] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:16 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:17.096467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46528934-0188-4ec6-8909-22762fbd2ecf admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:17.108259 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46528934-0188-4ec6-8909-22762fbd2ecf admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:17.113042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944e516-fd28-4e9d-98aa-9280f7f26b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:17.113697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944e516-fd28-4e9d-98aa-9280f7f26b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:17.113984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944e516-fd28-4e9d-98aa-9280f7f26b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:17.114265 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944e516-fd28-4e9d-98aa-9280f7f26b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:17.115003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944e516-fd28-4e9d-98aa-9280f7f26b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:17.116800 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944e516-fd28-4e9d-98aa-9280f7f26b48 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:17.132538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1031/2057] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:17.139951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8f644-0327-48d0-8bf7-6f36705271b0 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:17.156630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8f644-0327-48d0-8bf7-6f36705271b0 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:17.163784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299501cd-d0bf-4cba-96d0-ee696d67a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:17.164491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299501cd-d0bf-4cba-96d0-ee696d67a158 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:17.164771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299501cd-d0bf-4cba-96d0-ee696d67a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:17.165041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299501cd-d0bf-4cba-96d0-ee696d67a158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:17.165826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299501cd-d0bf-4cba-96d0-ee696d67a158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:17.167579 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299501cd-d0bf-4cba-96d0-ee696d67a158 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:17.181753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1027/2058] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:17.187119 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944e516-fd28-4e9d-98aa-9280f7f26b48 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:17.205141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944e516-fd28-4e9d-98aa-9280f7f26b48 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:17.210674 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46848b0-5a5f-42d5-aaa6-ebf38a8b604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:17.211644 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46848b0-5a5f-42d5-aaa6-ebf38a8b604f admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:17.211905 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46848b0-5a5f-42d5-aaa6-ebf38a8b604f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:17.212195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46848b0-5a5f-42d5-aaa6-ebf38a8b604f admin admin] PATH_INFO: `/v3/projects/09a41d9c3b0f42f2ac30d63472e4f0c0/users/f1663e4f08e9411fabef17365bf201f5/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:17.229756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46848b0-5a5f-42d5-aaa6-ebf38a8b604f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a41d9c3b0f42f2ac30d63472e4f0c0, user_id=f1663e4f08e9411fabef17365bf201f5, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:17.232892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46848b0-5a5f-42d5-aaa6-ebf38a8b604f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:17.260751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1032/2059] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:17 2022] PUT /identity/v3/projects/09a41d9c3b0f42f2ac30d63472e4f0c0/users/f1663e4f08e9411fabef17365bf201f5/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:17.274029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa3837-a36b-40b5-b8d7-cae5e9a2739d None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:17.274520 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa3837-a36b-40b5-b8d7-cae5e9a2739d None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:17.275036 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa3837-a36b-40b5-b8d7-cae5e9a2739d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:17.316269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-80aa3837-a36b-40b5-b8d7-cae5e9a2739d None None] MFA Rules not processed for user `f1663e4f08e9411fabef17365bf201f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:17.317670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-80aa3837-a36b-40b5-b8d7-cae5e9a2739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:17.385344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1028/2060] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:17.396754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46848b0-5a5f-42d5-aaa6-ebf38a8b604f admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:17.398797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d46848b0-5a5f-42d5-aaa6-ebf38a8b604f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:17.440866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:17.469673 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46848b0-5a5f-42d5-aaa6-ebf38a8b604f admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:17.473787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebc3a0-6858-4851-9613-3861473ffb5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6af41d833941debd6afcecd952af0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:17.474433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebc3a0-6858-4851-9613-3861473ffb5d service glance] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:17.474713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebc3a0-6858-4851-9613-3861473ffb5d service glance] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:17.474980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebc3a0-6858-4851-9613-3861473ffb5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:17.485515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebc3a0-6858-4851-9613-3861473ffb5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:17.487656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebc3a0-6858-4851-9613-3861473ffb5d service glance] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:17.499204 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1033/2061] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:24.719680 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa3837-a36b-40b5-b8d7-cae5e9a2739d None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:24.721202 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-80aa3837-a36b-40b5-b8d7-cae5e9a2739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:24.748182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:24.807135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa3837-a36b-40b5-b8d7-cae5e9a2739d None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:24.814110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:24.815097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:24.815449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:24.815793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] PATH_INFO: `/v3/users/bbf3613d51e547e3a5d43ededd2804c1` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:24.818177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf3613d51e547e3a5d43ededd2804c1)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:24.820161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:24.913669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf3613d51e547e3a5d43ededd2804c1'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:24.914395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf3613d51e547e3a5d43ededd2804c1'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:24.915349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf3613d51e547e3a5d43ededd2804c1'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:24.924345 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf3613d51e547e3a5d43ededd2804c1'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:24.938328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf3613d51e547e3a5d43ededd2804c1'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:24.962845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1029/2062] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:24 2022] DELETE /identity/v3/users/bbf3613d51e547e3a5d43ededd2804c1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:24.968969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3bd4-26fd-409e-9b7e-5a849dbea7f4 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:24.969562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3bd4-26fd-409e-9b7e-5a849dbea7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:24.969654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3bd4-26fd-409e-9b7e-5a849dbea7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:24.994634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-cfeb3bd4-26fd-409e-9b7e-5a849dbea7f4 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:24.995943 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cfeb3bd4-26fd-409e-9b7e-5a849dbea7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:25.072116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1034/2063] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:25.082559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:25.084073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:25.167442 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344e191-6681-4d7a-b2e2-847a90ec41b7 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:25.171644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5486c-e3a1-4e3a-a7dd-249f717fdad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:25.172376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5486c-e3a1-4e3a-a7dd-249f717fdad9 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:25.172659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5486c-e3a1-4e3a-a7dd-249f717fdad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:25.172941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5486c-e3a1-4e3a-a7dd-249f717fdad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:25.184001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5486c-e3a1-4e3a-a7dd-249f717fdad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:25.185505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5486c-e3a1-4e3a-a7dd-249f717fdad9 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:25.198904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1030/2064] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:25.571558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb3bd4-26fd-409e-9b7e-5a849dbea7f4 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:25.572964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cfeb3bd4-26fd-409e-9b7e-5a849dbea7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:25.587316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb3bd4-26fd-409e-9b7e-5a849dbea7f4 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:25.592574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:25.596232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:25.596232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:25.596232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] PATH_INFO: `/v3/projects/03106f0387f74253bdfb11d2cabf5c56` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:25.597070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=03106f0387f74253bdfb11d2cabf5c56)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:25.601358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:25.651864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03106f0387f74253bdfb11d2cabf5c56', 'request_id': 'req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:25.659750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03106f0387f74253bdfb11d2cabf5c56', 'request_id': 'req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:25.665531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03106f0387f74253bdfb11d2cabf5c56', 'request_id': 'req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:25.676569 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] The token cache is being invalidate because project 03106f0387f74253bdfb11d2cabf5c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:25.676858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:25.677579 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:25.679278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1035/2065] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:25 2022] DELETE /identity/v3/projects/03106f0387f74253bdfb11d2cabf5c56 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:25.683470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5486c-e3a1-4e3a-a7dd-249f717fdad9 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:25.693726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5486c-e3a1-4e3a-a7dd-249f717fdad9 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:25.741012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:25.759806 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0e54d-66c3-4a20-b2ad-7318116f59ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:25.760743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0e54d-66c3-4a20-b2ad-7318116f59ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:25.761023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0e54d-66c3-4a20-b2ad-7318116f59ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:25.761337 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0e54d-66c3-4a20-b2ad-7318116f59ba admin admin] PATH_INFO: `/v3/users/2bb65708a0bd4841a0c7e1827c3e7d0c` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:25.762560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0e54d-66c3-4a20-b2ad-7318116f59ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb65708a0bd4841a0c7e1827c3e7d0c)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:25.764495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0e54d-66c3-4a20-b2ad-7318116f59ba admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:25.823795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-46e0e54d-66c3-4a20-b2ad-7318116f59ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb65708a0bd4841a0c7e1827c3e7d0c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:25.824401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-46e0e54d-66c3-4a20-b2ad-7318116f59ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb65708a0bd4841a0c7e1827c3e7d0c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:25.825026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-46e0e54d-66c3-4a20-b2ad-7318116f59ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb65708a0bd4841a0c7e1827c3e7d0c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:25.832950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-46e0e54d-66c3-4a20-b2ad-7318116f59ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb65708a0bd4841a0c7e1827c3e7d0c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:25.843167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-46e0e54d-66c3-4a20-b2ad-7318116f59ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb65708a0bd4841a0c7e1827c3e7d0c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:25.863838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1031/2066] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:25 2022] DELETE /identity/v3/users/2bb65708a0bd4841a0c7e1827c3e7d0c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:26.203558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:26.205688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:26.226973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb1953-cb46-4ed4-ab09-de3c00fd1aad admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:26.292807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:26.301750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df19d9-826a-4dde-8707-5d742a6f3430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:26.302705 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df19d9-826a-4dde-8707-5d742a6f3430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:26.302986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df19d9-826a-4dde-8707-5d742a6f3430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:26.303260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df19d9-826a-4dde-8707-5d742a6f3430 admin admin] PATH_INFO: `/v3/projects/c3c2149c769b4011991f6b1436dfd930` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:26.304611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df19d9-826a-4dde-8707-5d742a6f3430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c2149c769b4011991f6b1436dfd930)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:26.306727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df19d9-826a-4dde-8707-5d742a6f3430 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:26.364136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b0df19d9-826a-4dde-8707-5d742a6f3430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c2149c769b4011991f6b1436dfd930', 'request_id': 'req-b0df19d9-826a-4dde-8707-5d742a6f3430'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:26.372277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b0df19d9-826a-4dde-8707-5d742a6f3430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c2149c769b4011991f6b1436dfd930', 'request_id': 'req-b0df19d9-826a-4dde-8707-5d742a6f3430'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:26.378224 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b0df19d9-826a-4dde-8707-5d742a6f3430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c2149c769b4011991f6b1436dfd930', 'request_id': 'req-b0df19d9-826a-4dde-8707-5d742a6f3430'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:26.393866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b0df19d9-826a-4dde-8707-5d742a6f3430 admin admin] The token cache is being invalidate because project c3c2149c769b4011991f6b1436dfd930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:26.394463 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b0df19d9-826a-4dde-8707-5d742a6f3430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:26.395354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b0df19d9-826a-4dde-8707-5d742a6f3430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:26.404002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1036/2067] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:26 2022] DELETE /identity/v3/projects/c3c2149c769b4011991f6b1436dfd930 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:26.404925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73252e1f-8a9b-43b9-8e57-c1aab92a8956 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:26.405253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73252e1f-8a9b-43b9-8e57-c1aab92a8956 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:26.405606 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73252e1f-8a9b-43b9-8e57-c1aab92a8956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:26.428395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-73252e1f-8a9b-43b9-8e57-c1aab92a8956 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:26.429662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-73252e1f-8a9b-43b9-8e57-c1aab92a8956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:26.498749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1032/2068] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:26.508830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae320-8308-4296-bb5e-6e2888daefb7 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:26.509135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae320-8308-4296-bb5e-6e2888daefb7 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:26.509553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae320-8308-4296-bb5e-6e2888daefb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:26.529535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-5f1ae320-8308-4296-bb5e-6e2888daefb7 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:26.530763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5f1ae320-8308-4296-bb5e-6e2888daefb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:26.539327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1037/2069] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:26.543969 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73252e1f-8a9b-43b9-8e57-c1aab92a8956 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:26.554552 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73252e1f-8a9b-43b9-8e57-c1aab92a8956 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:26.559507 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390ac2d-a2cc-4e61-9b61-6f40522995f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:26.560174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390ac2d-a2cc-4e61-9b61-6f40522995f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:26.560459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390ac2d-a2cc-4e61-9b61-6f40522995f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:26.560733 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390ac2d-a2cc-4e61-9b61-6f40522995f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:26.561500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390ac2d-a2cc-4e61-9b61-6f40522995f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:21:26.561829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390ac2d-a2cc-4e61-9b61-6f40522995f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:26.563850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390ac2d-a2cc-4e61-9b61-6f40522995f1 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:26.576114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1033/2070] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:21:26.580524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae320-8308-4296-bb5e-6e2888daefb7 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:26.590165 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae320-8308-4296-bb5e-6e2888daefb7 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:26.595040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b06cf8-4fb9-4d59-8167-fce6a9d5e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:26.595741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b06cf8-4fb9-4d59-8167-fce6a9d5e9ae admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:26.596026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b06cf8-4fb9-4d59-8167-fce6a9d5e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:26.596289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b06cf8-4fb9-4d59-8167-fce6a9d5e9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:26.597006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b06cf8-4fb9-4d59-8167-fce6a9d5e9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:26.598994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b06cf8-4fb9-4d59-8167-fce6a9d5e9ae admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:26.630730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1038/2071] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:26 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:26.632190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390ac2d-a2cc-4e61-9b61-6f40522995f1 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:26.647608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390ac2d-a2cc-4e61-9b61-6f40522995f1 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:26.696197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:26.712772 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b62fcf-6268-4ffd-8bac-b15640bbf8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:26.713531 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b62fcf-6268-4ffd-8bac-b15640bbf8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:26.713848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b62fcf-6268-4ffd-8bac-b15640bbf8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:26.714121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b62fcf-6268-4ffd-8bac-b15640bbf8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:26.714821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b62fcf-6268-4ffd-8bac-b15640bbf8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:26.716875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b62fcf-6268-4ffd-8bac-b15640bbf8e6 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:26.738464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1034/2072] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:26 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:26.742711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b06cf8-4fb9-4d59-8167-fce6a9d5e9ae admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:26.753751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b06cf8-4fb9-4d59-8167-fce6a9d5e9ae admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:26.758688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c2420-8ce2-4c46-985e-69998393e887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:26.759384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c2420-8ce2-4c46-985e-69998393e887 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:26.759669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c2420-8ce2-4c46-985e-69998393e887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:26.759953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c2420-8ce2-4c46-985e-69998393e887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:26.760949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c2420-8ce2-4c46-985e-69998393e887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:26.762660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c2420-8ce2-4c46-985e-69998393e887 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:26.773370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1039/2073] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:26.777764 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b62fcf-6268-4ffd-8bac-b15640bbf8e6 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:26.788580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b62fcf-6268-4ffd-8bac-b15640bbf8e6 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:26.793742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b3730-5b66-4c1a-9df5-6674582e7027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:26.794522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3730-5b66-4c1a-9df5-6674582e7027 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:26.794816 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3730-5b66-4c1a-9df5-6674582e7027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:26.795091 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3730-5b66-4c1a-9df5-6674582e7027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:26.795831 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b3730-5b66-4c1a-9df5-6674582e7027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:26.797514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b3730-5b66-4c1a-9df5-6674582e7027 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:26.808232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1035/2074] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:26.813079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c2420-8ce2-4c46-985e-69998393e887 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:26.824245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c2420-8ce2-4c46-985e-69998393e887 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:26.829885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d0af5-7229-42ef-863d-3cfe123f39fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:26.830785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d0af5-7229-42ef-863d-3cfe123f39fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:26.831064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d0af5-7229-42ef-863d-3cfe123f39fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:26.831344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d0af5-7229-42ef-863d-3cfe123f39fa admin admin] PATH_INFO: `/v3/projects/6744b2331bb84a4daca8d7a9cb84103b/users/d37c1e43b38c4e2dadc52169929c23fc/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:26.848232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d0af5-7229-42ef-863d-3cfe123f39fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6744b2331bb84a4daca8d7a9cb84103b, user_id=d37c1e43b38c4e2dadc52169929c23fc, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:26.851005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d0af5-7229-42ef-863d-3cfe123f39fa admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:26.867326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1040/2075] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:26 2022] PUT /identity/v3/projects/6744b2331bb84a4daca8d7a9cb84103b/users/d37c1e43b38c4e2dadc52169929c23fc/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:26.878373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d59b8f-3771-4547-abd6-f3affe2f492c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:26.878703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d59b8f-3771-4547-abd6-f3affe2f492c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:26.878984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d59b8f-3771-4547-abd6-f3affe2f492c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:26.915697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e0d59b8f-3771-4547-abd6-f3affe2f492c None None] MFA Rules not processed for user `d37c1e43b38c4e2dadc52169929c23fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:26.916902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e0d59b8f-3771-4547-abd6-f3affe2f492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:26.996948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1036/2076] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:27.014804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d0af5-7229-42ef-863d-3cfe123f39fa admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:27.017744 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-568d0af5-7229-42ef-863d-3cfe123f39fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:27.080618 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d0af5-7229-42ef-863d-3cfe123f39fa admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:27.084857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ecc56-74bd-4cb8-b0b8-980df2763a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:27.085531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ecc56-74bd-4cb8-b0b8-980df2763a3e service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:27.085878 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ecc56-74bd-4cb8-b0b8-980df2763a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:27.086092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ecc56-74bd-4cb8-b0b8-980df2763a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:27.094576 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ecc56-74bd-4cb8-b0b8-980df2763a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:27.095999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ecc56-74bd-4cb8-b0b8-980df2763a3e service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:27.105680 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1041/2077] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:28.872344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c6a3e-1d34-4b61-8bee-368ba87842e6 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:28.872901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c6a3e-1d34-4b61-8bee-368ba87842e6 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:28.872901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c6a3e-1d34-4b61-8bee-368ba87842e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:28.893679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-536c6a3e-1d34-4b61-8bee-368ba87842e6 None None] MFA Rules not processed for user `2e6e49df0e254b4284950e4bbe65ab45`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:28.895520 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-536c6a3e-1d34-4b61-8bee-368ba87842e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:28.962575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1037/2078] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:31.380415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb37ba-88c2-4ac3-b8fd-9adba2dccabe None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:31.381160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb37ba-88c2-4ac3-b8fd-9adba2dccabe None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:31.381571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb37ba-88c2-4ac3-b8fd-9adba2dccabe None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:31.383309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1042/2079] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:21:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:21:31.428419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25920d98-7b62-4c2e-9919-e980bac07eb2 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:31.430060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25920d98-7b62-4c2e-9919-e980bac07eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:31.430060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25920d98-7b62-4c2e-9919-e980bac07eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:31.464797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-25920d98-7b62-4c2e-9919-e980bac07eb2 None None] MFA Rules not processed for user `bd80f27a4499407d8c350f2908638334`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:31.465049 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb37ba-88c2-4ac3-b8fd-9adba2dccabe None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:31.466841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-15bb37ba-88c2-4ac3-b8fd-9adba2dccabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:31.467174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-25920d98-7b62-4c2e-9919-e980bac07eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:31.519000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:31.541782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:31.554679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1038/2080] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:21:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:31.562251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb37ba-88c2-4ac3-b8fd-9adba2dccabe None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:31.566841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25920d98-7b62-4c2e-9919-e980bac07eb2 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:31.567600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21d8fb-d763-47a0-817e-719f16ee5f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:31.568252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-25920d98-7b62-4c2e-9919-e980bac07eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:31.568492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21d8fb-d763-47a0-817e-719f16ee5f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:31.568773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21d8fb-d763-47a0-817e-719f16ee5f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:31.569257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21d8fb-d763-47a0-817e-719f16ee5f9a admin admin] PATH_INFO: `/v3/users/3401cbd655eb4dffb2acb46cfbdd9259` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:31.570311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21d8fb-d763-47a0-817e-719f16ee5f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3401cbd655eb4dffb2acb46cfbdd9259)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:31.572330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21d8fb-d763-47a0-817e-719f16ee5f9a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:31.581980 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25920d98-7b62-4c2e-9919-e980bac07eb2 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:31.587114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5246651-e17b-45b5-99c4-78680c0796aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:31.587773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5246651-e17b-45b5-99c4-78680c0796aa service placement] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:31.588129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5246651-e17b-45b5-99c4-78680c0796aa service placement] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:31.588417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5246651-e17b-45b5-99c4-78680c0796aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:31.597292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5246651-e17b-45b5-99c4-78680c0796aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:31.599174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5246651-e17b-45b5-99c4-78680c0796aa service placement] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:31.609299 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1039/2081] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:31.623619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-2d21d8fb-d763-47a0-817e-719f16ee5f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3401cbd655eb4dffb2acb46cfbdd9259'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:31.624866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-2d21d8fb-d763-47a0-817e-719f16ee5f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3401cbd655eb4dffb2acb46cfbdd9259'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:31.625237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-2d21d8fb-d763-47a0-817e-719f16ee5f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3401cbd655eb4dffb2acb46cfbdd9259'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:31.633059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-2d21d8fb-d763-47a0-817e-719f16ee5f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3401cbd655eb4dffb2acb46cfbdd9259'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:31.641525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-2d21d8fb-d763-47a0-817e-719f16ee5f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3401cbd655eb4dffb2acb46cfbdd9259'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:31.661155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1043/2082] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:31 2022] DELETE /identity/v3/users/3401cbd655eb4dffb2acb46cfbdd9259 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:31.846638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5246651-e17b-45b5-99c4-78680c0796aa service placement] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:31.864701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5246651-e17b-45b5-99c4-78680c0796aa service placement] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:31.933390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:31.934291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:31.934575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:31.934866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe admin admin] PATH_INFO: `/v3/projects/6b6345958b424ceeb06285db0fc8d877` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:31.936197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b6345958b424ceeb06285db0fc8d877)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:31.938635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:31.991262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b6345958b424ceeb06285db0fc8d877', 'request_id': 'req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:31.997124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b6345958b424ceeb06285db0fc8d877', 'request_id': 'req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:32.006549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b6345958b424ceeb06285db0fc8d877', 'request_id': 'req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:32.018577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe admin admin] The token cache is being invalidate because project 6b6345958b424ceeb06285db0fc8d877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:32.018868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:32.019543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-45057fc3-ae5d-401c-8ba1-774a4f4a7abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:32.021134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1040/2083] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:31 2022] DELETE /identity/v3/projects/6b6345958b424ceeb06285db0fc8d877 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:32.027060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08869e3b-f939-4173-a67e-481c54b23b21 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:32.027546 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08869e3b-f939-4173-a67e-481c54b23b21 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:32.027896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08869e3b-f939-4173-a67e-481c54b23b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:32.047409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-08869e3b-f939-4173-a67e-481c54b23b21 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:32.048640 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-08869e3b-f939-4173-a67e-481c54b23b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:32.117304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1044/2084] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:32.125893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576cf52-8654-4964-9192-13afd7998267 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:32.126209 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576cf52-8654-4964-9192-13afd7998267 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:32.126489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576cf52-8654-4964-9192-13afd7998267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:32.150534 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-b576cf52-8654-4964-9192-13afd7998267 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:32.151919 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b576cf52-8654-4964-9192-13afd7998267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:32.161431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1041/2085] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:32.166451 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08869e3b-f939-4173-a67e-481c54b23b21 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:32.177771 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08869e3b-f939-4173-a67e-481c54b23b21 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:32.183474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9dae1-67a2-41f2-bf74-3a7f8173e3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:32.184370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9dae1-67a2-41f2-bf74-3a7f8173e3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:32.184652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9dae1-67a2-41f2-bf74-3a7f8173e3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:32.184925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9dae1-67a2-41f2-bf74-3a7f8173e3f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:32.186243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9dae1-67a2-41f2-bf74-3a7f8173e3f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:21:32.186620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9dae1-67a2-41f2-bf74-3a7f8173e3f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:32.188572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9dae1-67a2-41f2-bf74-3a7f8173e3f4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:32.203583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1045/2086] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:21:32.208464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576cf52-8654-4964-9192-13afd7998267 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:32.218614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576cf52-8654-4964-9192-13afd7998267 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:32.225013 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf353b-f432-462c-ad5a-4e5364856b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:32.225735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf353b-f432-462c-ad5a-4e5364856b97 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:32.226015 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf353b-f432-462c-ad5a-4e5364856b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:32.226287 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf353b-f432-462c-ad5a-4e5364856b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:32.226999 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf353b-f432-462c-ad5a-4e5364856b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:32.228953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf353b-f432-462c-ad5a-4e5364856b97 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:32.257345 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1042/2087] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:32 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:32.261754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9dae1-67a2-41f2-bf74-3a7f8173e3f4 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:32.272342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9dae1-67a2-41f2-bf74-3a7f8173e3f4 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:32.304913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:32.342905 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7195e-f107-4064-9808-116566dfcb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:32.343587 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7195e-f107-4064-9808-116566dfcb6e admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:32.343874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7195e-f107-4064-9808-116566dfcb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:32.344157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7195e-f107-4064-9808-116566dfcb6e admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:32.344880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7195e-f107-4064-9808-116566dfcb6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:32.346914 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7195e-f107-4064-9808-116566dfcb6e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:32.370622 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1046/2088] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:32 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:32.375194 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf353b-f432-462c-ad5a-4e5364856b97 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:32.385907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf353b-f432-462c-ad5a-4e5364856b97 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:32.391161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1cca4-023a-4385-993f-e08ceb8bbab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:32.391848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1cca4-023a-4385-993f-e08ceb8bbab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:32.392133 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1cca4-023a-4385-993f-e08ceb8bbab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:32.392416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1cca4-023a-4385-993f-e08ceb8bbab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:32.393201 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1cca4-023a-4385-993f-e08ceb8bbab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:32.394847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1cca4-023a-4385-993f-e08ceb8bbab4 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:32.409035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1043/2089] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:32.410989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7195e-f107-4064-9808-116566dfcb6e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:32.421388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7195e-f107-4064-9808-116566dfcb6e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:32.426038 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c1419-adc6-4ad5-8dec-3176ec9122d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:32.426703 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c1419-adc6-4ad5-8dec-3176ec9122d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:32.427005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c1419-adc6-4ad5-8dec-3176ec9122d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:32.427280 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c1419-adc6-4ad5-8dec-3176ec9122d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:32.428023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c1419-adc6-4ad5-8dec-3176ec9122d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:32.429975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c1419-adc6-4ad5-8dec-3176ec9122d9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:32.441679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1047/2090] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:32.446029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1cca4-023a-4385-993f-e08ceb8bbab4 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:32.457561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1cca4-023a-4385-993f-e08ceb8bbab4 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:32.462939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465d60a-7a63-49ed-b1b8-f12311c8d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:32.463998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465d60a-7a63-49ed-b1b8-f12311c8d432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:32.464291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465d60a-7a63-49ed-b1b8-f12311c8d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:32.464652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465d60a-7a63-49ed-b1b8-f12311c8d432 admin admin] PATH_INFO: `/v3/projects/441079c8bc1b4a4fb8f38fff6728f3ef/users/b80ab2a9c7504806851400e07074004e/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:32.482599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465d60a-7a63-49ed-b1b8-f12311c8d432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=441079c8bc1b4a4fb8f38fff6728f3ef, user_id=b80ab2a9c7504806851400e07074004e, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:32.486557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465d60a-7a63-49ed-b1b8-f12311c8d432 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:32.503517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1044/2091] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:32 2022] PUT /identity/v3/projects/441079c8bc1b4a4fb8f38fff6728f3ef/users/b80ab2a9c7504806851400e07074004e/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:32.508741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c48fd2-967d-4a78-8cc0-dcc86344ec1b None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:32.509145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c48fd2-967d-4a78-8cc0-dcc86344ec1b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:32.509458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c48fd2-967d-4a78-8cc0-dcc86344ec1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:32.529005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-f8c48fd2-967d-4a78-8cc0-dcc86344ec1b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:32.530303 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f8c48fd2-967d-4a78-8cc0-dcc86344ec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:32.594360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1048/2092] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:32.604827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465d60a-7a63-49ed-b1b8-f12311c8d432 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:32.606805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9465d60a-7a63-49ed-b1b8-f12311c8d432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:32.625871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:32.678072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465d60a-7a63-49ed-b1b8-f12311c8d432 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:32.681985 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778cb07-2311-43a2-90ea-b188f9376378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:32.683012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cb07-2311-43a2-90ea-b188f9376378 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:32.683556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cb07-2311-43a2-90ea-b188f9376378 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:32.684056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cb07-2311-43a2-90ea-b188f9376378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:32.700232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778cb07-2311-43a2-90ea-b188f9376378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:32.701800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778cb07-2311-43a2-90ea-b188f9376378 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:32.712636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1045/2093] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:37.039631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3aff8-55ea-4d2d-9e16-4db5861fb0d4 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:37.040076 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3aff8-55ea-4d2d-9e16-4db5861fb0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:37.040076 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3aff8-55ea-4d2d-9e16-4db5861fb0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:37.083610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-38d3aff8-55ea-4d2d-9e16-4db5861fb0d4 None None] MFA Rules not processed for user `b80ab2a9c7504806851400e07074004e`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:37.091154 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-38d3aff8-55ea-4d2d-9e16-4db5861fb0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:37.217928 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1049/2094] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:37.231140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d456f-4ed9-4213-8c48-9ac0b61a0fc7 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:37.231770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d456f-4ed9-4213-8c48-9ac0b61a0fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:37.232125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d456f-4ed9-4213-8c48-9ac0b61a0fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:37.250795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-066d456f-4ed9-4213-8c48-9ac0b61a0fc7 None None] MFA Rules not processed for user `b80ab2a9c7504806851400e07074004e`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:37.252029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-066d456f-4ed9-4213-8c48-9ac0b61a0fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:37.264210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1046/2095] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:37.275200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3aff8-55ea-4d2d-9e16-4db5861fb0d4 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:37.277030 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-38d3aff8-55ea-4d2d-9e16-4db5861fb0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:37.353798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:37.414728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3aff8-55ea-4d2d-9e16-4db5861fb0d4 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:37.421365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe228ef-0bd0-48a2-b060-72eb4eec797e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:37.422356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe228ef-0bd0-48a2-b060-72eb4eec797e service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:37.422765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe228ef-0bd0-48a2-b060-72eb4eec797e service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:37.423139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe228ef-0bd0-48a2-b060-72eb4eec797e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:37.433613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe228ef-0bd0-48a2-b060-72eb4eec797e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:37.435533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe228ef-0bd0-48a2-b060-72eb4eec797e service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:37.448382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1050/2096] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:38.316364 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6d6bd-228b-4981-b6d9-ed6376552907 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:38.316823 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6d6bd-228b-4981-b6d9-ed6376552907 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:38.316933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6d6bd-228b-4981-b6d9-ed6376552907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:38.337132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-55e6d6bd-228b-4981-b6d9-ed6376552907 None None] MFA Rules not processed for user `b80ab2a9c7504806851400e07074004e`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:38.338453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-55e6d6bd-228b-4981-b6d9-ed6376552907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:38.350472 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1047/2097] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:47.445201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=15 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:48.331938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=27 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:55.610095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe228ef-0bd0-48a2-b060-72eb4eec797e service nova] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:55.611651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-8fe228ef-0bd0-48a2-b060-72eb4eec797e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:55.629133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe228ef-0bd0-48a2-b060-72eb4eec797e service nova] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:55.643689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:55.644777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:55.645364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:55.645875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] PATH_INFO: `/v3/users/f1663e4f08e9411fabef17365bf201f5` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:55.647400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1663e4f08e9411fabef17365bf201f5)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:55.650138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:55.729156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1663e4f08e9411fabef17365bf201f5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:55.729864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1663e4f08e9411fabef17365bf201f5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:55.730488 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1663e4f08e9411fabef17365bf201f5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:55.742679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1663e4f08e9411fabef17365bf201f5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:55.750182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1663e4f08e9411fabef17365bf201f5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:55.769238 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1051/2098] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:55 2022] DELETE /identity/v3/users/f1663e4f08e9411fabef17365bf201f5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:55.774979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010121d8-5f2d-4723-a814-84382646be2c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:55.775525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010121d8-5f2d-4723-a814-84382646be2c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:55.775627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010121d8-5f2d-4723-a814-84382646be2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:55.793350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-010121d8-5f2d-4723-a814-84382646be2c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:55.794569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-010121d8-5f2d-4723-a814-84382646be2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:55.859704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1048/2099] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:55.869612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:55.871935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:55.931828 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8862eea-7c16-4831-a84e-ba4e636eeabb admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:55.935740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830eb58c-aa13-4883-8ef5-22b6cbd8be59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:55.936424 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830eb58c-aa13-4883-8ef5-22b6cbd8be59 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:55.936711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830eb58c-aa13-4883-8ef5-22b6cbd8be59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:55.936984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830eb58c-aa13-4883-8ef5-22b6cbd8be59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:55.946589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830eb58c-aa13-4883-8ef5-22b6cbd8be59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:55.948038 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830eb58c-aa13-4883-8ef5-22b6cbd8be59 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:55.959157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1052/2100] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:21:56.266126 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010121d8-5f2d-4723-a814-84382646be2c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:56.267645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-010121d8-5f2d-4723-a814-84382646be2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:56.290464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010121d8-5f2d-4723-a814-84382646be2c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:56.300126 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa7819-abf0-45d7-927f-a70791ab8f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:56.302048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa7819-abf0-45d7-927f-a70791ab8f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:56.302282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa7819-abf0-45d7-927f-a70791ab8f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:56.302608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa7819-abf0-45d7-927f-a70791ab8f6a admin admin] PATH_INFO: `/v3/projects/09a41d9c3b0f42f2ac30d63472e4f0c0` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:56.304041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa7819-abf0-45d7-927f-a70791ab8f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a41d9c3b0f42f2ac30d63472e4f0c0)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:56.306292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa7819-abf0-45d7-927f-a70791ab8f6a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:56.320893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830eb58c-aa13-4883-8ef5-22b6cbd8be59 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:56.322527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-830eb58c-aa13-4883-8ef5-22b6cbd8be59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:56.340145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830eb58c-aa13-4883-8ef5-22b6cbd8be59 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:56.352236 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f80021-a42e-453c-8271-b48de65fb3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:56.353177 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80021-a42e-453c-8271-b48de65fb3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:56.353442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80021-a42e-453c-8271-b48de65fb3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:56.353710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80021-a42e-453c-8271-b48de65fb3db admin admin] PATH_INFO: `/v3/users/d37c1e43b38c4e2dadc52169929c23fc` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:56.354944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f80021-a42e-453c-8271-b48de65fb3db admin admin] RBAC: Authorizing `identity:delete_user(user_id=d37c1e43b38c4e2dadc52169929c23fc)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:56.357022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f80021-a42e-453c-8271-b48de65fb3db admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:56.397696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-11aa7819-abf0-45d7-927f-a70791ab8f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a41d9c3b0f42f2ac30d63472e4f0c0', 'request_id': 'req-11aa7819-abf0-45d7-927f-a70791ab8f6a'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:56.412068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-11aa7819-abf0-45d7-927f-a70791ab8f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a41d9c3b0f42f2ac30d63472e4f0c0', 'request_id': 'req-11aa7819-abf0-45d7-927f-a70791ab8f6a'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:56.424349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-99f80021-a42e-453c-8271-b48de65fb3db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd37c1e43b38c4e2dadc52169929c23fc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:56.425883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-11aa7819-abf0-45d7-927f-a70791ab8f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a41d9c3b0f42f2ac30d63472e4f0c0', 'request_id': 'req-11aa7819-abf0-45d7-927f-a70791ab8f6a'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:56.428074 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-99f80021-a42e-453c-8271-b48de65fb3db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd37c1e43b38c4e2dadc52169929c23fc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:56.429450 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-99f80021-a42e-453c-8271-b48de65fb3db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd37c1e43b38c4e2dadc52169929c23fc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:56.436830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-99f80021-a42e-453c-8271-b48de65fb3db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd37c1e43b38c4e2dadc52169929c23fc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:56.438189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-11aa7819-abf0-45d7-927f-a70791ab8f6a admin admin] The token cache is being invalidate because project 09a41d9c3b0f42f2ac30d63472e4f0c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:56.438617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-11aa7819-abf0-45d7-927f-a70791ab8f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:56.439512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-11aa7819-abf0-45d7-927f-a70791ab8f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:56.442074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1049/2101] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:56 2022] DELETE /identity/v3/projects/09a41d9c3b0f42f2ac30d63472e4f0c0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:56.446838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-99f80021-a42e-453c-8271-b48de65fb3db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd37c1e43b38c4e2dadc52169929c23fc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:56.447827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84bf9f-b404-41a6-9a13-46cc91321119 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:56.448116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84bf9f-b404-41a6-9a13-46cc91321119 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:56.448565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84bf9f-b404-41a6-9a13-46cc91321119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:56.452884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:56.469114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-6d84bf9f-b404-41a6-9a13-46cc91321119 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:56.469761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1053/2102] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:21:56 2022] DELETE /identity/v3/users/d37c1e43b38c4e2dadc52169929c23fc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:56.470505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6d84bf9f-b404-41a6-9a13-46cc91321119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:56.474251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7536a21-2a0a-4340-a003-d5c7e36f5956 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:56.474572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7536a21-2a0a-4340-a003-d5c7e36f5956 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:56.474862 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7536a21-2a0a-4340-a003-d5c7e36f5956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:56.492139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a7536a21-2a0a-4340-a003-d5c7e36f5956 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:56.493391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a7536a21-2a0a-4340-a003-d5c7e36f5956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:56.547374 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1050/2103] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:56.555170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1288cfb-adf8-4a8c-a542-507349ad9a2a None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:56.555381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1288cfb-adf8-4a8c-a542-507349ad9a2a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:56.555662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1288cfb-adf8-4a8c-a542-507349ad9a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:56.567883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1054/2104] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:56.575779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a1288cfb-adf8-4a8c-a542-507349ad9a2a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:56.577111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a1288cfb-adf8-4a8c-a542-507349ad9a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:56.580639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7536a21-2a0a-4340-a003-d5c7e36f5956 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:56.582262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a7536a21-2a0a-4340-a003-d5c7e36f5956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:56.585723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1051/2105] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:56.590264 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1288cfb-adf8-4a8c-a542-507349ad9a2a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:56.600987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1288cfb-adf8-4a8c-a542-507349ad9a2a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:56.606267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f25b6f-05c4-468c-af65-ff0a393fd37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:56.606682 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f25b6f-05c4-468c-af65-ff0a393fd37b admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:56.607061 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f25b6f-05c4-468c-af65-ff0a393fd37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:56.607404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f25b6f-05c4-468c-af65-ff0a393fd37b admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:56.608248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f25b6f-05c4-468c-af65-ff0a393fd37b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:21:56.608756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f25b6f-05c4-468c-af65-ff0a393fd37b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:56.610471 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f25b6f-05c4-468c-af65-ff0a393fd37b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:56.644644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1052/2106] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:21:56.645106 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f25b6f-05c4-468c-af65-ff0a393fd37b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:56.653475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:56.658545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f25b6f-05c4-468c-af65-ff0a393fd37b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:56.659169 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7536a21-2a0a-4340-a003-d5c7e36f5956 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:56.663439 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30269d-16f8-474a-919d-067062f093b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:56.664270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30269d-16f8-474a-919d-067062f093b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:56.664564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30269d-16f8-474a-919d-067062f093b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:56.664906 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30269d-16f8-474a-919d-067062f093b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:56.666627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62cf88-e30d-4afa-b285-30eb1cfd7771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:56.667786 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62cf88-e30d-4afa-b285-30eb1cfd7771 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:56.668432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62cf88-e30d-4afa-b285-30eb1cfd7771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:56.669185 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62cf88-e30d-4afa-b285-30eb1cfd7771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:56.670173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62cf88-e30d-4afa-b285-30eb1cfd7771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:56.672750 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62cf88-e30d-4afa-b285-30eb1cfd7771 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:56.676047 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30269d-16f8-474a-919d-067062f093b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:56.677712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30269d-16f8-474a-919d-067062f093b8 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:56.688244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1055/2107] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:21:56.713673 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1053/2108] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:56 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:21:56.715509 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30269d-16f8-474a-919d-067062f093b8 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:56.738504 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30269d-16f8-474a-919d-067062f093b8 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:56.831247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990e81-800e-4210-a2c4-0aabb88f6d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:56.832199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990e81-800e-4210-a2c4-0aabb88f6d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:56.832549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990e81-800e-4210-a2c4-0aabb88f6d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:56.832920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990e81-800e-4210-a2c4-0aabb88f6d08 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:56.833750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02990e81-800e-4210-a2c4-0aabb88f6d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:56.836767 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02990e81-800e-4210-a2c4-0aabb88f6d08 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:56.890588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1056/2109] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:56 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:56.890938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62cf88-e30d-4afa-b285-30eb1cfd7771 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:56.904686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62cf88-e30d-4afa-b285-30eb1cfd7771 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:56.910201 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5a1b-826b-414a-87b6-f0bdbc270c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:56.911174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5a1b-826b-414a-87b6-f0bdbc270c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:56.911661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5a1b-826b-414a-87b6-f0bdbc270c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:56.912286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5a1b-826b-414a-87b6-f0bdbc270c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:56.913259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b5a1b-826b-414a-87b6-f0bdbc270c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:56.915286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b5a1b-826b-414a-87b6-f0bdbc270c4d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:56.928366 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1054/2110] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:56.932909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990e81-800e-4210-a2c4-0aabb88f6d08 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:56.950321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990e81-800e-4210-a2c4-0aabb88f6d08 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:56.958588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de872eb-cbb7-4870-994d-3dc3da2d2a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:56.959244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de872eb-cbb7-4870-994d-3dc3da2d2a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:56.960250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de872eb-cbb7-4870-994d-3dc3da2d2a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:56.961084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de872eb-cbb7-4870-994d-3dc3da2d2a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:56.962805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de872eb-cbb7-4870-994d-3dc3da2d2a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:56.965663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de872eb-cbb7-4870-994d-3dc3da2d2a1d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:56.983151 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1057/2111] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:56.983724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5a1b-826b-414a-87b6-f0bdbc270c4d admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:56.994570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5a1b-826b-414a-87b6-f0bdbc270c4d admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:56.999862 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773225d-aba1-48cc-a765-0e5e6b825915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.000871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773225d-aba1-48cc-a765-0e5e6b825915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.001154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773225d-aba1-48cc-a765-0e5e6b825915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.005418 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773225d-aba1-48cc-a765-0e5e6b825915 admin admin] PATH_INFO: `/v3/projects/05bd627665e34bfc8e08f1ac68392509/users/1ea3e1da67304248a8ece7e3e64f3f65/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.020552 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773225d-aba1-48cc-a765-0e5e6b825915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bd627665e34bfc8e08f1ac68392509, user_id=1ea3e1da67304248a8ece7e3e64f3f65, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.025032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773225d-aba1-48cc-a765-0e5e6b825915 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.045453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1055/2112] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:56 2022] PUT /identity/v3/projects/05bd627665e34bfc8e08f1ac68392509/users/1ea3e1da67304248a8ece7e3e64f3f65/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:57.055440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de872eb-cbb7-4870-994d-3dc3da2d2a1d admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.057909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0de872eb-cbb7-4870-994d-3dc3da2d2a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:57.058310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759ceaa-1c98-42ba-b625-cb3d69586ef8 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.058692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759ceaa-1c98-42ba-b625-cb3d69586ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.059156 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759ceaa-1c98-42ba-b625-cb3d69586ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.073860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de872eb-cbb7-4870-994d-3dc3da2d2a1d admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.079561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:57.110909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a759ceaa-1c98-42ba-b625-cb3d69586ef8 None None] MFA Rules not processed for user `1ea3e1da67304248a8ece7e3e64f3f65`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:57.112522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a759ceaa-1c98-42ba-b625-cb3d69586ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:57.176582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11804301-0676-4a38-a379-38d2f83d5478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.177915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11804301-0676-4a38-a379-38d2f83d5478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.178433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11804301-0676-4a38-a379-38d2f83d5478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.178859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11804301-0676-4a38-a379-38d2f83d5478 admin admin] PATH_INFO: `/v3/projects/6744b2331bb84a4daca8d7a9cb84103b` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.181311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11804301-0676-4a38-a379-38d2f83d5478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6744b2331bb84a4daca8d7a9cb84103b)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.185113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11804301-0676-4a38-a379-38d2f83d5478 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.220654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1056/2113] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:57.225531 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759ceaa-1c98-42ba-b625-cb3d69586ef8 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.242141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759ceaa-1c98-42ba-b625-cb3d69586ef8 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.253107 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-11804301-0676-4a38-a379-38d2f83d5478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6744b2331bb84a4daca8d7a9cb84103b', 'request_id': 'req-11804301-0676-4a38-a379-38d2f83d5478'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:57.261670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-11804301-0676-4a38-a379-38d2f83d5478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6744b2331bb84a4daca8d7a9cb84103b', 'request_id': 'req-11804301-0676-4a38-a379-38d2f83d5478'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:57.268159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-11804301-0676-4a38-a379-38d2f83d5478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6744b2331bb84a4daca8d7a9cb84103b', 'request_id': 'req-11804301-0676-4a38-a379-38d2f83d5478'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:57.281709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-11804301-0676-4a38-a379-38d2f83d5478 admin admin] The token cache is being invalidate because project 6744b2331bb84a4daca8d7a9cb84103b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:21:57.281985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-11804301-0676-4a38-a379-38d2f83d5478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:57.282668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-11804301-0676-4a38-a379-38d2f83d5478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:21:57.284302 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1058/2114] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:21:57 2022] DELETE /identity/v3/projects/6744b2331bb84a4daca8d7a9cb84103b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:57.289122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c207af-219c-45ef-a4bf-b42762940f6b None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.289446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c207af-219c-45ef-a4bf-b42762940f6b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.289748 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c207af-219c-45ef-a4bf-b42762940f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.303679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4cd4c-4e33-4063-9f61-339756e2656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.304360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4cd4c-4e33-4063-9f61-339756e2656e admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.304697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4cd4c-4e33-4063-9f61-339756e2656e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.304975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4cd4c-4e33-4063-9f61-339756e2656e admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.305786 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4cd4c-4e33-4063-9f61-339756e2656e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.307741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4cd4c-4e33-4063-9f61-339756e2656e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.309703 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-f8c207af-219c-45ef-a4bf-b42762940f6b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:57.310866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f8c207af-219c-45ef-a4bf-b42762940f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:57.320316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1059/2115] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:57.329306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afc552-8954-483b-a5c1-6d08cf0feac0 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.329729 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afc552-8954-483b-a5c1-6d08cf0feac0 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.330012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afc552-8954-483b-a5c1-6d08cf0feac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.340562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1057/2116] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:57 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:57.345448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4cd4c-4e33-4063-9f61-339756e2656e admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.347170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-30f4cd4c-4e33-4063-9f61-339756e2656e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:57.351328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-45afc552-8954-483b-a5c1-6d08cf0feac0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:57.352740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-45afc552-8954-483b-a5c1-6d08cf0feac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:57.382326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:57.447965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1060/2117] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:57.449142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afc552-8954-483b-a5c1-6d08cf0feac0 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.452381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4cd4c-4e33-4063-9f61-339756e2656e admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.459458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fe972-eac1-4f62-8ba6-714161b00adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.460971 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fe972-eac1-4f62-8ba6-714161b00adf admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.461112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afc552-8954-483b-a5c1-6d08cf0feac0 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.461197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fe972-eac1-4f62-8ba6-714161b00adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.461197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fe972-eac1-4f62-8ba6-714161b00adf admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.461674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fe972-eac1-4f62-8ba6-714161b00adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.463706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fe972-eac1-4f62-8ba6-714161b00adf admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.466979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901f49e-b479-4932-8686-c28239a9644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.467644 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901f49e-b479-4932-8686-c28239a9644a admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.468578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901f49e-b479-4932-8686-c28239a9644a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.468578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901f49e-b479-4932-8686-c28239a9644a admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.469198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901f49e-b479-4932-8686-c28239a9644a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:21:57.471341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901f49e-b479-4932-8686-c28239a9644a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.472137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901f49e-b479-4932-8686-c28239a9644a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.492338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1061/2118] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:21:57.493855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901f49e-b479-4932-8686-c28239a9644a admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.496751 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1058/2119] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:57 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:57.501022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fe972-eac1-4f62-8ba6-714161b00adf admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.505779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901f49e-b479-4932-8686-c28239a9644a admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.513249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844e570-0724-4e2a-9eca-76d1cd23db84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.513992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fe972-eac1-4f62-8ba6-714161b00adf admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.514102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e570-0724-4e2a-9eca-76d1cd23db84 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.514102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e570-0724-4e2a-9eca-76d1cd23db84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.514102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e570-0724-4e2a-9eca-76d1cd23db84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.514649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844e570-0724-4e2a-9eca-76d1cd23db84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.516690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844e570-0724-4e2a-9eca-76d1cd23db84 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.520710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eebcb2-5d91-4eec-88df-540acc27e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.521459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eebcb2-5d91-4eec-88df-540acc27e266 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.521749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eebcb2-5d91-4eec-88df-540acc27e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.522025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eebcb2-5d91-4eec-88df-540acc27e266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.522783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eebcb2-5d91-4eec-88df-540acc27e266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.524436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eebcb2-5d91-4eec-88df-540acc27e266 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.538360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1059/2120] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:57.540853 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:57.543508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eebcb2-5d91-4eec-88df-540acc27e266 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.553412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1062/2121] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:57 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:57.556796 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eebcb2-5d91-4eec-88df-540acc27e266 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.557876 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844e570-0724-4e2a-9eca-76d1cd23db84 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.638784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844e570-0724-4e2a-9eca-76d1cd23db84 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.639257 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38bfb6-3672-421d-817c-4a87076f2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.640163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38bfb6-3672-421d-817c-4a87076f2ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.640585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38bfb6-3672-421d-817c-4a87076f2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.640972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38bfb6-3672-421d-817c-4a87076f2ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.642088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38bfb6-3672-421d-817c-4a87076f2ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.643907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38bfb6-3672-421d-817c-4a87076f2ac9 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.649882 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10176459-8cb8-4eaf-82eb-6510bdc11792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.652018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10176459-8cb8-4eaf-82eb-6510bdc11792 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.652545 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10176459-8cb8-4eaf-82eb-6510bdc11792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.653063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10176459-8cb8-4eaf-82eb-6510bdc11792 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.654436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10176459-8cb8-4eaf-82eb-6510bdc11792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.656659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1060/2122] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:57.662815 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10176459-8cb8-4eaf-82eb-6510bdc11792 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.663909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38bfb6-3672-421d-817c-4a87076f2ac9 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.680304 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38bfb6-3672-421d-817c-4a87076f2ac9 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.689777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca44a2-5553-430b-a627-66747544018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.690610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca44a2-5553-430b-a627-66747544018d admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.691080 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca44a2-5553-430b-a627-66747544018d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.691934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca44a2-5553-430b-a627-66747544018d admin admin] PATH_INFO: `/v3/projects/6b70ca4dea774329814708534a8f2fe6/users/ece62bb1e357415691c48b4817c5b547/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.700643 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1063/2123] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:57 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:21:57.701934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10176459-8cb8-4eaf-82eb-6510bdc11792 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.718455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10176459-8cb8-4eaf-82eb-6510bdc11792 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.726639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca44a2-5553-430b-a627-66747544018d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b70ca4dea774329814708534a8f2fe6, user_id=ece62bb1e357415691c48b4817c5b547, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.726867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69498bb-d012-4e77-a561-71b0e0d73ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.727840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69498bb-d012-4e77-a561-71b0e0d73ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.728297 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69498bb-d012-4e77-a561-71b0e0d73ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.728760 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69498bb-d012-4e77-a561-71b0e0d73ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.730088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69498bb-d012-4e77-a561-71b0e0d73ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.731737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca44a2-5553-430b-a627-66747544018d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.732985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69498bb-d012-4e77-a561-71b0e0d73ab2 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.754470 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1064/2124] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:57.757016 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1061/2125] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:57 2022] PUT /identity/v3/projects/6b70ca4dea774329814708534a8f2fe6/users/ece62bb1e357415691c48b4817c5b547/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:57.759667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69498bb-d012-4e77-a561-71b0e0d73ab2 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.776556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c42a-0321-400e-a45f-d7866df6f777 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.777029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c42a-0321-400e-a45f-d7866df6f777 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.777826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c42a-0321-400e-a45f-d7866df6f777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.779288 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69498bb-d012-4e77-a561-71b0e0d73ab2 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.817663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-1a22c42a-0321-400e-a45f-d7866df6f777 None None] MFA Rules not processed for user `ece62bb1e357415691c48b4817c5b547`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:57.819836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1a22c42a-0321-400e-a45f-d7866df6f777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:57.885619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc4a37-6bf2-45c2-9c5e-f1976078615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.886543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc4a37-6bf2-45c2-9c5e-f1976078615a admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.886891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc4a37-6bf2-45c2-9c5e-f1976078615a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.887255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc4a37-6bf2-45c2-9c5e-f1976078615a admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.888118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc4a37-6bf2-45c2-9c5e-f1976078615a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.890374 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc4a37-6bf2-45c2-9c5e-f1976078615a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.907563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1065/2126] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:57.911677 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc4a37-6bf2-45c2-9c5e-f1976078615a admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.924659 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc4a37-6bf2-45c2-9c5e-f1976078615a admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.931429 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f45bcb-dc23-4af7-8ca5-06a0b2a9b07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.932375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f45bcb-dc23-4af7-8ca5-06a0b2a9b07e admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.932661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f45bcb-dc23-4af7-8ca5-06a0b2a9b07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.933060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f45bcb-dc23-4af7-8ca5-06a0b2a9b07e admin admin] PATH_INFO: `/v3/projects/fb6fd4575d2b4d07aaa96ea1e38b6f74/users/80ef66d8d1274839a54f0d34576aa914/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.939945 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1062/2127] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:57.946471 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22c42a-0321-400e-a45f-d7866df6f777 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:57.952438 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:57.958320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f45bcb-dc23-4af7-8ca5-06a0b2a9b07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6fd4575d2b4d07aaa96ea1e38b6f74, user_id=80ef66d8d1274839a54f0d34576aa914, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.960239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22c42a-0321-400e-a45f-d7866df6f777 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:57.961760 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f45bcb-dc23-4af7-8ca5-06a0b2a9b07e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.966337 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9169d-d194-4986-baa0-91132f5b1150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:57.967507 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9169d-d194-4986-baa0-91132f5b1150 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.968129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9169d-d194-4986-baa0-91132f5b1150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.969390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9169d-d194-4986-baa0-91132f5b1150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:57.969390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9169d-d194-4986-baa0-91132f5b1150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:57.971564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9169d-d194-4986-baa0-91132f5b1150 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:57.980843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1066/2128] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:57 2022] PUT /identity/v3/projects/fb6fd4575d2b4d07aaa96ea1e38b6f74/users/80ef66d8d1274839a54f0d34576aa914/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:57.992483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4afc17-c2a4-4117-93d7-6364ef787dd5 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:57.992826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4afc17-c2a4-4117-93d7-6364ef787dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:57.993244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4afc17-c2a4-4117-93d7-6364ef787dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.002202 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1063/2129] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:57 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:58.006287 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9169d-d194-4986-baa0-91132f5b1150 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.028673 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-4f4afc17-c2a4-4117-93d7-6364ef787dd5 None None] MFA Rules not processed for user `80ef66d8d1274839a54f0d34576aa914`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:58.031289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4f4afc17-c2a4-4117-93d7-6364ef787dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:58.090072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:58.093892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9169d-d194-4986-baa0-91132f5b1150 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.102934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0f99a-a6de-48ea-9d52-e2fa254d71e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.103791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0f99a-a6de-48ea-9d52-e2fa254d71e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.104397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0f99a-a6de-48ea-9d52-e2fa254d71e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.104397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0f99a-a6de-48ea-9d52-e2fa254d71e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.105337 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0f99a-a6de-48ea-9d52-e2fa254d71e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.107592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0f99a-a6de-48ea-9d52-e2fa254d71e1 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.128835 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1067/2130] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:58.133263 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4afc17-c2a4-4117-93d7-6364ef787dd5 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.139152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1064/2131] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:58 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:21:58.143027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0f99a-a6de-48ea-9d52-e2fa254d71e1 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.148228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4afc17-c2a4-4117-93d7-6364ef787dd5 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.157022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55ad93-d649-41bf-a2d1-6f26cd2f30ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.157825 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55ad93-d649-41bf-a2d1-6f26cd2f30ec admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.158401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0f99a-a6de-48ea-9d52-e2fa254d71e1 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.161572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55ad93-d649-41bf-a2d1-6f26cd2f30ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.162355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55ad93-d649-41bf-a2d1-6f26cd2f30ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.163620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55ad93-d649-41bf-a2d1-6f26cd2f30ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.165939 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55ad93-d649-41bf-a2d1-6f26cd2f30ec admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.168348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215eaff1-bc60-470a-99f9-69b1b5500890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.169208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eaff1-bc60-470a-99f9-69b1b5500890 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.169522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eaff1-bc60-470a-99f9-69b1b5500890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.169806 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eaff1-bc60-470a-99f9-69b1b5500890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.170554 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215eaff1-bc60-470a-99f9-69b1b5500890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.172292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215eaff1-bc60-470a-99f9-69b1b5500890 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.186699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1065/2132] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:58.191644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215eaff1-bc60-470a-99f9-69b1b5500890 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.200287 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1068/2133] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:58 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:58.204746 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55ad93-d649-41bf-a2d1-6f26cd2f30ec admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.207128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215eaff1-bc60-470a-99f9-69b1b5500890 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.284085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a850e-6e2e-42b9-a9b5-023a36682453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.285137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a850e-6e2e-42b9-a9b5-023a36682453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.285460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a850e-6e2e-42b9-a9b5-023a36682453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.285732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a850e-6e2e-42b9-a9b5-023a36682453 admin admin] PATH_INFO: `/v3/projects/29bd2ce19be1410f99ff8b123fd8a1d3/users/e5d38be2f43944e09b4ca9e9d673e4f8/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.292027 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55ad93-d649-41bf-a2d1-6f26cd2f30ec admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.298519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6f2f9-b60d-4701-bbe9-7033c61942b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.299452 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f2f9-b60d-4701-bbe9-7033c61942b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.299772 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f2f9-b60d-4701-bbe9-7033c61942b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.300062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f2f9-b60d-4701-bbe9-7033c61942b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.301027 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6f2f9-b60d-4701-bbe9-7033c61942b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.303889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6f2f9-b60d-4701-bbe9-7033c61942b7 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.305190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a850e-6e2e-42b9-a9b5-023a36682453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bd2ce19be1410f99ff8b123fd8a1d3, user_id=e5d38be2f43944e09b4ca9e9d673e4f8, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.307992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a850e-6e2e-42b9-a9b5-023a36682453 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.325319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1066/2134] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:58 2022] PUT /identity/v3/projects/29bd2ce19be1410f99ff8b123fd8a1d3/users/e5d38be2f43944e09b4ca9e9d673e4f8/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:58.335132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a850e-6e2e-42b9-a9b5-023a36682453 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.335420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1069/2135] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:58 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:58.336112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6f2f9-b60d-4701-bbe9-7033c61942b7 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.346961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6f2f9-b60d-4701-bbe9-7033c61942b7 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.384274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:58.400998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a850e-6e2e-42b9-a9b5-023a36682453 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.406107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7c7e2-2229-42dc-893f-a7569643180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.406790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7c7e2-2229-42dc-893f-a7569643180b admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.407216 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7c7e2-2229-42dc-893f-a7569643180b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.407493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7c7e2-2229-42dc-893f-a7569643180b admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.408231 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7c7e2-2229-42dc-893f-a7569643180b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.409883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7c7e2-2229-42dc-893f-a7569643180b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.427323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1067/2136] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:58.428571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7c7e2-2229-42dc-893f-a7569643180b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.430316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dfd58-2c3a-492c-b2cc-8432f47eff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.431002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dfd58-2c3a-492c-b2cc-8432f47eff29 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.431277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dfd58-2c3a-492c-b2cc-8432f47eff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.431558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dfd58-2c3a-492c-b2cc-8432f47eff29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.432294 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dfd58-2c3a-492c-b2cc-8432f47eff29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.433984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dfd58-2c3a-492c-b2cc-8432f47eff29 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.439466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7c7e2-2229-42dc-893f-a7569643180b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.444688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939f426-661a-4dce-afbf-957e0b9aea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.445209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1070/2137] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:58.448417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939f426-661a-4dce-afbf-957e0b9aea10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.448701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939f426-661a-4dce-afbf-957e0b9aea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.448984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939f426-661a-4dce-afbf-957e0b9aea10 admin admin] PATH_INFO: `/v3/projects/29bd2ce19be1410f99ff8b123fd8a1d3/users/e5d38be2f43944e09b4ca9e9d673e4f8/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.449474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dfd58-2c3a-492c-b2cc-8432f47eff29 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.451128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939f426-661a-4dce-afbf-957e0b9aea10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bd2ce19be1410f99ff8b123fd8a1d3, user_id=e5d38be2f43944e09b4ca9e9d673e4f8, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.453944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939f426-661a-4dce-afbf-957e0b9aea10 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.459723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dfd58-2c3a-492c-b2cc-8432f47eff29 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.465112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1068/2138] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:58 2022] PUT /identity/v3/projects/29bd2ce19be1410f99ff8b123fd8a1d3/users/e5d38be2f43944e09b4ca9e9d673e4f8/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:58.475570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc630524-35fc-4743-8f65-599e867d7022 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.475866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc630524-35fc-4743-8f65-599e867d7022 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.476148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc630524-35fc-4743-8f65-599e867d7022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.502716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:58.507635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-dc630524-35fc-4743-8f65-599e867d7022 None None] MFA Rules not processed for user `e5d38be2f43944e09b4ca9e9d673e4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:58.508866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-dc630524-35fc-4743-8f65-599e867d7022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:58.520638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb2503-d107-4c11-9b1e-88e03c890a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.521350 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb2503-d107-4c11-9b1e-88e03c890a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.521658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb2503-d107-4c11-9b1e-88e03c890a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.521940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb2503-d107-4c11-9b1e-88e03c890a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.522669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb2503-d107-4c11-9b1e-88e03c890a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.524278 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb2503-d107-4c11-9b1e-88e03c890a2a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.538194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1071/2139] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:58.542387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb2503-d107-4c11-9b1e-88e03c890a2a admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.552718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb2503-d107-4c11-9b1e-88e03c890a2a admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.557657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05a358-9a77-4b9c-8a8e-e24b4242aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.558672 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05a358-9a77-4b9c-8a8e-e24b4242aa8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.558952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05a358-9a77-4b9c-8a8e-e24b4242aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.559223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05a358-9a77-4b9c-8a8e-e24b4242aa8d admin admin] PATH_INFO: `/v3/projects/ee7471dee55c4579ab12fa06fcd43f51/users/291744bf4e8a44c69412ddaede11826d/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.579069 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05a358-9a77-4b9c-8a8e-e24b4242aa8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7471dee55c4579ab12fa06fcd43f51, user_id=291744bf4e8a44c69412ddaede11826d, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.582909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05a358-9a77-4b9c-8a8e-e24b4242aa8d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.584286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1069/2140] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:58.598813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc630524-35fc-4743-8f65-599e867d7022 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.599632 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1072/2141] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:58 2022] PUT /identity/v3/projects/ee7471dee55c4579ab12fa06fcd43f51/users/291744bf4e8a44c69412ddaede11826d/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:58.600326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-dc630524-35fc-4743-8f65-599e867d7022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:58.609793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c600721-988d-4f4d-bd13-5ee6bf1847b7 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.610083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c600721-988d-4f4d-bd13-5ee6bf1847b7 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.610363 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c600721-988d-4f4d-bd13-5ee6bf1847b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.636954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0c600721-988d-4f4d-bd13-5ee6bf1847b7 None None] MFA Rules not processed for user `291744bf4e8a44c69412ddaede11826d`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:58.638218 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0c600721-988d-4f4d-bd13-5ee6bf1847b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:58.667708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc630524-35fc-4743-8f65-599e867d7022 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.708342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1073/2142] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:21:58.712537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c600721-988d-4f4d-bd13-5ee6bf1847b7 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.724053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70585e-5cdb-4412-8827-b889f5676c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.724669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70585e-5cdb-4412-8827-b889f5676c35 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.724951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70585e-5cdb-4412-8827-b889f5676c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.725855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70585e-5cdb-4412-8827-b889f5676c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.727089 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3c70585e-5cdb-4412-8827-b889f5676c35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:58.752177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:58.780819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c600721-988d-4f4d-bd13-5ee6bf1847b7 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.787067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf9b64-6664-4476-bb7a-dee310036a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.787276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf9b64-6664-4476-bb7a-dee310036a59 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.787785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf9b64-6664-4476-bb7a-dee310036a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.788073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf9b64-6664-4476-bb7a-dee310036a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.788903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf9b64-6664-4476-bb7a-dee310036a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.791037 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf9b64-6664-4476-bb7a-dee310036a59 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.794295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70585e-5cdb-4412-8827-b889f5676c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.795788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70585e-5cdb-4412-8827-b889f5676c35 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.805788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1070/2143] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:21:58.822828 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1074/2144] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:21:58 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:21:58.827429 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70585e-5cdb-4412-8827-b889f5676c35 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.838781 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70585e-5cdb-4412-8827-b889f5676c35 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.908652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e643d2e-a5ed-4aaa-8432-8ce75bce8c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.909394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e643d2e-a5ed-4aaa-8432-8ce75bce8c61 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.909669 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e643d2e-a5ed-4aaa-8432-8ce75bce8c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.909949 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e643d2e-a5ed-4aaa-8432-8ce75bce8c61 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.910764 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e643d2e-a5ed-4aaa-8432-8ce75bce8c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.912617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e643d2e-a5ed-4aaa-8432-8ce75bce8c61 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.940164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1071/2145] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:21:58 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:21:58.941712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf9b64-6664-4476-bb7a-dee310036a59 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:58.954553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf9b64-6664-4476-bb7a-dee310036a59 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:58.960059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31432674-5ccd-409e-a560-f8597ded17b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:58.960747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31432674-5ccd-409e-a560-f8597ded17b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:58.961046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31432674-5ccd-409e-a560-f8597ded17b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:58.961374 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31432674-5ccd-409e-a560-f8597ded17b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:58.962333 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31432674-5ccd-409e-a560-f8597ded17b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:58.972581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31432674-5ccd-409e-a560-f8597ded17b8 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:58.985747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1075/2146] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:21:58.990238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e643d2e-a5ed-4aaa-8432-8ce75bce8c61 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:59.001258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e643d2e-a5ed-4aaa-8432-8ce75bce8c61 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:59.005946 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56013c-5837-456c-aeab-33d13e043b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:59.006849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56013c-5837-456c-aeab-33d13e043b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:59.007163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56013c-5837-456c-aeab-33d13e043b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:59.007598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56013c-5837-456c-aeab-33d13e043b40 admin admin] PATH_INFO: `/v3/projects/07f7aec6b365438f9cdd511bd491e728/users/d0368450cdf04bf0a7af614db8646fb2/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:59.031454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56013c-5837-456c-aeab-33d13e043b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f7aec6b365438f9cdd511bd491e728, user_id=d0368450cdf04bf0a7af614db8646fb2, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:59.034813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56013c-5837-456c-aeab-33d13e043b40 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:59.050540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1072/2147] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:58 2022] PUT /identity/v3/projects/07f7aec6b365438f9cdd511bd491e728/users/d0368450cdf04bf0a7af614db8646fb2/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:21:59.054713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31432674-5ccd-409e-a560-f8597ded17b8 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:59.065827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31432674-5ccd-409e-a560-f8597ded17b8 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:59.079828 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:59.151153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0441e58-c630-4c7c-aa70-685ee68dfea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:59.152007 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0441e58-c630-4c7c-aa70-685ee68dfea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:59.152380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0441e58-c630-4c7c-aa70-685ee68dfea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:59.152761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0441e58-c630-4c7c-aa70-685ee68dfea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:59.153773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0441e58-c630-4c7c-aa70-685ee68dfea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:59.155934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0441e58-c630-4c7c-aa70-685ee68dfea5 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:59.168064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1076/2148] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:21:59.177869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56013c-5837-456c-aeab-33d13e043b40 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:59.189559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56013c-5837-456c-aeab-33d13e043b40 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:59.194264 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793d9e1-e63c-4419-8b7c-77469b12035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:59.195194 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793d9e1-e63c-4419-8b7c-77469b12035b admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:59.195470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793d9e1-e63c-4419-8b7c-77469b12035b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:59.195740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793d9e1-e63c-4419-8b7c-77469b12035b admin admin] PATH_INFO: `/v3/projects/07f7aec6b365438f9cdd511bd491e728/users/d0368450cdf04bf0a7af614db8646fb2/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:59.197744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793d9e1-e63c-4419-8b7c-77469b12035b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f7aec6b365438f9cdd511bd491e728, user_id=d0368450cdf04bf0a7af614db8646fb2, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:59.200401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793d9e1-e63c-4419-8b7c-77469b12035b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:59.214594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1073/2149] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:21:59 2022] PUT /identity/v3/projects/07f7aec6b365438f9cdd511bd491e728/users/d0368450cdf04bf0a7af614db8646fb2/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:21:59.226173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c64d22-cee0-4e7a-80bf-a64540ed034d None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:59.226473 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c64d22-cee0-4e7a-80bf-a64540ed034d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:59.226755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c64d22-cee0-4e7a-80bf-a64540ed034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:59.256556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a3c64d22-cee0-4e7a-80bf-a64540ed034d None None] MFA Rules not processed for user `d0368450cdf04bf0a7af614db8646fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:21:59.258021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a3c64d22-cee0-4e7a-80bf-a64540ed034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:59.342407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1077/2150] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:21:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:21:59.356392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793d9e1-e63c-4419-8b7c-77469b12035b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:21:59.358463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7793d9e1-e63c-4419-8b7c-77469b12035b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:21:59.424950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793d9e1-e63c-4419-8b7c-77469b12035b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:21:59.428790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45ba44-9d24-4db2-8256-46f5d0e7e3f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:21:59.429484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45ba44-9d24-4db2-8256-46f5d0e7e3f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:21:59.429770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45ba44-9d24-4db2-8256-46f5d0e7e3f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:21:59.430054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45ba44-9d24-4db2-8256-46f5d0e7e3f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:21:59.459691 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:59.493653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45ba44-9d24-4db2-8256-46f5d0e7e3f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:21:59.495115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45ba44-9d24-4db2-8256-46f5d0e7e3f1 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:21:59.504896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1074/2151] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:21:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:01.519570 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c64d22-cee0-4e7a-80bf-a64540ed034d None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:01.529955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c64d22-cee0-4e7a-80bf-a64540ed034d None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:01.533937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b5bec-6a58-44be-904c-12f155538e19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:01.534609 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b5bec-6a58-44be-904c-12f155538e19 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:01.534914 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b5bec-6a58-44be-904c-12f155538e19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:01.535190 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b5bec-6a58-44be-904c-12f155538e19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:01.626191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b5bec-6a58-44be-904c-12f155538e19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:01.627675 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b5bec-6a58-44be-904c-12f155538e19 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:01.641143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1078/2152] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:02.115879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45ba44-9d24-4db2-8256-46f5d0e7e3f1 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:02.125077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45ba44-9d24-4db2-8256-46f5d0e7e3f1 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:02.130509 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291483a-e12f-42c4-8c00-b0f94bccfef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:02.131356 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291483a-e12f-42c4-8c00-b0f94bccfef6 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:02.132095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291483a-e12f-42c4-8c00-b0f94bccfef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:02.132603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291483a-e12f-42c4-8c00-b0f94bccfef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:02.212542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291483a-e12f-42c4-8c00-b0f94bccfef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:02.214131 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291483a-e12f-42c4-8c00-b0f94bccfef6 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:02.226337 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1075/2153] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:02.300974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b5bec-6a58-44be-904c-12f155538e19 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:02.309931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b5bec-6a58-44be-904c-12f155538e19 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:02.314235 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4061e63-080f-4471-897a-e151e64ebb4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:02.314964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061e63-080f-4471-897a-e151e64ebb4c service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:02.315595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061e63-080f-4471-897a-e151e64ebb4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:02.315595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061e63-080f-4471-897a-e151e64ebb4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:02.360757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:02.411909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4061e63-080f-4471-897a-e151e64ebb4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:02.413418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4061e63-080f-4471-897a-e151e64ebb4c service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:02.424801 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1079/2154] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:02.985562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291483a-e12f-42c4-8c00-b0f94bccfef6 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:03.005832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291483a-e12f-42c4-8c00-b0f94bccfef6 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:03.014568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f51d8c-3bde-43b4-b6ce-667b81656a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:03.015431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f51d8c-3bde-43b4-b6ce-667b81656a85 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:03.015774 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f51d8c-3bde-43b4-b6ce-667b81656a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:03.015996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f51d8c-3bde-43b4-b6ce-667b81656a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:03.029346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f51d8c-3bde-43b4-b6ce-667b81656a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:03.031565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f51d8c-3bde-43b4-b6ce-667b81656a85 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:03.043006 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1076/2155] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:06.769437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4061e63-080f-4471-897a-e151e64ebb4c service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:06.882013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4061e63-080f-4471-897a-e151e64ebb4c service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:06.889884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:06.890796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:06.891079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:06.891360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] PATH_INFO: `/v3/users/1ea3e1da67304248a8ece7e3e64f3f65` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:06.892820 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea3e1da67304248a8ece7e3e64f3f65)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:06.895083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:06.962468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea3e1da67304248a8ece7e3e64f3f65'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:06.963113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea3e1da67304248a8ece7e3e64f3f65'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:06.963744 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea3e1da67304248a8ece7e3e64f3f65'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:06.972455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea3e1da67304248a8ece7e3e64f3f65'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:06.981948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea3e1da67304248a8ece7e3e64f3f65'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:07.003063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1080/2156] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:22:06 2022] DELETE /identity/v3/users/1ea3e1da67304248a8ece7e3e64f3f65 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:07.007747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e49b3c-49f3-4a8a-bed7-9faa2ae83571 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:07.008305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e49b3c-49f3-4a8a-bed7-9faa2ae83571 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:07.008305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e49b3c-49f3-4a8a-bed7-9faa2ae83571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:07.026494 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-22e49b3c-49f3-4a8a-bed7-9faa2ae83571 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:07.027714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-22e49b3c-49f3-4a8a-bed7-9faa2ae83571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:07.111184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:07.112997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:07.118782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1077/2157] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:07.128832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e49b3c-49f3-4a8a-bed7-9faa2ae83571 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:07.130603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-22e49b3c-49f3-4a8a-bed7-9faa2ae83571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:07.132191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed65d00-e31d-430f-be6e-eda2783971e2 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:07.140810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:07.142159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:07.142439 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:07.142715 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] PATH_INFO: `/v3/users/80ef66d8d1274839a54f0d34576aa914` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:07.144253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ef66d8d1274839a54f0d34576aa914)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:07.146326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:07.212009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:07.214221 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e49b3c-49f3-4a8a-bed7-9faa2ae83571 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:07.214400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ef66d8d1274839a54f0d34576aa914'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:07.215708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ef66d8d1274839a54f0d34576aa914'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:07.216733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ef66d8d1274839a54f0d34576aa914'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:07.219481 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778514de-81bc-44bb-8a26-0797384c63de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:07.220612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778514de-81bc-44bb-8a26-0797384c63de service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:07.221096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778514de-81bc-44bb-8a26-0797384c63de service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:07.221599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778514de-81bc-44bb-8a26-0797384c63de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:07.223769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-778514de-81bc-44bb-8a26-0797384c63de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:07.226805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ef66d8d1274839a54f0d34576aa914'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:07.234168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:07.237050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ef66d8d1274839a54f0d34576aa914'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:07.238380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778514de-81bc-44bb-8a26-0797384c63de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:07.241072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778514de-81bc-44bb-8a26-0797384c63de service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:07.258232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1078/2158] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:07.263456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1081/2159] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:22:07 2022] DELETE /identity/v3/users/80ef66d8d1274839a54f0d34576aa914 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:22:07.269135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3ba20-468d-472a-a7c0-b952d3576a90 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:07.269758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3ba20-468d-472a-a7c0-b952d3576a90 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:07.270253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3ba20-468d-472a-a7c0-b952d3576a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:07.292841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-00d3ba20-468d-472a-a7c0-b952d3576a90 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:07.294194 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-00d3ba20-468d-472a-a7c0-b952d3576a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:07.374339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1079/2160] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:07.384787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:07.386295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:07.462641 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f1512-6b65-491b-9e30-33ecca45909d admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:07.466504 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a203f7-cd0c-489b-aa85-935c7549f493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:07.467170 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a203f7-cd0c-489b-aa85-935c7549f493 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:07.467514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a203f7-cd0c-489b-aa85-935c7549f493 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:07.468004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a203f7-cd0c-489b-aa85-935c7549f493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:07.479352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a203f7-cd0c-489b-aa85-935c7549f493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:07.480972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a203f7-cd0c-489b-aa85-935c7549f493 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:07.492852 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1082/2161] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:22:07.774274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3ba20-468d-472a-a7c0-b952d3576a90 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:07.776300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-00d3ba20-468d-472a-a7c0-b952d3576a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:07.797062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3ba20-468d-472a-a7c0-b952d3576a90 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:07.806617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:07.807828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:07.808123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:07.808561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] PATH_INFO: `/v3/projects/05bd627665e34bfc8e08f1ac68392509` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:07.810098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bd627665e34bfc8e08f1ac68392509)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:07.817545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:07.895189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bd627665e34bfc8e08f1ac68392509', 'request_id': 'req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:07.903000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bd627665e34bfc8e08f1ac68392509', 'request_id': 'req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:07.912665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bd627665e34bfc8e08f1ac68392509', 'request_id': 'req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:07.927552 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] The token cache is being invalidate because project 05bd627665e34bfc8e08f1ac68392509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:22:07.927861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:07.928539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:07.930560 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1080/2162] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:22:07 2022] DELETE /identity/v3/projects/05bd627665e34bfc8e08f1ac68392509 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:07.934497 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a203f7-cd0c-489b-aa85-935c7549f493 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:07.945574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a203f7-cd0c-489b-aa85-935c7549f493 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:07.995242 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:07.996747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:08.050187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:08.054681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:08.055137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:08.055598 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] PATH_INFO: `/v3/users/ece62bb1e357415691c48b4817c5b547` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:08.058043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece62bb1e357415691c48b4817c5b547)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:08.062299 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:08.096967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b90f3-9e8b-434d-9ddd-0be2ae9d0175 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:08.103820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:08.105259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:08.105733 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:08.106169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] PATH_INFO: `/v3/projects/fb6fd4575d2b4d07aaa96ea1e38b6f74` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:08.109627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6fd4575d2b4d07aaa96ea1e38b6f74)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:08.112592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:08.147732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece62bb1e357415691c48b4817c5b547'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.148564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece62bb1e357415691c48b4817c5b547'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.149848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece62bb1e357415691c48b4817c5b547'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.151683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:08.166883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece62bb1e357415691c48b4817c5b547'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.182222 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece62bb1e357415691c48b4817c5b547'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.196639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:08.196854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6fd4575d2b4d07aaa96ea1e38b6f74', 'request_id': 'req-b1c2ab69-1a98-4418-acb1-5f80a45e6829'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.211860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6fd4575d2b4d07aaa96ea1e38b6f74', 'request_id': 'req-b1c2ab69-1a98-4418-acb1-5f80a45e6829'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.221269 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1083/2163] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:22:07 2022] DELETE /identity/v3/users/ece62bb1e357415691c48b4817c5b547 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:22:08.235776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6fd4575d2b4d07aaa96ea1e38b6f74', 'request_id': 'req-b1c2ab69-1a98-4418-acb1-5f80a45e6829'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.260299 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] The token cache is being invalidate because project fb6fd4575d2b4d07aaa96ea1e38b6f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:22:08.260811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.262298 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.265287 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1081/2164] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:22:07 2022] DELETE /identity/v3/projects/fb6fd4575d2b4d07aaa96ea1e38b6f74 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:22:08.270181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:08.272501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:08.375108 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae0ff7-79c8-41e8-8ce7-6b386ce9ec23 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:08.380368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:08.381491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:08.381788 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:08.382074 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] PATH_INFO: `/v3/users/291744bf4e8a44c69412ddaede11826d` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:08.383474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=291744bf4e8a44c69412ddaede11826d)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:08.385573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:08.467480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291744bf4e8a44c69412ddaede11826d'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.468567 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291744bf4e8a44c69412ddaede11826d'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.469937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291744bf4e8a44c69412ddaede11826d'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.479462 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291744bf4e8a44c69412ddaede11826d'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.492006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291744bf4e8a44c69412ddaede11826d'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.515175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1084/2165] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:22:08 2022] DELETE /identity/v3/users/291744bf4e8a44c69412ddaede11826d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:08.674885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:08.678488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:08.794355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2ab69-1a98-4418-acb1-5f80a45e6829 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:08.878676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:08.879577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:08.879855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:08.880134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] PATH_INFO: `/v3/projects/6b70ca4dea774329814708534a8f2fe6` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:08.881500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b70ca4dea774329814708534a8f2fe6)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:08.883487 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:08.948318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b70ca4dea774329814708534a8f2fe6', 'request_id': 'req-32988e93-ff43-406c-923f-4c57ef16e97f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.959387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b70ca4dea774329814708534a8f2fe6', 'request_id': 'req-32988e93-ff43-406c-923f-4c57ef16e97f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:08.963231 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:08.972110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:08.974532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:08.988832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b70ca4dea774329814708534a8f2fe6', 'request_id': 'req-32988e93-ff43-406c-923f-4c57ef16e97f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.006047 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8b8b7-1d34-4ab1-9e2e-5ece1ee81797 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:09.014917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] The token cache is being invalidate because project 6b70ca4dea774329814708534a8f2fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:22:09.015525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.016836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.021301 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1082/2166] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:22:08 2022] DELETE /identity/v3/projects/6b70ca4dea774329814708534a8f2fe6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:09.029925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:09.034295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:09.128564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:09.128979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:09.129342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:09.129645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] PATH_INFO: `/v3/projects/ee7471dee55c4579ab12fa06fcd43f51` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:09.131426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee7471dee55c4579ab12fa06fcd43f51)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:09.134171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:09.143491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:09.160038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32988e93-ff43-406c-923f-4c57ef16e97f admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:09.165349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:09.166289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:09.166565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:09.166836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] PATH_INFO: `/v3/users/e5d38be2f43944e09b4ca9e9d673e4f8` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:09.168147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d38be2f43944e09b4ca9e9d673e4f8)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:09.170141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:09.221115 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7471dee55c4579ab12fa06fcd43f51', 'request_id': 'req-e7740fb9-3306-415a-9d39-9eb02f54d579'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.232101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7471dee55c4579ab12fa06fcd43f51', 'request_id': 'req-e7740fb9-3306-415a-9d39-9eb02f54d579'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.244548 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d38be2f43944e09b4ca9e9d673e4f8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.245528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d38be2f43944e09b4ca9e9d673e4f8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.246489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d38be2f43944e09b4ca9e9d673e4f8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.253491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7471dee55c4579ab12fa06fcd43f51', 'request_id': 'req-e7740fb9-3306-415a-9d39-9eb02f54d579'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.259336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d38be2f43944e09b4ca9e9d673e4f8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.270272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d38be2f43944e09b4ca9e9d673e4f8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.276983 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] The token cache is being invalidate because project ee7471dee55c4579ab12fa06fcd43f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:22:09.277315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.278183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.281525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1085/2167] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:22:08 2022] DELETE /identity/v3/projects/ee7471dee55c4579ab12fa06fcd43f51 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:09.284424 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:09.286133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:09.301850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1083/2168] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:22:09 2022] DELETE /identity/v3/users/e5d38be2f43944e09b4ca9e9d673e4f8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:09.372066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7740fb9-3306-415a-9d39-9eb02f54d579 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:09.461887 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:09.464123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:09.464651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:09.465184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] PATH_INFO: `/v3/users/d0368450cdf04bf0a7af614db8646fb2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:09.467394 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0368450cdf04bf0a7af614db8646fb2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:09.470182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:09.526803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:09.533750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0368450cdf04bf0a7af614db8646fb2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.534712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0368450cdf04bf0a7af614db8646fb2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.535896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0368450cdf04bf0a7af614db8646fb2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.546915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0368450cdf04bf0a7af614db8646fb2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.559877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0368450cdf04bf0a7af614db8646fb2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.586247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1086/2169] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:22:09 2022] DELETE /identity/v3/users/d0368450cdf04bf0a7af614db8646fb2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:09.728044 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:09.729776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:09.745235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61a81b-e53f-41a9-bc3e-8da706378281 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:09.836484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:09.836484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:09.836484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:09.836484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84 admin admin] PATH_INFO: `/v3/projects/29bd2ce19be1410f99ff8b123fd8a1d3` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:09.838099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29bd2ce19be1410f99ff8b123fd8a1d3)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:09.838746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:09.850573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:09.915275 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29bd2ce19be1410f99ff8b123fd8a1d3', 'request_id': 'req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.923781 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29bd2ce19be1410f99ff8b123fd8a1d3', 'request_id': 'req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.939051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29bd2ce19be1410f99ff8b123fd8a1d3', 'request_id': 'req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.963600 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84 admin admin] The token cache is being invalidate because project 29bd2ce19be1410f99ff8b123fd8a1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:22:09.963903 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.964748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-64b6fdbd-9d57-4bdb-83b9-7e676a3a9d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:09.966349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1084/2170] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:22:09 2022] DELETE /identity/v3/projects/29bd2ce19be1410f99ff8b123fd8a1d3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:10.002472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:10.014542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:10.034123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd51e-1052-4f51-a705-9a6f5bb8b338 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:10.136698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74886885-139c-45f2-aaed-f3f974beecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:10.138046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74886885-139c-45f2-aaed-f3f974beecd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:10.138378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74886885-139c-45f2-aaed-f3f974beecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:10.138679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74886885-139c-45f2-aaed-f3f974beecd2 admin admin] PATH_INFO: `/v3/projects/07f7aec6b365438f9cdd511bd491e728` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:10.140241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74886885-139c-45f2-aaed-f3f974beecd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f7aec6b365438f9cdd511bd491e728)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:10.142633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74886885-139c-45f2-aaed-f3f974beecd2 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:10.225294 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-74886885-139c-45f2-aaed-f3f974beecd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f7aec6b365438f9cdd511bd491e728', 'request_id': 'req-74886885-139c-45f2-aaed-f3f974beecd2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:10.236795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-74886885-139c-45f2-aaed-f3f974beecd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f7aec6b365438f9cdd511bd491e728', 'request_id': 'req-74886885-139c-45f2-aaed-f3f974beecd2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:10.244380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-74886885-139c-45f2-aaed-f3f974beecd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f7aec6b365438f9cdd511bd491e728', 'request_id': 'req-74886885-139c-45f2-aaed-f3f974beecd2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:10.261689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-74886885-139c-45f2-aaed-f3f974beecd2 admin admin] The token cache is being invalidate because project 07f7aec6b365438f9cdd511bd491e728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:22:10.262199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-74886885-139c-45f2-aaed-f3f974beecd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:10.263243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-74886885-139c-45f2-aaed-f3f974beecd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:10.266101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1087/2171] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:22:10 2022] DELETE /identity/v3/projects/07f7aec6b365438f9cdd511bd491e728 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:10.271163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fe8ed-50e9-4806-bd45-66b21343b36b None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:10.271686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fe8ed-50e9-4806-bd45-66b21343b36b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:10.271784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fe8ed-50e9-4806-bd45-66b21343b36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:10.293970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-9a9fe8ed-50e9-4806-bd45-66b21343b36b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:10.295110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9a9fe8ed-50e9-4806-bd45-66b21343b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:10.373511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1085/2172] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:10.382014 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ae53f-b31d-4b45-875f-7fa2c1032fef None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:10.382457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ae53f-b31d-4b45-875f-7fa2c1032fef None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:10.382846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ae53f-b31d-4b45-875f-7fa2c1032fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:10.404407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-fd3ae53f-b31d-4b45-875f-7fa2c1032fef None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:10.405681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-fd3ae53f-b31d-4b45-875f-7fa2c1032fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:10.417645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1088/2173] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:10.422278 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fe8ed-50e9-4806-bd45-66b21343b36b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:10.436358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fe8ed-50e9-4806-bd45-66b21343b36b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:10.442624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc99c6b-256e-4dbf-8964-e3e617152be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:10.446049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc99c6b-256e-4dbf-8964-e3e617152be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:10.446281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc99c6b-256e-4dbf-8964-e3e617152be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:10.446565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc99c6b-256e-4dbf-8964-e3e617152be7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:10.447364 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc99c6b-256e-4dbf-8964-e3e617152be7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:22:10.447760 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc99c6b-256e-4dbf-8964-e3e617152be7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:10.450596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc99c6b-256e-4dbf-8964-e3e617152be7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:10.472428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1086/2174] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:22:10.476839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ae53f-b31d-4b45-875f-7fa2c1032fef None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:10.493159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ae53f-b31d-4b45-875f-7fa2c1032fef None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:10.503016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38bf3c-660e-4001-acd9-aff2f272f73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:10.503433 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a135c-f2ce-42ef-bec9-57fb262d1e58 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:10.503698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38bf3c-660e-4001-acd9-aff2f272f73b admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:10.503819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a135c-f2ce-42ef-bec9-57fb262d1e58 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:10.503988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38bf3c-660e-4001-acd9-aff2f272f73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:10.504092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a135c-f2ce-42ef-bec9-57fb262d1e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:10.504268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38bf3c-660e-4001-acd9-aff2f272f73b admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:10.504988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38bf3c-660e-4001-acd9-aff2f272f73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:10.506976 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38bf3c-660e-4001-acd9-aff2f272f73b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:10.524536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-2b8a135c-f2ce-42ef-bec9-57fb262d1e58 None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:10.526166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2b8a135c-f2ce-42ef-bec9-57fb262d1e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:10.566352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1089/2175] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:22:10 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:22:10.572301 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38bf3c-660e-4001-acd9-aff2f272f73b admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:10.618142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1087/2176] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:22:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:10.621325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:10.685474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a135c-f2ce-42ef-bec9-57fb262d1e58 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:10.689020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2b8a135c-f2ce-42ef-bec9-57fb262d1e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:10.716173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38bf3c-660e-4001-acd9-aff2f272f73b admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:10.722045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a135c-f2ce-42ef-bec9-57fb262d1e58 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:10.725583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff309d-2e86-4f33-99dc-f4f951d292d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:10.727895 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff309d-2e86-4f33-99dc-f4f951d292d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:10.727895 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff309d-2e86-4f33-99dc-f4f951d292d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:10.728229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff309d-2e86-4f33-99dc-f4f951d292d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:10.729542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff309d-2e86-4f33-99dc-f4f951d292d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:10.731102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:10.732414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:10.732857 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:10.733284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] PATH_INFO: `/v3/users/cc5c8f94e3ca433e9f022781e5d7e85d` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:10.733765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff309d-2e86-4f33-99dc-f4f951d292d6 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:10.734883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5c8f94e3ca433e9f022781e5d7e85d)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:10.737297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:10.782937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:10.783811 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1090/2177] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:22:10 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:22:10.785098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff309d-2e86-4f33-99dc-f4f951d292d6 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:10.788396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b8ff309d-2e86-4f33-99dc-f4f951d292d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:10.845899 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5c8f94e3ca433e9f022781e5d7e85d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:10.846818 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5c8f94e3ca433e9f022781e5d7e85d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:10.848494 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5c8f94e3ca433e9f022781e5d7e85d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:10.861423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5c8f94e3ca433e9f022781e5d7e85d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:10.884740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5c8f94e3ca433e9f022781e5d7e85d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:10.926175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1088/2178] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:22:10 2022] DELETE /identity/v3/users/cc5c8f94e3ca433e9f022781e5d7e85d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:22:10.929374 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:10.930670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:10.931932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff309d-2e86-4f33-99dc-f4f951d292d6 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:11.078329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fa628-9e4c-40cb-9a62-a7f4b61eee33 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:11.079890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02381287-1f01-477e-920b-6f409900c1ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:11.081535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02381287-1f01-477e-920b-6f409900c1ed service swift] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:11.082079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02381287-1f01-477e-920b-6f409900c1ed service swift] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:11.084321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02381287-1f01-477e-920b-6f409900c1ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:11.087065 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd91e02-272a-4557-94ca-e31f20acf396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:11.087065 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd91e02-272a-4557-94ca-e31f20acf396 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:11.087571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-02381287-1f01-477e-920b-6f409900c1ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:11.087712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd91e02-272a-4557-94ca-e31f20acf396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:11.087712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd91e02-272a-4557-94ca-e31f20acf396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:11.089657 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd91e02-272a-4557-94ca-e31f20acf396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:11.090276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd91e02-272a-4557-94ca-e31f20acf396 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:11.105510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1089/2179] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:22:11.107037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78a1ed-a1f1-4564-9be4-4529c8930bf4 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:11.107334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78a1ed-a1f1-4564-9be4-4529c8930bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:11.107707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78a1ed-a1f1-4564-9be4-4529c8930bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:11.128845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-db78a1ed-a1f1-4564-9be4-4529c8930bf4 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:11.130179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-db78a1ed-a1f1-4564-9be4-4529c8930bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:11.141977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1090/2180] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:11.143122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78a1ed-a1f1-4564-9be4-4529c8930bf4 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:11.154731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78a1ed-a1f1-4564-9be4-4529c8930bf4 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:11.160170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851ad4-fa84-4afa-a931-5b58ac771c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:11.160876 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851ad4-fa84-4afa-a931-5b58ac771c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:11.161162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851ad4-fa84-4afa-a931-5b58ac771c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:11.161475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851ad4-fa84-4afa-a931-5b58ac771c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:11.162243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e851ad4-fa84-4afa-a931-5b58ac771c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:11.164502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e851ad4-fa84-4afa-a931-5b58ac771c22 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:11.176916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1091/2181] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:22:11.177956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851ad4-fa84-4afa-a931-5b58ac771c22 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:11.179956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-5e851ad4-fa84-4afa-a931-5b58ac771c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:11.204035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:11.209310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02381287-1f01-477e-920b-6f409900c1ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:11.213781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02381287-1f01-477e-920b-6f409900c1ed service swift] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:11.231680 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1091/2182] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:22:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:22:11.233633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02381287-1f01-477e-920b-6f409900c1ed service swift] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:11.254452 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02381287-1f01-477e-920b-6f409900c1ed service swift] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:11.262522 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bc42a-3097-4c10-91a3-fa81a0b79714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:11.263834 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc42a-3097-4c10-91a3-fa81a0b79714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:11.264321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc42a-3097-4c10-91a3-fa81a0b79714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:11.264799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc42a-3097-4c10-91a3-fa81a0b79714 admin admin] PATH_INFO: `/v3/projects/d73fbb193cc64d1cbe76f97765d87643/users/cd0fc8d78de64eb5a129657114fbb9a8/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:11.293390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bc42a-3097-4c10-91a3-fa81a0b79714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73fbb193cc64d1cbe76f97765d87643, user_id=cd0fc8d78de64eb5a129657114fbb9a8, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:11.298714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bc42a-3097-4c10-91a3-fa81a0b79714 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:11.313385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851ad4-fa84-4afa-a931-5b58ac771c22 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:11.320129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51e7ed-40cb-4d6e-bcdc-ccd857c6a530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:11.321288 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51e7ed-40cb-4d6e-bcdc-ccd857c6a530 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:11.321763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51e7ed-40cb-4d6e-bcdc-ccd857c6a530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:11.322310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51e7ed-40cb-4d6e-bcdc-ccd857c6a530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:11.343178 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1092/2183] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:22:11 2022] PUT /identity/v3/projects/d73fbb193cc64d1cbe76f97765d87643/users/cd0fc8d78de64eb5a129657114fbb9a8/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:11.347116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51e7ed-40cb-4d6e-bcdc-ccd857c6a530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:11.348284 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f0f0e-0526-4d90-a8aa-ea70b1280540 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:11.348854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f0f0e-0526-4d90-a8aa-ea70b1280540 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:11.349434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f0f0e-0526-4d90-a8aa-ea70b1280540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:11.353497 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51e7ed-40cb-4d6e-bcdc-ccd857c6a530 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:11.383694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1092/2184] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:11.396964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-563f0f0e-0526-4d90-a8aa-ea70b1280540 None None] MFA Rules not processed for user `cd0fc8d78de64eb5a129657114fbb9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:11.399313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-563f0f0e-0526-4d90-a8aa-ea70b1280540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:11.542843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1093/2185] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:22:11.573711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51e7ed-40cb-4d6e-bcdc-ccd857c6a530 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:11.578263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0f51e7ed-40cb-4d6e-bcdc-ccd857c6a530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:11.679510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:11.815533 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51e7ed-40cb-4d6e-bcdc-ccd857c6a530 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:11.918241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f0f0e-0526-4d90-a8aa-ea70b1280540 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:11.920157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-563f0f0e-0526-4d90-a8aa-ea70b1280540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:11.965599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c098ab9-fc0f-4beb-9930-b3e6a56fa8e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:11.967592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c098ab9-fc0f-4beb-9930-b3e6a56fa8e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:11.967878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c098ab9-fc0f-4beb-9930-b3e6a56fa8e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:11.968604 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c098ab9-fc0f-4beb-9930-b3e6a56fa8e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:11.982551 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c098ab9-fc0f-4beb-9930-b3e6a56fa8e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:11.984081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c098ab9-fc0f-4beb-9930-b3e6a56fa8e2 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:11.999371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1093/2186] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:12.105263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c098ab9-fc0f-4beb-9930-b3e6a56fa8e2 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:12.181083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f0f0e-0526-4d90-a8aa-ea70b1280540 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:12.198377 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:12.199397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:12.199652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:12.200139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9 admin admin] PATH_INFO: `/v3/projects/9367f5eb594c40ae908bc1c165680d8e` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:12.204255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9367f5eb594c40ae908bc1c165680d8e)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:12.205797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:12.300752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c098ab9-fc0f-4beb-9930-b3e6a56fa8e2 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:12.321810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9367f5eb594c40ae908bc1c165680d8e', 'request_id': 'req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:12.333813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9367f5eb594c40ae908bc1c165680d8e', 'request_id': 'req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:12.341128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:12.342956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9367f5eb594c40ae908bc1c165680d8e', 'request_id': 'req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:12.370245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9 admin admin] The token cache is being invalidate because project 9367f5eb594c40ae908bc1c165680d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:22:12.370544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:12.371260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-82e2f9d1-f2f9-4ecc-b2a7-4481389c21d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:12.381536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1094/2187] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:22:11 2022] DELETE /identity/v3/projects/9367f5eb594c40ae908bc1c165680d8e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:12.383276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c41b87-a88b-445f-96d0-318dc6dd94e7 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:12.383571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c41b87-a88b-445f-96d0-318dc6dd94e7 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:12.383854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c41b87-a88b-445f-96d0-318dc6dd94e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:12.397956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df851aae-f7f8-4b73-ad3e-2d7480b4c797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:12.401898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df851aae-f7f8-4b73-ad3e-2d7480b4c797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:12.401898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df851aae-f7f8-4b73-ad3e-2d7480b4c797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:12.401898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df851aae-f7f8-4b73-ad3e-2d7480b4c797 admin admin] PATH_INFO: `/v3/users/cd0fc8d78de64eb5a129657114fbb9a8` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:12.405845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df851aae-f7f8-4b73-ad3e-2d7480b4c797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0fc8d78de64eb5a129657114fbb9a8)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:12.412278 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df851aae-f7f8-4b73-ad3e-2d7480b4c797 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:12.427791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-69c41b87-a88b-445f-96d0-318dc6dd94e7 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:12.429320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-69c41b87-a88b-445f-96d0-318dc6dd94e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:12.446635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1095/2188] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:12.455378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c199e-7b76-4453-9949-f018a8b64045 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:12.455660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c199e-7b76-4453-9949-f018a8b64045 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:12.455949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c199e-7b76-4453-9949-f018a8b64045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:12.486088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:12.514900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-3a1c199e-7b76-4453-9949-f018a8b64045 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:12.518314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3a1c199e-7b76-4453-9949-f018a8b64045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:12.521117 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-df851aae-f7f8-4b73-ad3e-2d7480b4c797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0fc8d78de64eb5a129657114fbb9a8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:12.521962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-df851aae-f7f8-4b73-ad3e-2d7480b4c797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0fc8d78de64eb5a129657114fbb9a8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:12.522859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-df851aae-f7f8-4b73-ad3e-2d7480b4c797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0fc8d78de64eb5a129657114fbb9a8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:12.533167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-df851aae-f7f8-4b73-ad3e-2d7480b4c797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0fc8d78de64eb5a129657114fbb9a8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:12.536877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1096/2189] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:22:12.539290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c199e-7b76-4453-9949-f018a8b64045 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:12.551106 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-df851aae-f7f8-4b73-ad3e-2d7480b4c797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0fc8d78de64eb5a129657114fbb9a8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:12.559103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c199e-7b76-4453-9949-f018a8b64045 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:12.574767 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793911d-d28a-496f-ba39-b0e3d1236833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:12.575773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793911d-d28a-496f-ba39-b0e3d1236833 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:12.577531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793911d-d28a-496f-ba39-b0e3d1236833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:12.577938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793911d-d28a-496f-ba39-b0e3d1236833 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:12.578883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793911d-d28a-496f-ba39-b0e3d1236833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:22:12.579212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793911d-d28a-496f-ba39-b0e3d1236833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:12.581007 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793911d-d28a-496f-ba39-b0e3d1236833 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:12.589281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1094/2190] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:22:12 2022] DELETE /identity/v3/users/cd0fc8d78de64eb5a129657114fbb9a8 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:22:12.594831 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9d32-a16b-409c-9b12-90237a1181f2 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:12.597295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9d32-a16b-409c-9b12-90237a1181f2 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:12.597753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9d32-a16b-409c-9b12-90237a1181f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:12.613847 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1097/2191] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:22:12.615221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793911d-d28a-496f-ba39-b0e3d1236833 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:12.619299 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-2aca9d32-a16b-409c-9b12-90237a1181f2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:12.620755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2aca9d32-a16b-409c-9b12-90237a1181f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:12.634927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793911d-d28a-496f-ba39-b0e3d1236833 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:12.708322 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1095/2192] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:12.720425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9d32-a16b-409c-9b12-90237a1181f2 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:12.722359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2aca9d32-a16b-409c-9b12-90237a1181f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:12.782129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d439f-2290-4fb8-a321-c9431d99229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:12.785638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d439f-2290-4fb8-a321-c9431d99229d admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:12.786028 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d439f-2290-4fb8-a321-c9431d99229d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:12.786323 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d439f-2290-4fb8-a321-c9431d99229d admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:12.787035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d439f-2290-4fb8-a321-c9431d99229d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:12.789052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d439f-2290-4fb8-a321-c9431d99229d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:12.842981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9d32-a16b-409c-9b12-90237a1181f2 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:12.848881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76ed67-8e4e-4e49-82a0-c766f5b6fc06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:12.849536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76ed67-8e4e-4e49-82a0-c766f5b6fc06 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:12.849804 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76ed67-8e4e-4e49-82a0-c766f5b6fc06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:12.850053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76ed67-8e4e-4e49-82a0-c766f5b6fc06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:12.862223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76ed67-8e4e-4e49-82a0-c766f5b6fc06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:12.863628 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76ed67-8e4e-4e49-82a0-c766f5b6fc06 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:12.885283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1098/2193] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:22:12 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:22:12.890123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d439f-2290-4fb8-a321-c9431d99229d admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:12.891052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1096/2194] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:13.077035 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d439f-2290-4fb8-a321-c9431d99229d admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:13.099046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407758f1-2e88-461d-ab1f-33edd323a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:13.101081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407758f1-2e88-461d-ab1f-33edd323a0ab admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:13.105310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407758f1-2e88-461d-ab1f-33edd323a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:13.107330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407758f1-2e88-461d-ab1f-33edd323a0ab admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:13.108190 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407758f1-2e88-461d-ab1f-33edd323a0ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:13.110737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407758f1-2e88-461d-ab1f-33edd323a0ab admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:13.157398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1099/2195] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:22:12 2022] POST /identity/v3/users => generated 286 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:22:13.163164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76ed67-8e4e-4e49-82a0-c766f5b6fc06 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:13.179650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76ed67-8e4e-4e49-82a0-c766f5b6fc06 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:13.198249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a4e66-5c0c-4644-bd2b-ad34540b341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:13.203239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4e66-5c0c-4644-bd2b-ad34540b341e admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:13.203239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4e66-5c0c-4644-bd2b-ad34540b341e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:13.203239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4e66-5c0c-4644-bd2b-ad34540b341e admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:13.203239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a4e66-5c0c-4644-bd2b-ad34540b341e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:13.203239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a4e66-5c0c-4644-bd2b-ad34540b341e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:13.231593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1097/2196] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:22:13.240355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407758f1-2e88-461d-ab1f-33edd323a0ab admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:13.274657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407758f1-2e88-461d-ab1f-33edd323a0ab admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:13.282132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e5592-d255-472f-bc18-364cc1ec002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:13.283301 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e5592-d255-472f-bc18-364cc1ec002d admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:13.283832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e5592-d255-472f-bc18-364cc1ec002d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:13.284915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e5592-d255-472f-bc18-364cc1ec002d admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:13.286208 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e5592-d255-472f-bc18-364cc1ec002d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:13.290250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e5592-d255-472f-bc18-364cc1ec002d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:13.328281 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1100/2197] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:22:13.336117 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a4e66-5c0c-4644-bd2b-ad34540b341e admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:13.389193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a4e66-5c0c-4644-bd2b-ad34540b341e admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:13.407013 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe20e59-ba7d-426e-acc8-cd897e545707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:13.408936 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe20e59-ba7d-426e-acc8-cd897e545707 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:13.412640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe20e59-ba7d-426e-acc8-cd897e545707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:13.414256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe20e59-ba7d-426e-acc8-cd897e545707 admin admin] PATH_INFO: `/v3/projects/67ac46aa3011450188009d658f42f491/users/5f7e85e3c4f24877ae11d6aa1a532d51/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:13.466197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe20e59-ba7d-426e-acc8-cd897e545707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ac46aa3011450188009d658f42f491, user_id=5f7e85e3c4f24877ae11d6aa1a532d51, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:13.469837 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe20e59-ba7d-426e-acc8-cd897e545707 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:13.498621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1098/2198] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:22:13 2022] PUT /identity/v3/projects/67ac46aa3011450188009d658f42f491/users/5f7e85e3c4f24877ae11d6aa1a532d51/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:13.510088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5464471-6e67-4751-b3d2-af62ca23eb4a None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:13.510532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5464471-6e67-4751-b3d2-af62ca23eb4a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:13.510932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5464471-6e67-4751-b3d2-af62ca23eb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:13.582921 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-f5464471-6e67-4751-b3d2-af62ca23eb4a None None] MFA Rules not processed for user `5f7e85e3c4f24877ae11d6aa1a532d51`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:13.584644 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f5464471-6e67-4751-b3d2-af62ca23eb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:13.629543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:13.655170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe20e59-ba7d-426e-acc8-cd897e545707 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:13.658124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-bfe20e59-ba7d-426e-acc8-cd897e545707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:13.689665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:13.747438 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1101/2199] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:22:13.762701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5464471-6e67-4751-b3d2-af62ca23eb4a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:13.764870 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f5464471-6e67-4751-b3d2-af62ca23eb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:13.774375 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe20e59-ba7d-426e-acc8-cd897e545707 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:13.780389 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83181f5-0420-4971-a085-f546ef7832a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:13.781386 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83181f5-0420-4971-a085-f546ef7832a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:13.781645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83181f5-0420-4971-a085-f546ef7832a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:13.782072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83181f5-0420-4971-a085-f546ef7832a5 admin admin] PATH_INFO: `/v3/projects/d73fbb193cc64d1cbe76f97765d87643` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:13.783488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83181f5-0420-4971-a085-f546ef7832a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73fbb193cc64d1cbe76f97765d87643)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:13.785716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83181f5-0420-4971-a085-f546ef7832a5 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:13.846324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e83181f5-0420-4971-a085-f546ef7832a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73fbb193cc64d1cbe76f97765d87643', 'request_id': 'req-e83181f5-0420-4971-a085-f546ef7832a5'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:13.856227 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5464471-6e67-4751-b3d2-af62ca23eb4a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:13.857167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e83181f5-0420-4971-a085-f546ef7832a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73fbb193cc64d1cbe76f97765d87643', 'request_id': 'req-e83181f5-0420-4971-a085-f546ef7832a5'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:13.869598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e83181f5-0420-4971-a085-f546ef7832a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73fbb193cc64d1cbe76f97765d87643', 'request_id': 'req-e83181f5-0420-4971-a085-f546ef7832a5'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:13.885306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e83181f5-0420-4971-a085-f546ef7832a5 admin admin] The token cache is being invalidate because project d73fbb193cc64d1cbe76f97765d87643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:22:13.885612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e83181f5-0420-4971-a085-f546ef7832a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:13.886255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e83181f5-0420-4971-a085-f546ef7832a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:13.887867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1099/2200] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:22:13 2022] DELETE /identity/v3/projects/d73fbb193cc64d1cbe76f97765d87643 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:13.946771 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3754509-bcb1-413d-ad89-251a1087edff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6af41d833941debd6afcecd952af0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:13.947499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754509-bcb1-413d-ad89-251a1087edff service glance] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:13.947928 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754509-bcb1-413d-ad89-251a1087edff service glance] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:13.948225 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754509-bcb1-413d-ad89-251a1087edff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:13.950455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b3754509-bcb1-413d-ad89-251a1087edff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:14.036605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3754509-bcb1-413d-ad89-251a1087edff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:14.038118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3754509-bcb1-413d-ad89-251a1087edff service glance] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:14.051154 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1102/2201] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:22:23.881651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:24.045350 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=87 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:30.779237 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778970-e396-45f8-858f-34c30c19e88a None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:30.780387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778970-e396-45f8-858f-34c30c19e88a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:30.780739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778970-e396-45f8-858f-34c30c19e88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:30.823594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-75778970-e396-45f8-858f-34c30c19e88a None None] MFA Rules not processed for user `58366850e234491cafe268bb56e9e3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:30.826229 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-75778970-e396-45f8-858f-34c30c19e88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:30.956405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1100/2202] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:36.051654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d991a-0438-4b27-9236-b587d2f17060 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:36.052502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d991a-0438-4b27-9236-b587d2f17060 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:36.052939 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d991a-0438-4b27-9236-b587d2f17060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:36.073953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-865d991a-0438-4b27-9236-b587d2f17060 None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:36.075094 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-865d991a-0438-4b27-9236-b587d2f17060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:36.155233 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1103/2203] 10.222.0.62 () {58 vars in 967 bytes} [Thu Jul 7 07:22:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:36.170236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778970-e396-45f8-858f-34c30c19e88a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:36.172092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-75778970-e396-45f8-858f-34c30c19e88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:36.254832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778970-e396-45f8-858f-34c30c19e88a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:36.260241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afdc0e-f68b-456d-9db3-f8c11ca08f83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:36.260919 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afdc0e-f68b-456d-9db3-f8c11ca08f83 service swift] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:36.261206 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afdc0e-f68b-456d-9db3-f8c11ca08f83 service swift] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:36.261516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afdc0e-f68b-456d-9db3-f8c11ca08f83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:36.271469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afdc0e-f68b-456d-9db3-f8c11ca08f83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:36.273061 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afdc0e-f68b-456d-9db3-f8c11ca08f83 service swift] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:36.283404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1101/2204] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:22:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:22:38.899944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3e5d1-da35-4592-b188-ca838620b0f6 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:38.900427 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3e5d1-da35-4592-b188-ca838620b0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:38.900636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3e5d1-da35-4592-b188-ca838620b0f6 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:38.902611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1104/2205] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:22:38.923162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120e42f-3e8f-454a-89cd-1845da82ed4c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:38.924069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120e42f-3e8f-454a-89cd-1845da82ed4c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:38.924562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120e42f-3e8f-454a-89cd-1845da82ed4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:38.971930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-6120e42f-3e8f-454a-89cd-1845da82ed4c None None] MFA Rules not processed for user `bd80f27a4499407d8c350f2908638334`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:38.973561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6120e42f-3e8f-454a-89cd-1845da82ed4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:38.996168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3e5d1-da35-4592-b188-ca838620b0f6 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:38.999534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-21d3e5d1-da35-4592-b188-ca838620b0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:39.112638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:39.126167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1102/2206] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:22:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:39.140465 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120e42f-3e8f-454a-89cd-1845da82ed4c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:39.144007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6120e42f-3e8f-454a-89cd-1845da82ed4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:39.151774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3e5d1-da35-4592-b188-ca838620b0f6 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:39.157079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a31d2f-6bd8-4e99-bb30-5caac69a4b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:39.158005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31d2f-6bd8-4e99-bb30-5caac69a4b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:39.158398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31d2f-6bd8-4e99-bb30-5caac69a4b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:39.158701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31d2f-6bd8-4e99-bb30-5caac69a4b63 admin admin] PATH_INFO: `/v3/users/2e6e49df0e254b4284950e4bbe65ab45` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:39.160437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a31d2f-6bd8-4e99-bb30-5caac69a4b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6e49df0e254b4284950e4bbe65ab45)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:39.163638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a31d2f-6bd8-4e99-bb30-5caac69a4b63 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:39.167492 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120e42f-3e8f-454a-89cd-1845da82ed4c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:39.188432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8a41a-60e7-4bc0-96dd-d9175607832b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:39.189525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8a41a-60e7-4bc0-96dd-d9175607832b service placement] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:39.189930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8a41a-60e7-4bc0-96dd-d9175607832b service placement] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:39.190614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8a41a-60e7-4bc0-96dd-d9175607832b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:39.202142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8a41a-60e7-4bc0-96dd-d9175607832b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:39.203913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8a41a-60e7-4bc0-96dd-d9175607832b service placement] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:39.219011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1103/2207] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:39.226355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-24a31d2f-6bd8-4e99-bb30-5caac69a4b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6e49df0e254b4284950e4bbe65ab45'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:39.227232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-24a31d2f-6bd8-4e99-bb30-5caac69a4b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6e49df0e254b4284950e4bbe65ab45'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:39.227896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-24a31d2f-6bd8-4e99-bb30-5caac69a4b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6e49df0e254b4284950e4bbe65ab45'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:39.248790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-24a31d2f-6bd8-4e99-bb30-5caac69a4b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6e49df0e254b4284950e4bbe65ab45'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:39.259832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-24a31d2f-6bd8-4e99-bb30-5caac69a4b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6e49df0e254b4284950e4bbe65ab45'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:39.261199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:39.282167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1105/2208] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:22:38 2022] DELETE /identity/v3/users/2e6e49df0e254b4284950e4bbe65ab45 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:22:39.475569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8a41a-60e7-4bc0-96dd-d9175607832b service placement] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:39.491526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8a41a-60e7-4bc0-96dd-d9175607832b service placement] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:39.564388 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65efb6b-0f77-4f67-a213-e2d732359054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:39.566334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65efb6b-0f77-4f67-a213-e2d732359054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:39.566625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65efb6b-0f77-4f67-a213-e2d732359054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:39.567042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65efb6b-0f77-4f67-a213-e2d732359054 admin admin] PATH_INFO: `/v3/projects/559507d94a984b9f9663ed9f127668fb` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:39.568476 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65efb6b-0f77-4f67-a213-e2d732359054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559507d94a984b9f9663ed9f127668fb)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:39.572850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65efb6b-0f77-4f67-a213-e2d732359054 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:39.628855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d65efb6b-0f77-4f67-a213-e2d732359054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559507d94a984b9f9663ed9f127668fb', 'request_id': 'req-d65efb6b-0f77-4f67-a213-e2d732359054'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:39.635621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d65efb6b-0f77-4f67-a213-e2d732359054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559507d94a984b9f9663ed9f127668fb', 'request_id': 'req-d65efb6b-0f77-4f67-a213-e2d732359054'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:39.645598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d65efb6b-0f77-4f67-a213-e2d732359054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559507d94a984b9f9663ed9f127668fb', 'request_id': 'req-d65efb6b-0f77-4f67-a213-e2d732359054'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:39.658543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d65efb6b-0f77-4f67-a213-e2d732359054 admin admin] The token cache is being invalidate because project 559507d94a984b9f9663ed9f127668fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:22:39.658886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d65efb6b-0f77-4f67-a213-e2d732359054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:39.659495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d65efb6b-0f77-4f67-a213-e2d732359054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:39.661332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1104/2209] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:22:39 2022] DELETE /identity/v3/projects/559507d94a984b9f9663ed9f127668fb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:39.668193 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afcf65-61b8-4ffa-80cf-1804d8dfd0b8 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:39.668484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afcf65-61b8-4ffa-80cf-1804d8dfd0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:39.668766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afcf65-61b8-4ffa-80cf-1804d8dfd0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:39.718716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-31afcf65-61b8-4ffa-80cf-1804d8dfd0b8 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:39.719952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-31afcf65-61b8-4ffa-80cf-1804d8dfd0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:39.789031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1106/2210] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:39.797211 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd854f2-b821-422b-a168-1354aea8fa9e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:39.797540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd854f2-b821-422b-a168-1354aea8fa9e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:39.797783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd854f2-b821-422b-a168-1354aea8fa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:39.817175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-9dd854f2-b821-422b-a168-1354aea8fa9e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:39.818494 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9dd854f2-b821-422b-a168-1354aea8fa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:39.826913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1105/2211] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:39.831554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afcf65-61b8-4ffa-80cf-1804d8dfd0b8 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:39.841530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afcf65-61b8-4ffa-80cf-1804d8dfd0b8 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:39.846361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962155ce-04ae-4e33-90c7-af09287b10a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:39.847036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962155ce-04ae-4e33-90c7-af09287b10a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:39.847322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962155ce-04ae-4e33-90c7-af09287b10a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:39.847600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962155ce-04ae-4e33-90c7-af09287b10a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:39.848339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962155ce-04ae-4e33-90c7-af09287b10a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:22:39.848654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962155ce-04ae-4e33-90c7-af09287b10a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:39.850307 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962155ce-04ae-4e33-90c7-af09287b10a1 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:39.863013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1107/2212] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:22:39.867242 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd854f2-b821-422b-a168-1354aea8fa9e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:39.876729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd854f2-b821-422b-a168-1354aea8fa9e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:39.882502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687d857-4eea-4b80-9c5a-6c3f6f9d90ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:39.883161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687d857-4eea-4b80-9c5a-6c3f6f9d90ea admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:39.883451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687d857-4eea-4b80-9c5a-6c3f6f9d90ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:39.883731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687d857-4eea-4b80-9c5a-6c3f6f9d90ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:39.884447 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687d857-4eea-4b80-9c5a-6c3f6f9d90ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:39.886490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687d857-4eea-4b80-9c5a-6c3f6f9d90ea admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:39.919473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1106/2213] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:22:39 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:22:39.923832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962155ce-04ae-4e33-90c7-af09287b10a1 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:39.934556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962155ce-04ae-4e33-90c7-af09287b10a1 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:39.995514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4eddc-2c8f-41bb-822e-030eda424a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:39.996034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4eddc-2c8f-41bb-822e-030eda424a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:39.996326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4eddc-2c8f-41bb-822e-030eda424a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:39.996603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4eddc-2c8f-41bb-822e-030eda424a35 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:39.997348 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4eddc-2c8f-41bb-822e-030eda424a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:39.999330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4eddc-2c8f-41bb-822e-030eda424a35 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:40.021853 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1108/2214] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:22:39 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:22:40.025720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687d857-4eea-4b80-9c5a-6c3f6f9d90ea admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:40.036167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687d857-4eea-4b80-9c5a-6c3f6f9d90ea admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:40.041011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fb22a-742a-44fd-b553-27bae16ea8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:40.041988 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fb22a-742a-44fd-b553-27bae16ea8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:40.042153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fb22a-742a-44fd-b553-27bae16ea8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:40.042422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fb22a-742a-44fd-b553-27bae16ea8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:40.043165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fb22a-742a-44fd-b553-27bae16ea8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:40.044907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fb22a-742a-44fd-b553-27bae16ea8c8 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:40.071334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1107/2215] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:22:40.075031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4eddc-2c8f-41bb-822e-030eda424a35 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:40.085359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4eddc-2c8f-41bb-822e-030eda424a35 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:40.090090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d19e08-12c8-4537-9065-950f034f9ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:40.090758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d19e08-12c8-4537-9065-950f034f9ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:40.091044 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d19e08-12c8-4537-9065-950f034f9ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:40.091326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d19e08-12c8-4537-9065-950f034f9ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:40.092049 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d19e08-12c8-4537-9065-950f034f9ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:40.093693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d19e08-12c8-4537-9065-950f034f9ab9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:40.104456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1109/2216] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:22:40.108562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fb22a-742a-44fd-b553-27bae16ea8c8 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:40.119280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fb22a-742a-44fd-b553-27bae16ea8c8 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:40.124300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6f3b1-0798-45a6-b3e4-e00471dbccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:40.125318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f3b1-0798-45a6-b3e4-e00471dbccc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:40.125607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f3b1-0798-45a6-b3e4-e00471dbccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:40.125890 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f3b1-0798-45a6-b3e4-e00471dbccc6 admin admin] PATH_INFO: `/v3/projects/9ee25b35791243e698a41375cca91cea/users/e1f0d73f1807487ca3eb016660b29f47/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:40.142407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6f3b1-0798-45a6-b3e4-e00471dbccc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee25b35791243e698a41375cca91cea, user_id=e1f0d73f1807487ca3eb016660b29f47, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:40.145109 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6f3b1-0798-45a6-b3e4-e00471dbccc6 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:40.158697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1108/2217] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:22:40 2022] PUT /identity/v3/projects/9ee25b35791243e698a41375cca91cea/users/e1f0d73f1807487ca3eb016660b29f47/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:40.163979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bd1ea-5b9c-4a86-863a-c5a11c9d2bf5 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:40.164267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bd1ea-5b9c-4a86-863a-c5a11c9d2bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:40.164547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bd1ea-5b9c-4a86-863a-c5a11c9d2bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:40.182354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0d8bd1ea-5b9c-4a86-863a-c5a11c9d2bf5 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:40.183638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0d8bd1ea-5b9c-4a86-863a-c5a11c9d2bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:40.218714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:40.279492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1110/2218] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:40.289615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6f3b1-0798-45a6-b3e4-e00471dbccc6 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:40.291704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-58d6f3b1-0798-45a6-b3e4-e00471dbccc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:40.310885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:40.387258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6f3b1-0798-45a6-b3e4-e00471dbccc6 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:40.397302 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627da3-b298-4ebd-95b0-d9a0f33e9bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:40.397935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627da3-b298-4ebd-95b0-d9a0f33e9bbd service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:40.398219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627da3-b298-4ebd-95b0-d9a0f33e9bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:40.398500 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627da3-b298-4ebd-95b0-d9a0f33e9bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:40.411737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3627da3-b298-4ebd-95b0-d9a0f33e9bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:40.413533 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3627da3-b298-4ebd-95b0-d9a0f33e9bbd service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:40.425166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1109/2219] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:45.649540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fe940-d865-446f-a7c8-7b5c83b61824 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:45.650140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fe940-d865-446f-a7c8-7b5c83b61824 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:45.650140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fe940-d865-446f-a7c8-7b5c83b61824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:45.684206 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-265fe940-d865-446f-a7c8-7b5c83b61824 None None] MFA Rules not processed for user `e1f0d73f1807487ca3eb016660b29f47`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:45.685561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-265fe940-d865-446f-a7c8-7b5c83b61824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:45.769252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1111/2220] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:22:45.773907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627da3-b298-4ebd-95b0-d9a0f33e9bbd service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:45.785409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627da3-b298-4ebd-95b0-d9a0f33e9bbd service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:45.791008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7edce-662b-424d-af09-f4f6e6f3bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:45.791696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7edce-662b-424d-af09-f4f6e6f3bf56 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:45.791984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7edce-662b-424d-af09-f4f6e6f3bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:45.792269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7edce-662b-424d-af09-f4f6e6f3bf56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:45.793067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7edce-662b-424d-af09-f4f6e6f3bf56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:45.795038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7edce-662b-424d-af09-f4f6e6f3bf56 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:45.825193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1110/2221] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:22:45 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:22:45.829308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fe940-d865-446f-a7c8-7b5c83b61824 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:45.848025 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fe940-d865-446f-a7c8-7b5c83b61824 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:45.926650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e3cbd-0649-4ac3-aaab-d8a9d705bba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:45.927358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e3cbd-0649-4ac3-aaab-d8a9d705bba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:45.927646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e3cbd-0649-4ac3-aaab-d8a9d705bba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:45.927927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e3cbd-0649-4ac3-aaab-d8a9d705bba8 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:45.928644 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e3cbd-0649-4ac3-aaab-d8a9d705bba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:45.931249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e3cbd-0649-4ac3-aaab-d8a9d705bba8 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:45.959696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1112/2222] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:22:45 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:22:45.961286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7edce-662b-424d-af09-f4f6e6f3bf56 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:45.972769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7edce-662b-424d-af09-f4f6e6f3bf56 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:45.977586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f20d8f-11f8-48e0-8f17-85f9d9960dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:45.978383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f20d8f-11f8-48e0-8f17-85f9d9960dbf admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:45.978728 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f20d8f-11f8-48e0-8f17-85f9d9960dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:45.979063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f20d8f-11f8-48e0-8f17-85f9d9960dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:45.979883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f20d8f-11f8-48e0-8f17-85f9d9960dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:45.981620 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f20d8f-11f8-48e0-8f17-85f9d9960dbf admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:45.994166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1111/2223] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:22:45.998901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e3cbd-0649-4ac3-aaab-d8a9d705bba8 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:46.014561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e3cbd-0649-4ac3-aaab-d8a9d705bba8 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:46.020549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfca66d-d130-46e7-a62d-8808b1d60083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:46.021517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca66d-d130-46e7-a62d-8808b1d60083 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:46.021803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca66d-d130-46e7-a62d-8808b1d60083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:46.022083 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca66d-d130-46e7-a62d-8808b1d60083 admin admin] PATH_INFO: `/v3/projects/a0a7dd0cca974394af1e32d2977a5a8d/users/390ddc7f829045d78947949d6863b3ad/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:46.047337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfca66d-d130-46e7-a62d-8808b1d60083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a7dd0cca974394af1e32d2977a5a8d, user_id=390ddc7f829045d78947949d6863b3ad, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:46.051628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfca66d-d130-46e7-a62d-8808b1d60083 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:46.078416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1113/2224] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:22:45 2022] PUT /identity/v3/projects/a0a7dd0cca974394af1e32d2977a5a8d/users/390ddc7f829045d78947949d6863b3ad/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:46.082619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f20d8f-11f8-48e0-8f17-85f9d9960dbf admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:46.092761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f20d8f-11f8-48e0-8f17-85f9d9960dbf admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:46.160992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647cbde-6299-4e00-a913-6da5a682fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:46.161824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647cbde-6299-4e00-a913-6da5a682fa29 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:46.162172 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647cbde-6299-4e00-a913-6da5a682fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:46.162512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647cbde-6299-4e00-a913-6da5a682fa29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:46.163259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647cbde-6299-4e00-a913-6da5a682fa29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:46.164920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647cbde-6299-4e00-a913-6da5a682fa29 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:46.176272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1112/2225] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:22:46.180764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfca66d-d130-46e7-a62d-8808b1d60083 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:46.194919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfca66d-d130-46e7-a62d-8808b1d60083 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:46.219968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf438e-2b45-4229-8211-ecc560ac487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:46.221334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf438e-2b45-4229-8211-ecc560ac487d admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:46.221601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf438e-2b45-4229-8211-ecc560ac487d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:46.221901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf438e-2b45-4229-8211-ecc560ac487d admin admin] PATH_INFO: `/v3/projects/a0a7dd0cca974394af1e32d2977a5a8d/users/390ddc7f829045d78947949d6863b3ad/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:46.235066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf438e-2b45-4229-8211-ecc560ac487d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a7dd0cca974394af1e32d2977a5a8d, user_id=390ddc7f829045d78947949d6863b3ad, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:46.237949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf438e-2b45-4229-8211-ecc560ac487d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:46.254354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1114/2226] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:22:46 2022] PUT /identity/v3/projects/a0a7dd0cca974394af1e32d2977a5a8d/users/390ddc7f829045d78947949d6863b3ad/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:48.182833 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647cbde-6299-4e00-a913-6da5a682fa29 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:48.184729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8647cbde-6299-4e00-a913-6da5a682fa29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:48.200549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647cbde-6299-4e00-a913-6da5a682fa29 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:48.298391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:48.310573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:48.312763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:48.313193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:48.314539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] PATH_INFO: `/v3/users/5f7e85e3c4f24877ae11d6aa1a532d51` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:48.316155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7e85e3c4f24877ae11d6aa1a532d51)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:48.318869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:48.396970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7e85e3c4f24877ae11d6aa1a532d51'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:48.398124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7e85e3c4f24877ae11d6aa1a532d51'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:48.398977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7e85e3c4f24877ae11d6aa1a532d51'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:48.422022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7e85e3c4f24877ae11d6aa1a532d51'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:48.438206 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7e85e3c4f24877ae11d6aa1a532d51'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:48.464658 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1113/2227] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:22:48 2022] DELETE /identity/v3/users/5f7e85e3c4f24877ae11d6aa1a532d51 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:48.466596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e679e-5c79-47f8-8d28-bf991590b7c0 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:48.467071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e679e-5c79-47f8-8d28-bf991590b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:48.467159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e679e-5c79-47f8-8d28-bf991590b7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:48.482171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:48.488140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-767e679e-5c79-47f8-8d28-bf991590b7c0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:48.490389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-767e679e-5c79-47f8-8d28-bf991590b7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:48.571314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1115/2228] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:48.579380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:48.581582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:48.715952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e5106-06df-4304-8238-3d3bfaa07ec1 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:48.747521 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5380303-4c2c-4815-9326-527427293845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:48.748403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5380303-4c2c-4815-9326-527427293845 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:48.748791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5380303-4c2c-4815-9326-527427293845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:48.749169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5380303-4c2c-4815-9326-527427293845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:48.779050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5380303-4c2c-4815-9326-527427293845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:48.780876 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5380303-4c2c-4815-9326-527427293845 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:48.805950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1114/2229] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:49.270341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e679e-5c79-47f8-8d28-bf991590b7c0 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:49.272322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-767e679e-5c79-47f8-8d28-bf991590b7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:49.329424 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e679e-5c79-47f8-8d28-bf991590b7c0 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:49.339625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:49.341365 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:49.341660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:49.341945 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3 admin admin] PATH_INFO: `/v3/projects/67ac46aa3011450188009d658f42f491` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:49.343228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ac46aa3011450188009d658f42f491)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:49.345267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:49.460939 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ac46aa3011450188009d658f42f491', 'request_id': 'req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:49.482313 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ac46aa3011450188009d658f42f491', 'request_id': 'req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:49.492030 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ac46aa3011450188009d658f42f491', 'request_id': 'req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:49.506415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3 admin admin] The token cache is being invalidate because project 67ac46aa3011450188009d658f42f491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:22:49.506999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:49.508400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e73a08bf-9c1f-4fd0-aa66-bdad4f1e35d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:22:49.510856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1116/2230] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:22:49 2022] DELETE /identity/v3/projects/67ac46aa3011450188009d658f42f491 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:49.516932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe32756-2d52-4f79-acbf-f09853f0b4b1 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:49.517505 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe32756-2d52-4f79-acbf-f09853f0b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:49.517609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe32756-2d52-4f79-acbf-f09853f0b4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:49.552027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-9fe32756-2d52-4f79-acbf-f09853f0b4b1 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:49.553724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9fe32756-2d52-4f79-acbf-f09853f0b4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:49.636997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1115/2231] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:49.645379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260638ad-04da-4ca3-9da5-bfcff539812a None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:49.645935 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260638ad-04da-4ca3-9da5-bfcff539812a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:49.646212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260638ad-04da-4ca3-9da5-bfcff539812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:49.677293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-260638ad-04da-4ca3-9da5-bfcff539812a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:49.678542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-260638ad-04da-4ca3-9da5-bfcff539812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:49.699913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1117/2232] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:49.703983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe32756-2d52-4f79-acbf-f09853f0b4b1 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:49.718940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe32756-2d52-4f79-acbf-f09853f0b4b1 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:49.725346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc72e9-a207-432a-a9d5-00175e90b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:49.733679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc72e9-a207-432a-a9d5-00175e90b2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:49.733981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc72e9-a207-432a-a9d5-00175e90b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:49.734265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc72e9-a207-432a-a9d5-00175e90b2b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:49.735995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc72e9-a207-432a-a9d5-00175e90b2b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:22:49.736580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc72e9-a207-432a-a9d5-00175e90b2b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:49.741599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc72e9-a207-432a-a9d5-00175e90b2b1 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:49.761280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:49.780159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1116/2233] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:22:49.781351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260638ad-04da-4ca3-9da5-bfcff539812a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:49.797427 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260638ad-04da-4ca3-9da5-bfcff539812a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:49.808721 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8aa2f-fa82-4136-a15e-525e9abab840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:49.809717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8aa2f-fa82-4136-a15e-525e9abab840 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:49.810003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8aa2f-fa82-4136-a15e-525e9abab840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:49.810369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8aa2f-fa82-4136-a15e-525e9abab840 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:49.811063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8aa2f-fa82-4136-a15e-525e9abab840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:49.813526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8aa2f-fa82-4136-a15e-525e9abab840 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:49.882687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1118/2234] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:22:49 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:22:49.882795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc72e9-a207-432a-a9d5-00175e90b2b1 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:49.896050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc72e9-a207-432a-a9d5-00175e90b2b1 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:50.037992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a0853-b741-4fb4-9b11-342644860974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:50.038789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a0853-b741-4fb4-9b11-342644860974 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:50.039404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a0853-b741-4fb4-9b11-342644860974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:50.039795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a0853-b741-4fb4-9b11-342644860974 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:50.040593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a0853-b741-4fb4-9b11-342644860974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:50.043058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a0853-b741-4fb4-9b11-342644860974 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:50.084984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1117/2235] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:22:49 2022] POST /identity/v3/users => generated 295 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:22:50.089005 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8aa2f-fa82-4136-a15e-525e9abab840 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:50.112209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8aa2f-fa82-4136-a15e-525e9abab840 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:50.117975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672c1ee-1963-4ab5-b93f-50b15ffb4092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:50.118665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672c1ee-1963-4ab5-b93f-50b15ffb4092 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:50.118946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672c1ee-1963-4ab5-b93f-50b15ffb4092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:50.119484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672c1ee-1963-4ab5-b93f-50b15ffb4092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:50.119999 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672c1ee-1963-4ab5-b93f-50b15ffb4092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:50.122467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672c1ee-1963-4ab5-b93f-50b15ffb4092 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:50.144830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1119/2236] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:22:50.148926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a0853-b741-4fb4-9b11-342644860974 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:50.164187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a0853-b741-4fb4-9b11-342644860974 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:50.177147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe6a5b-7f29-4080-9113-48622b7fe91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:50.178329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe6a5b-7f29-4080-9113-48622b7fe91c admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:50.178900 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe6a5b-7f29-4080-9113-48622b7fe91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:50.179482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe6a5b-7f29-4080-9113-48622b7fe91c admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:50.180335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe6a5b-7f29-4080-9113-48622b7fe91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:50.182947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe6a5b-7f29-4080-9113-48622b7fe91c admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:50.204624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1118/2237] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:22:50.213651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672c1ee-1963-4ab5-b93f-50b15ffb4092 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:50.235855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672c1ee-1963-4ab5-b93f-50b15ffb4092 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:50.244841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bec18-a944-4a23-8cd2-e8107e23cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:50.246484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bec18-a944-4a23-8cd2-e8107e23cdcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:50.246771 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bec18-a944-4a23-8cd2-e8107e23cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:50.247048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bec18-a944-4a23-8cd2-e8107e23cdcf admin admin] PATH_INFO: `/v3/projects/58db3998a84b4b41bba42cdb49447b7e/users/445d314ecf2b40839edafde2a96d7952/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:50.267310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bec18-a944-4a23-8cd2-e8107e23cdcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=58db3998a84b4b41bba42cdb49447b7e, user_id=445d314ecf2b40839edafde2a96d7952, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:50.271593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bec18-a944-4a23-8cd2-e8107e23cdcf admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:50.295214 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1120/2238] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:22:50 2022] PUT /identity/v3/projects/58db3998a84b4b41bba42cdb49447b7e/users/445d314ecf2b40839edafde2a96d7952/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:22:50.309344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adab78b-4319-4d36-8a5a-eab31165d900 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:50.309344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adab78b-4319-4d36-8a5a-eab31165d900 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:50.309344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adab78b-4319-4d36-8a5a-eab31165d900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:50.359680 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-3adab78b-4319-4d36-8a5a-eab31165d900 None None] MFA Rules not processed for user `445d314ecf2b40839edafde2a96d7952`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:50.361744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3adab78b-4319-4d36-8a5a-eab31165d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:50.472932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1119/2239] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:50.492551 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bec18-a944-4a23-8cd2-e8107e23cdcf admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:50.495490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0f4bec18-a944-4a23-8cd2-e8107e23cdcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:50.596434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:50.645446 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bec18-a944-4a23-8cd2-e8107e23cdcf admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:50.654518 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c7fdd-91df-45ce-be22-6ebe215ee0a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:50.655611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c7fdd-91df-45ce-be22-6ebe215ee0a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:50.656064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c7fdd-91df-45ce-be22-6ebe215ee0a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:50.656490 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c7fdd-91df-45ce-be22-6ebe215ee0a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:50.676654 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c7fdd-91df-45ce-be22-6ebe215ee0a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:50.681596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c7fdd-91df-45ce-be22-6ebe215ee0a1 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:50.701301 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1121/2240] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:52.480349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf358d-7030-4012-9345-6b6e83d3d5e7 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:52.480349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf358d-7030-4012-9345-6b6e83d3d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:52.481008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf358d-7030-4012-9345-6b6e83d3d5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:52.530829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-07bf358d-7030-4012-9345-6b6e83d3d5e7 None None] MFA Rules not processed for user `390ddc7f829045d78947949d6863b3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:52.532479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-07bf358d-7030-4012-9345-6b6e83d3d5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:52.669557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:52.703017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1120/2241] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:52 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:52.717422 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c7fdd-91df-45ce-be22-6ebe215ee0a1 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:52.718942 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b21c7fdd-91df-45ce-be22-6ebe215ee0a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:52.862840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c7fdd-91df-45ce-be22-6ebe215ee0a1 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:52.868782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039824ca-1e64-4a6c-907c-73b9f36f5fec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:52.869551 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039824ca-1e64-4a6c-907c-73b9f36f5fec service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:52.869897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039824ca-1e64-4a6c-907c-73b9f36f5fec service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:52.870233 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039824ca-1e64-4a6c-907c-73b9f36f5fec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:52.872124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-039824ca-1e64-4a6c-907c-73b9f36f5fec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:52.958142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039824ca-1e64-4a6c-907c-73b9f36f5fec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:52.959870 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039824ca-1e64-4a6c-907c-73b9f36f5fec service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:52.975429 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1122/2242] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:22:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:22:54.458208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879cfe8-0ccd-43fa-8745-fa98a54fdc69 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:54.459078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879cfe8-0ccd-43fa-8745-fa98a54fdc69 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:54.459576 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879cfe8-0ccd-43fa-8745-fa98a54fdc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:54.480414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-f879cfe8-0ccd-43fa-8745-fa98a54fdc69 None None] MFA Rules not processed for user `e1f0d73f1807487ca3eb016660b29f47`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:54.482497 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f879cfe8-0ccd-43fa-8745-fa98a54fdc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:54.497286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1121/2243] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:22:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:56.399298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4156582-a1b9-48ce-b32e-0ed1cc52a060 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:56.400284 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4156582-a1b9-48ce-b32e-0ed1cc52a060 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:56.400284 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4156582-a1b9-48ce-b32e-0ed1cc52a060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:56.461468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-f4156582-a1b9-48ce-b32e-0ed1cc52a060 None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:22:56.463925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f4156582-a1b9-48ce-b32e-0ed1cc52a060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:56.509482 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:56.568600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1123/2244] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:22:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:22:56.581420 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879cfe8-0ccd-43fa-8745-fa98a54fdc69 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:22:56.583417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f879cfe8-0ccd-43fa-8745-fa98a54fdc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:22:56.680992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879cfe8-0ccd-43fa-8745-fa98a54fdc69 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:22:56.686571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1730ad-d944-4b41-8e32-2f347a5cb17a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:22:56.690564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1730ad-d944-4b41-8e32-2f347a5cb17a service swift] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:22:56.690564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1730ad-d944-4b41-8e32-2f347a5cb17a service swift] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:22:56.690564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1730ad-d944-4b41-8e32-2f347a5cb17a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:22:56.696861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1730ad-d944-4b41-8e32-2f347a5cb17a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:22:56.698545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1730ad-d944-4b41-8e32-2f347a5cb17a service swift] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:22:56.707123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1122/2245] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:22:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:23:06.553361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=11 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:06.703636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=39 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:09.677667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bea636-37b9-420e-9b0b-e6a02cfd15fc None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:09.678229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bea636-37b9-420e-9b0b-e6a02cfd15fc None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:09.678229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bea636-37b9-420e-9b0b-e6a02cfd15fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:09.699972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-04bea636-37b9-420e-9b0b-e6a02cfd15fc None None] MFA Rules not processed for user `b80ab2a9c7504806851400e07074004e`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:09.701190 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-04bea636-37b9-420e-9b0b-e6a02cfd15fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:09.768082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1124/2246] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:23:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:23:11.013933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1730ad-d944-4b41-8e32-2f347a5cb17a service swift] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:11.134355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1730ad-d944-4b41-8e32-2f347a5cb17a service swift] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:11.140714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:11.142041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:11.142405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:11.142687 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] PATH_INFO: `/v3/users/445d314ecf2b40839edafde2a96d7952` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:11.144026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445d314ecf2b40839edafde2a96d7952)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:11.146326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:11.207933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445d314ecf2b40839edafde2a96d7952'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:23:11.208835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445d314ecf2b40839edafde2a96d7952'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:23:11.209624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445d314ecf2b40839edafde2a96d7952'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:23:11.218982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445d314ecf2b40839edafde2a96d7952'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:23:11.236285 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445d314ecf2b40839edafde2a96d7952'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:23:11.252093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1123/2247] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:23:11 2022] DELETE /identity/v3/users/445d314ecf2b40839edafde2a96d7952 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:23:11.257464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a70eee-07b3-49e0-ac4b-71d904ebd929 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:11.258249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a70eee-07b3-49e0-ac4b-71d904ebd929 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:11.258249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a70eee-07b3-49e0-ac4b-71d904ebd929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:11.277013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-46a70eee-07b3-49e0-ac4b-71d904ebd929 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:11.278268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-46a70eee-07b3-49e0-ac4b-71d904ebd929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:11.349128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1125/2248] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:23:11.359826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:11.361784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:11.420118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3887f0-11b4-495e-8b71-1e1f2c17d15e None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:11.420447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3887f0-11b4-495e-8b71-1e1f2c17d15e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:11.420724 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3887f0-11b4-495e-8b71-1e1f2c17d15e None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:11.422184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1126/2249] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:23:11.430590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cbfc4-2bb0-4e8f-8b0b-00c97be9dc1b None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:11.430931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cbfc4-2bb0-4e8f-8b0b-00c97be9dc1b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:11.431221 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cbfc4-2bb0-4e8f-8b0b-00c97be9dc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:11.432569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92404a2f-1650-4c8e-8ff8-fb9e3ce9bbd6 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:11.437934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4431aa2-7d13-4e4d-b1a3-215f76619da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:11.439892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4431aa2-7d13-4e4d-b1a3-215f76619da3 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:11.440390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4431aa2-7d13-4e4d-b1a3-215f76619da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:11.440742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4431aa2-7d13-4e4d-b1a3-215f76619da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:11.457023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4431aa2-7d13-4e4d-b1a3-215f76619da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:11.460663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4431aa2-7d13-4e4d-b1a3-215f76619da3 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:11.477604 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1124/2250] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:23:11.482024 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-9a0cbfc4-2bb0-4e8f-8b0b-00c97be9dc1b None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:11.483158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-9a0cbfc4-2bb0-4e8f-8b0b-00c97be9dc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:11.598572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1127/2251] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:23:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:23:11.610920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4431aa2-7d13-4e4d-b1a3-215f76619da3 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:11.612363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f4431aa2-7d13-4e4d-b1a3-215f76619da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:11.640519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:11.683339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4431aa2-7d13-4e4d-b1a3-215f76619da3 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:11.687550 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2419e-db33-4a2d-a5b3-c871872b6161 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6af41d833941debd6afcecd952af0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:11.688272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2419e-db33-4a2d-a5b3-c871872b6161 service glance] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:11.688754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2419e-db33-4a2d-a5b3-c871872b6161 service glance] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:11.689187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2419e-db33-4a2d-a5b3-c871872b6161 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:11.699913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2419e-db33-4a2d-a5b3-c871872b6161 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:11.701018 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2419e-db33-4a2d-a5b3-c871872b6161 service glance] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:11.711825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1125/2252] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:23:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:23:11.782736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bda0e2-8310-4a32-a0dc-d5ebde0ae85f None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:11.783016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bda0e2-8310-4a32-a0dc-d5ebde0ae85f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:11.783141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2419e-db33-4a2d-a5b3-c871872b6161 service glance] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:11.783443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bda0e2-8310-4a32-a0dc-d5ebde0ae85f None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:11.784901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7cc2419e-db33-4a2d-a5b3-c871872b6161 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:11.785448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1128/2253] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:23:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:23:11.790408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c8ffa-e3b0-4728-a56a-e176e6986273 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:11.790801 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c8ffa-e3b0-4728-a56a-e176e6986273 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:11.791147 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c8ffa-e3b0-4728-a56a-e176e6986273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:11.806867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2419e-db33-4a2d-a5b3-c871872b6161 service glance] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:11.812040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dee61f-210d-45c0-887d-e3fb238e153d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:11.813048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dee61f-210d-45c0-887d-e3fb238e153d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:11.813691 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dee61f-210d-45c0-887d-e3fb238e153d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:11.813976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dee61f-210d-45c0-887d-e3fb238e153d admin admin] PATH_INFO: `/v3/projects/58db3998a84b4b41bba42cdb49447b7e` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:11.815576 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dee61f-210d-45c0-887d-e3fb238e153d admin admin] RBAC: Authorizing `identity:delete_project(project_id=58db3998a84b4b41bba42cdb49447b7e)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:11.817568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dee61f-210d-45c0-887d-e3fb238e153d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:11.834021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-d24c8ffa-e3b0-4728-a56a-e176e6986273 None None] MFA Rules not processed for user `4d0c6b46b5d248e5bed2b1bbdfa74f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:11.836537 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d24c8ffa-e3b0-4728-a56a-e176e6986273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:11.845956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1129/2254] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:23:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:23:11.860290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c8ffa-e3b0-4728-a56a-e176e6986273 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:11.872779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c8ffa-e3b0-4728-a56a-e176e6986273 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:11.879822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-11dee61f-210d-45c0-887d-e3fb238e153d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58db3998a84b4b41bba42cdb49447b7e', 'request_id': 'req-11dee61f-210d-45c0-887d-e3fb238e153d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:23:11.886940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:11.887677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-11dee61f-210d-45c0-887d-e3fb238e153d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58db3998a84b4b41bba42cdb49447b7e', 'request_id': 'req-11dee61f-210d-45c0-887d-e3fb238e153d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:23:11.895755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-11dee61f-210d-45c0-887d-e3fb238e153d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58db3998a84b4b41bba42cdb49447b7e', 'request_id': 'req-11dee61f-210d-45c0-887d-e3fb238e153d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:23:11.907955 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-11dee61f-210d-45c0-887d-e3fb238e153d admin admin] The token cache is being invalidate because project 58db3998a84b4b41bba42cdb49447b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:23:11.908244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-11dee61f-210d-45c0-887d-e3fb238e153d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:23:11.908920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-11dee61f-210d-45c0-887d-e3fb238e153d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:23:11.910764 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1126/2255] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:23:11 2022] DELETE /identity/v3/projects/58db3998a84b4b41bba42cdb49447b7e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:23:11.915816 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26c62f-f3fc-4dea-8152-bcc5c71227b5 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:11.916108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26c62f-f3fc-4dea-8152-bcc5c71227b5 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:11.916393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26c62f-f3fc-4dea-8152-bcc5c71227b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:11.926607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085468c6-fe48-48aa-923a-039868dd6114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:11.927426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085468c6-fe48-48aa-923a-039868dd6114 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:11.927732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085468c6-fe48-48aa-923a-039868dd6114 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:11.928168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085468c6-fe48-48aa-923a-039868dd6114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:11.930024 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-085468c6-fe48-48aa-923a-039868dd6114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:11.935687 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-bd26c62f-f3fc-4dea-8152-bcc5c71227b5 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:11.937281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-bd26c62f-f3fc-4dea-8152-bcc5c71227b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:11.940384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085468c6-fe48-48aa-923a-039868dd6114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:11.941966 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085468c6-fe48-48aa-923a-039868dd6114 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:11.950181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1130/2256] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:23:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:23:12.000632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1127/2257] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:23:12.010454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017925e-3b5f-41ac-9d1d-e7fe2eff7377 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:12.010749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017925e-3b5f-41ac-9d1d-e7fe2eff7377 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:12.011130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017925e-3b5f-41ac-9d1d-e7fe2eff7377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:12.033372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-d017925e-3b5f-41ac-9d1d-e7fe2eff7377 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:12.034980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d017925e-3b5f-41ac-9d1d-e7fe2eff7377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:12.043745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1131/2258] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:23:12.048097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26c62f-f3fc-4dea-8152-bcc5c71227b5 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:12.061735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26c62f-f3fc-4dea-8152-bcc5c71227b5 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:12.064695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26392bc-d101-4187-898a-aa04fcedf21f None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:12.065114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26392bc-d101-4187-898a-aa04fcedf21f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:12.065506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26392bc-d101-4187-898a-aa04fcedf21f None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:12.067398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1132/2259] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:23:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 07:23:12.067543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089151e-74c2-48fe-9e60-7dc0c62323fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:12.068197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089151e-74c2-48fe-9e60-7dc0c62323fb admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:12.068496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089151e-74c2-48fe-9e60-7dc0c62323fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:12.068773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089151e-74c2-48fe-9e60-7dc0c62323fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:12.069707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089151e-74c2-48fe-9e60-7dc0c62323fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:23:12.070034 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089151e-74c2-48fe-9e60-7dc0c62323fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:12.071639 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089151e-74c2-48fe-9e60-7dc0c62323fb admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:12.073160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe990b-7efb-468f-99f1-d639193617c6 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:12.073670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe990b-7efb-468f-99f1-d639193617c6 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:12.073960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe990b-7efb-468f-99f1-d639193617c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:12.086665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1128/2260] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:23:12.090990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089151e-74c2-48fe-9e60-7dc0c62323fb admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:12.094819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-d3fe990b-7efb-468f-99f1-d639193617c6 None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:12.096158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d3fe990b-7efb-468f-99f1-d639193617c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:12.103026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089151e-74c2-48fe-9e60-7dc0c62323fb admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:12.108713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4179d-7fe0-402c-8c4c-d70f16e2bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:12.109581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4179d-7fe0-402c-8c4c-d70f16e2bc83 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:12.109882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4179d-7fe0-402c-8c4c-d70f16e2bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:12.110153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4179d-7fe0-402c-8c4c-d70f16e2bc83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:12.111054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4179d-7fe0-402c-8c4c-d70f16e2bc83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:12.112920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4179d-7fe0-402c-8c4c-d70f16e2bc83 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:12.150697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1129/2261] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:23:12 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:23:12.152727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4179d-7fe0-402c-8c4c-d70f16e2bc83 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:12.181228 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:12.213796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1133/2262] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:23:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:23:12.227729 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe990b-7efb-468f-99f1-d639193617c6 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:12.229767 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d3fe990b-7efb-468f-99f1-d639193617c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:12.242517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe990b-7efb-468f-99f1-d639193617c6 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:12.256007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4179d-7fe0-402c-8c4c-d70f16e2bc83 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:12.263631 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320777c-3ca5-4f58-8e31-d960f3ed3075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:12.264848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320777c-3ca5-4f58-8e31-d960f3ed3075 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:12.265419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320777c-3ca5-4f58-8e31-d960f3ed3075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:12.265931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320777c-3ca5-4f58-8e31-d960f3ed3075 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:12.267090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320777c-3ca5-4f58-8e31-d960f3ed3075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:12.269244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320777c-3ca5-4f58-8e31-d960f3ed3075 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:12.310522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1130/2263] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:23:12 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:23:12.312192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320777c-3ca5-4f58-8e31-d960f3ed3075 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:12.335194 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320777c-3ca5-4f58-8e31-d960f3ed3075 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:12.340797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7a847-fb78-4ca0-93a7-1faa38270903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:12.341544 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7a847-fb78-4ca0-93a7-1faa38270903 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:12.341826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7a847-fb78-4ca0-93a7-1faa38270903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:12.342281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7a847-fb78-4ca0-93a7-1faa38270903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:12.343268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7a847-fb78-4ca0-93a7-1faa38270903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:12.345079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7a847-fb78-4ca0-93a7-1faa38270903 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:12.347398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d4c8d-5308-4a7c-816b-c024b20164c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:12.348860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d4c8d-5308-4a7c-816b-c024b20164c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:12.351500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d4c8d-5308-4a7c-816b-c024b20164c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:12.352180 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d4c8d-5308-4a7c-816b-c024b20164c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:12.358200 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1131/2264] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:23:12.363294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7a847-fb78-4ca0-93a7-1faa38270903 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:12.384149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7a847-fb78-4ca0-93a7-1faa38270903 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:12.398096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e3e5c-3818-49ac-b5e3-6addcd44599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:12.398832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e3e5c-3818-49ac-b5e3-6addcd44599e admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:12.399077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e3e5c-3818-49ac-b5e3-6addcd44599e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:12.399344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e3e5c-3818-49ac-b5e3-6addcd44599e admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:12.400081 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e3e5c-3818-49ac-b5e3-6addcd44599e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:12.406161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e3e5c-3818-49ac-b5e3-6addcd44599e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:12.419212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:12.427679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1132/2265] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:23:12.434260 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e3e5c-3818-49ac-b5e3-6addcd44599e admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:12.439042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d4c8d-5308-4a7c-816b-c024b20164c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:12.440957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d4c8d-5308-4a7c-816b-c024b20164c9 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:12.450418 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e3e5c-3818-49ac-b5e3-6addcd44599e admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:12.454884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1134/2266] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:23:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:23:12.455711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf81c83-34d7-421a-8364-27b49b5c5a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:12.456625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf81c83-34d7-421a-8364-27b49b5c5a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:12.456912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf81c83-34d7-421a-8364-27b49b5c5a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:12.457714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf81c83-34d7-421a-8364-27b49b5c5a42 admin admin] PATH_INFO: `/v3/projects/e976a7167fc84b0ca11b4d0d1effcff3/users/cee7676762a04042a599439058ba90ad/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:12.474012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf81c83-34d7-421a-8364-27b49b5c5a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e976a7167fc84b0ca11b4d0d1effcff3, user_id=cee7676762a04042a599439058ba90ad, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:12.476699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf81c83-34d7-421a-8364-27b49b5c5a42 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:12.493002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1133/2267] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:23:12 2022] PUT /identity/v3/projects/e976a7167fc84b0ca11b4d0d1effcff3/users/cee7676762a04042a599439058ba90ad/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:23:12.498073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86988-afce-461b-ac4e-35cade1d3681 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:12.498356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86988-afce-461b-ac4e-35cade1d3681 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:12.500046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86988-afce-461b-ac4e-35cade1d3681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:12.521294 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-69a86988-afce-461b-ac4e-35cade1d3681 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:12.522948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-69a86988-afce-461b-ac4e-35cade1d3681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:12.598924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1135/2268] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:23:12.607622 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf81c83-34d7-421a-8364-27b49b5c5a42 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:12.675702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf81c83-34d7-421a-8364-27b49b5c5a42 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:12.680131 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ab99e-b295-4f56-b5d0-4b6e374127b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:12.680983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab99e-b295-4f56-b5d0-4b6e374127b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:12.681532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab99e-b295-4f56-b5d0-4b6e374127b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:12.681856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ab99e-b295-4f56-b5d0-4b6e374127b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:12.697683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ab99e-b295-4f56-b5d0-4b6e374127b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:12.700058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ab99e-b295-4f56-b5d0-4b6e374127b1 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:12.715768 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1134/2269] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:23:16.821819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86988-afce-461b-ac4e-35cade1d3681 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:16.823506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-69a86988-afce-461b-ac4e-35cade1d3681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:17.024604 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86988-afce-461b-ac4e-35cade1d3681 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:17.030488 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b429a34-3c1f-417f-bd03-ea3338a072da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:17.030805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b429a34-3c1f-417f-bd03-ea3338a072da service placement] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:17.030898 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b429a34-3c1f-417f-bd03-ea3338a072da service placement] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:17.031158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b429a34-3c1f-417f-bd03-ea3338a072da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:17.033960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7b429a34-3c1f-417f-bd03-ea3338a072da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:17.049320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b429a34-3c1f-417f-bd03-ea3338a072da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:17.052885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b429a34-3c1f-417f-bd03-ea3338a072da service placement] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:17.063789 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1136/2270] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:23:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:23:18.634850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6a97a-ae69-401f-9a7e-99e0ca78ff5e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:18.635443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6a97a-ae69-401f-9a7e-99e0ca78ff5e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:18.635443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6a97a-ae69-401f-9a7e-99e0ca78ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:18.764782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-29c6a97a-ae69-401f-9a7e-99e0ca78ff5e None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:18.767227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-29c6a97a-ae69-401f-9a7e-99e0ca78ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:18.849004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:18.920194 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1135/2271] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:23:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:23:18.962558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b429a34-3c1f-417f-bd03-ea3338a072da service placement] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:18.968673 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7b429a34-3c1f-417f-bd03-ea3338a072da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:19.097644 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:19.151276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b429a34-3c1f-417f-bd03-ea3338a072da service placement] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:19.158524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43030e56-adc5-4d1f-94ed-ce109e9a7e4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:19.159360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030e56-adc5-4d1f-94ed-ce109e9a7e4e service swift] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:19.160036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030e56-adc5-4d1f-94ed-ce109e9a7e4e service swift] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:19.160036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030e56-adc5-4d1f-94ed-ce109e9a7e4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:19.192082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43030e56-adc5-4d1f-94ed-ce109e9a7e4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:19.197792 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43030e56-adc5-4d1f-94ed-ce109e9a7e4e service swift] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:19.214130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1137/2272] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:23:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:23:21.174987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c50287-9130-4625-b1b1-358670fa2ddc None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:21.176214 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c50287-9130-4625-b1b1-358670fa2ddc None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:21.177087 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c50287-9130-4625-b1b1-358670fa2ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:21.232319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-62c50287-9130-4625-b1b1-358670fa2ddc None None] MFA Rules not processed for user `cee7676762a04042a599439058ba90ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:21.233799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-62c50287-9130-4625-b1b1-358670fa2ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:21.361125 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1136/2273] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:23:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:23:21.363931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43030e56-adc5-4d1f-94ed-ce109e9a7e4e service swift] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:21.395902 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43030e56-adc5-4d1f-94ed-ce109e9a7e4e service swift] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:21.407089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857912f6-4718-4109-af60-9ab259d6832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:21.407089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857912f6-4718-4109-af60-9ab259d6832d admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:21.407089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857912f6-4718-4109-af60-9ab259d6832d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:21.407089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857912f6-4718-4109-af60-9ab259d6832d admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:21.407535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857912f6-4718-4109-af60-9ab259d6832d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:21.408789 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857912f6-4718-4109-af60-9ab259d6832d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:21.476040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1138/2274] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:23:21 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:23:21.480437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c50287-9130-4625-b1b1-358670fa2ddc None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:21.509074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c50287-9130-4625-b1b1-358670fa2ddc None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:21.625945 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cf1c3-3086-4142-bee2-5647aff87685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:21.626947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cf1c3-3086-4142-bee2-5647aff87685 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:21.627376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cf1c3-3086-4142-bee2-5647aff87685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:21.627942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cf1c3-3086-4142-bee2-5647aff87685 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:21.629072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062cf1c3-3086-4142-bee2-5647aff87685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:21.631610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062cf1c3-3086-4142-bee2-5647aff87685 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:21.679375 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1137/2275] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:23:21 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:23:21.683923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857912f6-4718-4109-af60-9ab259d6832d admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:21.702865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857912f6-4718-4109-af60-9ab259d6832d admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:21.709548 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203508b-675b-4b95-978d-905920ef76a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:21.710607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203508b-675b-4b95-978d-905920ef76a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:21.711384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203508b-675b-4b95-978d-905920ef76a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:21.712047 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203508b-675b-4b95-978d-905920ef76a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:21.713367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203508b-675b-4b95-978d-905920ef76a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:21.716028 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203508b-675b-4b95-978d-905920ef76a7 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:21.758668 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cf1c3-3086-4142-bee2-5647aff87685 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:21.759434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1139/2276] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:23:21.773491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cf1c3-3086-4142-bee2-5647aff87685 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:21.780399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12e586-4203-45d7-a291-b4e5d472151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:21.804260 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12e586-4203-45d7-a291-b4e5d472151a admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:21.804599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12e586-4203-45d7-a291-b4e5d472151a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:21.804843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12e586-4203-45d7-a291-b4e5d472151a admin admin] PATH_INFO: `/v3/projects/9cc00a8f0ac346bd9cf75058a651f019/users/5f7dae0b24104840854cf75bb62a078f/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:21.866379 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12e586-4203-45d7-a291-b4e5d472151a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc00a8f0ac346bd9cf75058a651f019, user_id=5f7dae0b24104840854cf75bb62a078f, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:21.869826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12e586-4203-45d7-a291-b4e5d472151a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:21.903514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1138/2277] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:23:21 2022] PUT /identity/v3/projects/9cc00a8f0ac346bd9cf75058a651f019/users/5f7dae0b24104840854cf75bb62a078f/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:23:21.907795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203508b-675b-4b95-978d-905920ef76a7 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:21.921265 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203508b-675b-4b95-978d-905920ef76a7 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:22.016598 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab2611-f2c9-42bd-ba19-ca7a1dfd8a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:22.017344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab2611-f2c9-42bd-ba19-ca7a1dfd8a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:22.017629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab2611-f2c9-42bd-ba19-ca7a1dfd8a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:22.017907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab2611-f2c9-42bd-ba19-ca7a1dfd8a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:22.019093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab2611-f2c9-42bd-ba19-ca7a1dfd8a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:22.020798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab2611-f2c9-42bd-ba19-ca7a1dfd8a3f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:22.043492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1140/2278] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:23:22.047495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12e586-4203-45d7-a291-b4e5d472151a admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:22.060152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12e586-4203-45d7-a291-b4e5d472151a admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:22.088138 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1d668-aaac-492b-a74d-09382377693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:22.089842 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1d668-aaac-492b-a74d-09382377693b admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:22.090320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1d668-aaac-492b-a74d-09382377693b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:22.090799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1d668-aaac-492b-a74d-09382377693b admin admin] PATH_INFO: `/v3/projects/9cc00a8f0ac346bd9cf75058a651f019/users/5f7dae0b24104840854cf75bb62a078f/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:22.097179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1d668-aaac-492b-a74d-09382377693b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc00a8f0ac346bd9cf75058a651f019, user_id=5f7dae0b24104840854cf75bb62a078f, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:22.101864 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1d668-aaac-492b-a74d-09382377693b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:22.130142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1139/2279] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:23:22 2022] PUT /identity/v3/projects/9cc00a8f0ac346bd9cf75058a651f019/users/5f7dae0b24104840854cf75bb62a078f/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:23:29.502546 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f379-197e-423f-af0a-db159db74f89 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:29.505722 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f379-197e-423f-af0a-db159db74f89 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:29.506013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f379-197e-423f-af0a-db159db74f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:29.591008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-ed55f379-197e-423f-af0a-db159db74f89 None None] MFA Rules not processed for user `5f7dae0b24104840854cf75bb62a078f`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:29.592375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ed55f379-197e-423f-af0a-db159db74f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:29.711578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1141/2280] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:23:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:23:29.724981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1d668-aaac-492b-a74d-09382377693b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:29.726937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6bd1d668-aaac-492b-a74d-09382377693b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:29.756472 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:29.848143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1d668-aaac-492b-a74d-09382377693b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:29.852808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbd081-ea3b-43a9-9532-1115c5a2dec0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6af41d833941debd6afcecd952af0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:29.854381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd081-ea3b-43a9-9532-1115c5a2dec0 service glance] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:29.854875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd081-ea3b-43a9-9532-1115c5a2dec0 service glance] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:29.855313 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd081-ea3b-43a9-9532-1115c5a2dec0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:29.952008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbd081-ea3b-43a9-9532-1115c5a2dec0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:29.953587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbd081-ea3b-43a9-9532-1115c5a2dec0 service glance] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:29.964977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1140/2281] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:23:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:23:30.086501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8539c-2e83-4b9f-a1ef-800655efc9d4 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:30.086814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8539c-2e83-4b9f-a1ef-800655efc9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:30.087094 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8539c-2e83-4b9f-a1ef-800655efc9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:30.110435 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-72f8539c-2e83-4b9f-a1ef-800655efc9d4 None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:30.111687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-72f8539c-2e83-4b9f-a1ef-800655efc9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:30.121980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:30.171223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1142/2282] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:23:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:23:30.184581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbd081-ea3b-43a9-9532-1115c5a2dec0 service glance] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:30.261340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbd081-ea3b-43a9-9532-1115c5a2dec0 service glance] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:30.266932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726945ea-360d-442c-98ae-fe453414b39c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:30.267586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726945ea-360d-442c-98ae-fe453414b39c service swift] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:30.267869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726945ea-360d-442c-98ae-fe453414b39c service swift] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:30.268170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726945ea-360d-442c-98ae-fe453414b39c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:30.277091 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726945ea-360d-442c-98ae-fe453414b39c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:30.278766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726945ea-360d-442c-98ae-fe453414b39c service swift] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:30.287661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1141/2283] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:23:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:23:40.164220 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=18 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:40.284007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=83 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:40.583053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca937-3c33-4cd3-972c-0e63a78528ca None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:40.583306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca937-3c33-4cd3-972c-0e63a78528ca None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:40.583547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca937-3c33-4cd3-972c-0e63a78528ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:40.601862 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-c03ca937-3c33-4cd3-972c-0e63a78528ca None None] MFA Rules not processed for user `cee7676762a04042a599439058ba90ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:40.603173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c03ca937-3c33-4cd3-972c-0e63a78528ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:40.614848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1143/2284] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:23:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:23:42.975883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb35718-06a8-4c49-a689-5402dc7e321f None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:42.976573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb35718-06a8-4c49-a689-5402dc7e321f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:42.976573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb35718-06a8-4c49-a689-5402dc7e321f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:43.003007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-3cb35718-06a8-4c49-a689-5402dc7e321f None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:43.004982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3cb35718-06a8-4c49-a689-5402dc7e321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:43.021974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1142/2285] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:23:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:23:43.037848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ca937-3c33-4cd3-972c-0e63a78528ca None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:43.051670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ca937-3c33-4cd3-972c-0e63a78528ca None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:43.057749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a622251-41f8-48f6-ba63-61c6e33e84e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:43.058422 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a622251-41f8-48f6-ba63-61c6e33e84e5 service swift] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:43.058707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a622251-41f8-48f6-ba63-61c6e33e84e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:43.058988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a622251-41f8-48f6-ba63-61c6e33e84e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:43.070723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a622251-41f8-48f6-ba63-61c6e33e84e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:43.072694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a622251-41f8-48f6-ba63-61c6e33e84e5 service swift] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:43.086100 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1144/2286] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:23:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 07 07:23:52.990583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:53.081229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=9 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:58.696561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeb88b-38ac-482c-beb2-fe5c924c294c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:58.698349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeb88b-38ac-482c-beb2-fe5c924c294c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:58.698922 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeb88b-38ac-482c-beb2-fe5c924c294c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:58.732099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-64aeb88b-38ac-482c-beb2-fe5c924c294c None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:23:58.736270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-64aeb88b-38ac-482c-beb2-fe5c924c294c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:58.758889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1143/2287] 10.222.0.62 () {58 vars in 967 bytes} [Thu Jul 7 07:23:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:23:58.759781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a622251-41f8-48f6-ba63-61c6e33e84e5 service swift] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:58.772306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a622251-41f8-48f6-ba63-61c6e33e84e5 service swift] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:58.792976 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da5d95-4ad9-482f-a346-146a61cb70a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:58.793984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da5d95-4ad9-482f-a346-146a61cb70a9 service swift] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:58.795695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da5d95-4ad9-482f-a346-146a61cb70a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:58.796860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da5d95-4ad9-482f-a346-146a61cb70a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:58.808354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da5d95-4ad9-482f-a346-146a61cb70a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:58.811191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da5d95-4ad9-482f-a346-146a61cb70a9 service swift] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:58.832668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1145/2288] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:23:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:23:59.653657 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aeb88b-38ac-482c-beb2-fe5c924c294c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:23:59.757354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aeb88b-38ac-482c-beb2-fe5c924c294c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:23:59.772988 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce08f9-3f59-4fb7-9910-015b4cd9d983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:23:59.773590 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce08f9-3f59-4fb7-9910-015b4cd9d983 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:23:59.773875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce08f9-3f59-4fb7-9910-015b4cd9d983 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:23:59.774153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce08f9-3f59-4fb7-9910-015b4cd9d983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:23:59.783175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-30ce08f9-3f59-4fb7-9910-015b4cd9d983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:23:59.899029 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce08f9-3f59-4fb7-9910-015b4cd9d983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:23:59.900921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce08f9-3f59-4fb7-9910-015b4cd9d983 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:23:59.914116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1144/2289] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:23:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:24:08.819806 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=6 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:09.908408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=53 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:12.533919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b9365-3acf-4cd5-a151-3e288d799f73 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:24:12.534700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b9365-3acf-4cd5-a151-3e288d799f73 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:24:12.534700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b9365-3acf-4cd5-a151-3e288d799f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:24:12.561057 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0b7b9365-3acf-4cd5-a151-3e288d799f73 None None] MFA Rules not processed for user `58366850e234491cafe268bb56e9e3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:24:12.562730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0b7b9365-3acf-4cd5-a151-3e288d799f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:24:12.624788 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1146/2290] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:24:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:24:19.384666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce08f9-3f59-4fb7-9910-015b4cd9d983 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:24:19.386204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-30ce08f9-3f59-4fb7-9910-015b4cd9d983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:24:19.398627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce08f9-3f59-4fb7-9910-015b4cd9d983 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:24:19.402923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee55cb1-4b1e-403d-a976-825b194184ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:24:19.403780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee55cb1-4b1e-403d-a976-825b194184ae service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:24:19.403933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee55cb1-4b1e-403d-a976-825b194184ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:24:19.404208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee55cb1-4b1e-403d-a976-825b194184ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:24:19.414834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee55cb1-4b1e-403d-a976-825b194184ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:24:19.416326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee55cb1-4b1e-403d-a976-825b194184ae service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:24:19.427274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1145/2291] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:24:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:24:22.617628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=25 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:29.422134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=6 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:48.831509 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd0956-db81-4cbe-a7c6-6620e3296fe7 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:24:48.832040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd0956-db81-4cbe-a7c6-6620e3296fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:24:48.832040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd0956-db81-4cbe-a7c6-6620e3296fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:24:48.851667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-7fcd0956-db81-4cbe-a7c6-6620e3296fe7 None None] MFA Rules not processed for user `b80ab2a9c7504806851400e07074004e`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:24:48.852895 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7fcd0956-db81-4cbe-a7c6-6620e3296fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:24:48.920118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1147/2292] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:24:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:24:58.908506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=25 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:01.906379 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53059aea-4e30-4894-ad92-e0ccc4218747 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:25:01.906887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53059aea-4e30-4894-ad92-e0ccc4218747 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:25:01.907641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53059aea-4e30-4894-ad92-e0ccc4218747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:25:01.926880 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-53059aea-4e30-4894-ad92-e0ccc4218747 None None] MFA Rules not processed for user `16293fa03ced44cc994a0b8ad19ebb89`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:25:01.928715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-53059aea-4e30-4894-ad92-e0ccc4218747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:25:02.010370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1146/2293] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:25:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:25:03.542996 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa704fb-2f33-42bc-96a9-5312b5801295 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:25:03.543495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa704fb-2f33-42bc-96a9-5312b5801295 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:25:03.543591 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa704fb-2f33-42bc-96a9-5312b5801295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:25:03.564053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-8aa704fb-2f33-42bc-96a9-5312b5801295 None None] MFA Rules not processed for user `d6db138644b14a20a43b3b1b3fa63314`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:25:03.565452 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-8aa704fb-2f33-42bc-96a9-5312b5801295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:25:03.624456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1148/2294] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:25:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:25:05.773233 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53059aea-4e30-4894-ad92-e0ccc4218747 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:25:05.783715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53059aea-4e30-4894-ad92-e0ccc4218747 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:25:05.787099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17996-534b-4cfd-b3a2-02856aba7467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:25:05.787749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17996-534b-4cfd-b3a2-02856aba7467 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:25:05.788034 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17996-534b-4cfd-b3a2-02856aba7467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:25:05.788312 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17996-534b-4cfd-b3a2-02856aba7467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:25:05.790287 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-75d17996-534b-4cfd-b3a2-02856aba7467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:25:05.865039 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17996-534b-4cfd-b3a2-02856aba7467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:25:05.866564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17996-534b-4cfd-b3a2-02856aba7467 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:25:05.878462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1147/2295] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:25:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:25:07.079251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa704fb-2f33-42bc-96a9-5312b5801295 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:25:07.090105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa704fb-2f33-42bc-96a9-5312b5801295 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:25:07.094115 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d5f28-2be9-4205-b694-3c949c535c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:25:07.095250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d5f28-2be9-4205-b694-3c949c535c36 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:25:07.095250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d5f28-2be9-4205-b694-3c949c535c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:25:07.095561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d5f28-2be9-4205-b694-3c949c535c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:25:07.109504 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ae7d5f28-2be9-4205-b694-3c949c535c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:25:07.124921 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d5f28-2be9-4205-b694-3c949c535c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:25:07.136799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d5f28-2be9-4205-b694-3c949c535c36 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:25:07.149967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1149/2296] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:25:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:25:15.873208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=59 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:17.144150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=31 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:25.898049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17996-534b-4cfd-b3a2-02856aba7467 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:25:25.900241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-75d17996-534b-4cfd-b3a2-02856aba7467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:25:25.917990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17996-534b-4cfd-b3a2-02856aba7467 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:25:25.924581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba71cf8-8d6e-4f4d-9a51-877377495f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:25:25.925270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba71cf8-8d6e-4f4d-9a51-877377495f53 service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:25:25.925568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba71cf8-8d6e-4f4d-9a51-877377495f53 service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:25:25.925850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba71cf8-8d6e-4f4d-9a51-877377495f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:25:25.927826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2ba71cf8-8d6e-4f4d-9a51-877377495f53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:25:25.940069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba71cf8-8d6e-4f4d-9a51-877377495f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:25:25.941739 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba71cf8-8d6e-4f4d-9a51-877377495f53 service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:25:25.952458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1148/2297] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:25:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:25:28.207563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c407a-cdc0-4d87-8479-2487ed802a39 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:25:28.208123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c407a-cdc0-4d87-8479-2487ed802a39 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:25:28.208257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c407a-cdc0-4d87-8479-2487ed802a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:25:28.227016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-3c7c407a-cdc0-4d87-8479-2487ed802a39 None None] MFA Rules not processed for user `58366850e234491cafe268bb56e9e3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:25:28.228282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3c7c407a-cdc0-4d87-8479-2487ed802a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:25:28.235882 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1150/2298] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:25:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:25:28.562416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba71cf8-8d6e-4f4d-9a51-877377495f53 service nova] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:25:28.572416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba71cf8-8d6e-4f4d-9a51-877377495f53 service nova] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:25:28.576807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aaaa6-2fce-4283-be11-ac2416d41899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:25:28.577485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aaaa6-2fce-4283-be11-ac2416d41899 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:25:28.577765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aaaa6-2fce-4283-be11-ac2416d41899 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:25:28.578037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aaaa6-2fce-4283-be11-ac2416d41899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:25:28.580350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f96aaaa6-2fce-4283-be11-ac2416d41899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:25:28.591671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96aaaa6-2fce-4283-be11-ac2416d41899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:25:28.593114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96aaaa6-2fce-4283-be11-ac2416d41899 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:25:28.602013 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1149/2299] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:25:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:25:38.221098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:38.597922 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=12 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:41.638066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c407a-cdc0-4d87-8479-2487ed802a39 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:25:41.649070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c407a-cdc0-4d87-8479-2487ed802a39 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:25:41.653682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f780e7d-6547-46d6-866f-d6c70328cd2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:25:41.654344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f780e7d-6547-46d6-866f-d6c70328cd2e service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:25:41.654625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f780e7d-6547-46d6-866f-d6c70328cd2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:25:41.654904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f780e7d-6547-46d6-866f-d6c70328cd2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:25:41.656883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4f780e7d-6547-46d6-866f-d6c70328cd2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:25:41.666924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f780e7d-6547-46d6-866f-d6c70328cd2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:25:41.668360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f780e7d-6547-46d6-866f-d6c70328cd2e service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:25:41.676493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1151/2300] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:25:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:25:50.919160 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aaaa6-2fce-4283-be11-ac2416d41899 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:25:50.935361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aaaa6-2fce-4283-be11-ac2416d41899 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:25:50.946989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e72ca0-079e-49aa-96fa-1385c0064c5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:25:50.948274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72ca0-079e-49aa-96fa-1385c0064c5c service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:25:50.948274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72ca0-079e-49aa-96fa-1385c0064c5c service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:25:50.948730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72ca0-079e-49aa-96fa-1385c0064c5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:25:50.951822 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-02e72ca0-079e-49aa-96fa-1385c0064c5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:25:50.968622 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72ca0-079e-49aa-96fa-1385c0064c5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:25:50.970292 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72ca0-079e-49aa-96fa-1385c0064c5c service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:25:50.981561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1150/2301] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:25:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:25:51.672995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=6 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:00.976816 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=6 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:01.525677 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f780e7d-6547-46d6-866f-d6c70328cd2e service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:01.527153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4f780e7d-6547-46d6-866f-d6c70328cd2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:01.543121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f780e7d-6547-46d6-866f-d6c70328cd2e service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:01.548891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767106be-f427-41d6-804f-57a7079e03a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:01.549612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767106be-f427-41d6-804f-57a7079e03a4 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:01.550084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767106be-f427-41d6-804f-57a7079e03a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:01.550374 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767106be-f427-41d6-804f-57a7079e03a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:01.552186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-767106be-f427-41d6-804f-57a7079e03a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:01.564592 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767106be-f427-41d6-804f-57a7079e03a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:01.566387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767106be-f427-41d6-804f-57a7079e03a4 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:01.577628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1152/2302] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:02.023617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e72ca0-079e-49aa-96fa-1385c0064c5c service nova] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:02.027785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-02e72ca0-079e-49aa-96fa-1385c0064c5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:02.129010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e72ca0-079e-49aa-96fa-1385c0064c5c service nova] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:02.133627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25e470-1ffa-445a-9e1d-54e0e8a0161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:02.134569 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25e470-1ffa-445a-9e1d-54e0e8a0161f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:02.134856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25e470-1ffa-445a-9e1d-54e0e8a0161f admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:02.135134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25e470-1ffa-445a-9e1d-54e0e8a0161f admin admin] PATH_INFO: `/v3/users/b80ab2a9c7504806851400e07074004e` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:02.136341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25e470-1ffa-445a-9e1d-54e0e8a0161f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b80ab2a9c7504806851400e07074004e)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:02.138367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25e470-1ffa-445a-9e1d-54e0e8a0161f admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:02.197641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-be25e470-1ffa-445a-9e1d-54e0e8a0161f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b80ab2a9c7504806851400e07074004e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:02.198197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-be25e470-1ffa-445a-9e1d-54e0e8a0161f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b80ab2a9c7504806851400e07074004e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:02.198850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-be25e470-1ffa-445a-9e1d-54e0e8a0161f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b80ab2a9c7504806851400e07074004e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:02.206265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-be25e470-1ffa-445a-9e1d-54e0e8a0161f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b80ab2a9c7504806851400e07074004e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:02.216263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-be25e470-1ffa-445a-9e1d-54e0e8a0161f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b80ab2a9c7504806851400e07074004e'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:02.237168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1151/2303] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:02 2022] DELETE /identity/v3/users/b80ab2a9c7504806851400e07074004e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:02.422676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767106be-f427-41d6-804f-57a7079e03a4 service nova] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:02.436191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767106be-f427-41d6-804f-57a7079e03a4 service nova] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:02.504102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16c043-c92a-4af9-8b01-ca6a4206904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:02.504987 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16c043-c92a-4af9-8b01-ca6a4206904b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:02.505295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16c043-c92a-4af9-8b01-ca6a4206904b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:02.505596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16c043-c92a-4af9-8b01-ca6a4206904b admin admin] PATH_INFO: `/v3/projects/441079c8bc1b4a4fb8f38fff6728f3ef` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:02.506787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16c043-c92a-4af9-8b01-ca6a4206904b admin admin] RBAC: Authorizing `identity:delete_project(project_id=441079c8bc1b4a4fb8f38fff6728f3ef)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:02.508914 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16c043-c92a-4af9-8b01-ca6a4206904b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:02.563480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0c16c043-c92a-4af9-8b01-ca6a4206904b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441079c8bc1b4a4fb8f38fff6728f3ef', 'request_id': 'req-0c16c043-c92a-4af9-8b01-ca6a4206904b'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:02.570984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0c16c043-c92a-4af9-8b01-ca6a4206904b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441079c8bc1b4a4fb8f38fff6728f3ef', 'request_id': 'req-0c16c043-c92a-4af9-8b01-ca6a4206904b'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:02.581614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0c16c043-c92a-4af9-8b01-ca6a4206904b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441079c8bc1b4a4fb8f38fff6728f3ef', 'request_id': 'req-0c16c043-c92a-4af9-8b01-ca6a4206904b'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:02.594689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0c16c043-c92a-4af9-8b01-ca6a4206904b admin admin] The token cache is being invalidate because project 441079c8bc1b4a4fb8f38fff6728f3ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:02.594981 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0c16c043-c92a-4af9-8b01-ca6a4206904b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:02.595717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0c16c043-c92a-4af9-8b01-ca6a4206904b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:02.597481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1153/2304] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:02 2022] DELETE /identity/v3/projects/441079c8bc1b4a4fb8f38fff6728f3ef => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:26:02.602786 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49cfbd-9991-4bca-a84b-10c2f1cb7fa2 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:02.603069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49cfbd-9991-4bca-a84b-10c2f1cb7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:02.603361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49cfbd-9991-4bca-a84b-10c2f1cb7fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:02.622929 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ad49cfbd-9991-4bca-a84b-10c2f1cb7fa2 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:02.624187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ad49cfbd-9991-4bca-a84b-10c2f1cb7fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:02.693031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1152/2305] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:02.701724 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1d8d0-c715-4fc2-b735-9994099f0281 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:02.702102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1d8d0-c715-4fc2-b735-9994099f0281 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:02.702389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1d8d0-c715-4fc2-b735-9994099f0281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:02.723145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-16a1d8d0-c715-4fc2-b735-9994099f0281 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:02.724392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-16a1d8d0-c715-4fc2-b735-9994099f0281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:02.732870 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1154/2306] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:02.738504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49cfbd-9991-4bca-a84b-10c2f1cb7fa2 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:02.748960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49cfbd-9991-4bca-a84b-10c2f1cb7fa2 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:02.754763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92511975-405b-4437-95f2-23e9f4377122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:02.755438 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92511975-405b-4437-95f2-23e9f4377122 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:02.755724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92511975-405b-4437-95f2-23e9f4377122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:02.755997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92511975-405b-4437-95f2-23e9f4377122 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:02.756757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92511975-405b-4437-95f2-23e9f4377122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:26:02.757045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92511975-405b-4437-95f2-23e9f4377122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:02.758799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92511975-405b-4437-95f2-23e9f4377122 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:02.773475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1153/2307] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:26:02.778114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1d8d0-c715-4fc2-b735-9994099f0281 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:02.787832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1d8d0-c715-4fc2-b735-9994099f0281 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:02.793408 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46fc16-aa11-45ee-95aa-0441bbf1f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:02.794050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46fc16-aa11-45ee-95aa-0441bbf1f5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:02.794330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46fc16-aa11-45ee-95aa-0441bbf1f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:02.794680 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46fc16-aa11-45ee-95aa-0441bbf1f5e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:02.795330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46fc16-aa11-45ee-95aa-0441bbf1f5e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:02.797336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46fc16-aa11-45ee-95aa-0441bbf1f5e4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:02.826907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1155/2308] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:26:02 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:02.831470 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92511975-405b-4437-95f2-23e9f4377122 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:02.842232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92511975-405b-4437-95f2-23e9f4377122 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:02.846682 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:02.905741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b454705-13d7-41a3-b15e-7b9709486cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:02.906424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b454705-13d7-41a3-b15e-7b9709486cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:02.906713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b454705-13d7-41a3-b15e-7b9709486cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:02.906995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b454705-13d7-41a3-b15e-7b9709486cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:02.907703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b454705-13d7-41a3-b15e-7b9709486cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:02.909688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b454705-13d7-41a3-b15e-7b9709486cc2 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:02.932935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1154/2309] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:26:02 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:26:02.937749 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46fc16-aa11-45ee-95aa-0441bbf1f5e4 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:02.948883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46fc16-aa11-45ee-95aa-0441bbf1f5e4 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:02.954938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc118ced-2008-44b7-96ff-f798552667e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:02.955628 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc118ced-2008-44b7-96ff-f798552667e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:02.955902 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc118ced-2008-44b7-96ff-f798552667e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:02.956177 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc118ced-2008-44b7-96ff-f798552667e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:02.956910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc118ced-2008-44b7-96ff-f798552667e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:02.958570 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc118ced-2008-44b7-96ff-f798552667e8 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:02.970822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1156/2310] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:02.975208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b454705-13d7-41a3-b15e-7b9709486cc2 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:02.986391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b454705-13d7-41a3-b15e-7b9709486cc2 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:02.991151 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cd0b0-4681-4030-ac89-645e2280dc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:02.991827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cd0b0-4681-4030-ac89-645e2280dc21 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:02.992135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cd0b0-4681-4030-ac89-645e2280dc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:02.992415 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cd0b0-4681-4030-ac89-645e2280dc21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:02.993145 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cd0b0-4681-4030-ac89-645e2280dc21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:02.994829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cd0b0-4681-4030-ac89-645e2280dc21 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:03.006518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1155/2311] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:03.011089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc118ced-2008-44b7-96ff-f798552667e8 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:03.022634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc118ced-2008-44b7-96ff-f798552667e8 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:03.028521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489f07d-bbc4-43ac-acfc-fc622c1e0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:03.029479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489f07d-bbc4-43ac-acfc-fc622c1e0195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:03.029761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489f07d-bbc4-43ac-acfc-fc622c1e0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:03.030043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489f07d-bbc4-43ac-acfc-fc622c1e0195 admin admin] PATH_INFO: `/v3/projects/b18d2cc99fc54b1983836ca5e96c2197/users/3fa57821484040599fc1f25d1e4bb815/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:03.047338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489f07d-bbc4-43ac-acfc-fc622c1e0195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18d2cc99fc54b1983836ca5e96c2197, user_id=3fa57821484040599fc1f25d1e4bb815, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:03.050137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489f07d-bbc4-43ac-acfc-fc622c1e0195 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:03.065291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1157/2312] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:03 2022] PUT /identity/v3/projects/b18d2cc99fc54b1983836ca5e96c2197/users/3fa57821484040599fc1f25d1e4bb815/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:03.075921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfa18b-8436-49c8-8fbe-a5e97493b2ca None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:03.076478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfa18b-8436-49c8-8fbe-a5e97493b2ca None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:03.076478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfa18b-8436-49c8-8fbe-a5e97493b2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:03.107414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-7ebfa18b-8436-49c8-8fbe-a5e97493b2ca None None] MFA Rules not processed for user `3fa57821484040599fc1f25d1e4bb815`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:03.108683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7ebfa18b-8436-49c8-8fbe-a5e97493b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:03.183274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1156/2313] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:03.188435 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489f07d-bbc4-43ac-acfc-fc622c1e0195 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:03.203910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:03.272286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489f07d-bbc4-43ac-acfc-fc622c1e0195 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:03.277052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40768e-8a8d-43e1-8d64-222ae17d30bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:03.277765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40768e-8a8d-43e1-8d64-222ae17d30bc admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:03.278051 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40768e-8a8d-43e1-8d64-222ae17d30bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:03.278331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40768e-8a8d-43e1-8d64-222ae17d30bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:03.279040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40768e-8a8d-43e1-8d64-222ae17d30bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:03.281118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40768e-8a8d-43e1-8d64-222ae17d30bc admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:03.313665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1158/2314] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:26:03 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:26:03.319488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfa18b-8436-49c8-8fbe-a5e97493b2ca None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:03.336039 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfa18b-8436-49c8-8fbe-a5e97493b2ca None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:03.409435 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec4a4d-ae2d-4efe-93fe-e07ea684d450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:03.410182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec4a4d-ae2d-4efe-93fe-e07ea684d450 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:03.411327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec4a4d-ae2d-4efe-93fe-e07ea684d450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:03.411327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec4a4d-ae2d-4efe-93fe-e07ea684d450 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:03.412290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec4a4d-ae2d-4efe-93fe-e07ea684d450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:03.413679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec4a4d-ae2d-4efe-93fe-e07ea684d450 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:03.440662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1157/2315] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:26:03 2022] POST /identity/v3/users => generated 309 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:03.445426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40768e-8a8d-43e1-8d64-222ae17d30bc admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:03.459203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40768e-8a8d-43e1-8d64-222ae17d30bc admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:03.463979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c944b-7bb4-457a-bc52-6339ac9f3bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:03.464699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c944b-7bb4-457a-bc52-6339ac9f3bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:03.465119 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c944b-7bb4-457a-bc52-6339ac9f3bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:03.465573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c944b-7bb4-457a-bc52-6339ac9f3bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:03.466116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c944b-7bb4-457a-bc52-6339ac9f3bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:03.467858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c944b-7bb4-457a-bc52-6339ac9f3bf4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:03.480883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1159/2316] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:03.485349 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec4a4d-ae2d-4efe-93fe-e07ea684d450 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:03.491866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:03.500776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec4a4d-ae2d-4efe-93fe-e07ea684d450 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:03.506193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b32ab1-809d-4a9c-ac8f-d3dde82cf554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:03.507210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b32ab1-809d-4a9c-ac8f-d3dde82cf554 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:03.507659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b32ab1-809d-4a9c-ac8f-d3dde82cf554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:03.507939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b32ab1-809d-4a9c-ac8f-d3dde82cf554 admin admin] PATH_INFO: `/v3/projects/52ed3504d0ab471d88cd6c799b842608/users/00a49159060a45f7928ad034edbaec90/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:03.526031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b32ab1-809d-4a9c-ac8f-d3dde82cf554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ed3504d0ab471d88cd6c799b842608, user_id=00a49159060a45f7928ad034edbaec90, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:03.528769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b32ab1-809d-4a9c-ac8f-d3dde82cf554 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:03.548568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1158/2317] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:03 2022] PUT /identity/v3/projects/52ed3504d0ab471d88cd6c799b842608/users/00a49159060a45f7928ad034edbaec90/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:26:03.553302 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c944b-7bb4-457a-bc52-6339ac9f3bf4 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:03.569129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c944b-7bb4-457a-bc52-6339ac9f3bf4 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:03.649259 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c12bc-7573-4415-802f-f4f657919a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:03.649968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c12bc-7573-4415-802f-f4f657919a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:03.650244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c12bc-7573-4415-802f-f4f657919a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:03.650538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c12bc-7573-4415-802f-f4f657919a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:03.651304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c12bc-7573-4415-802f-f4f657919a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:03.652953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c12bc-7573-4415-802f-f4f657919a48 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:03.664853 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1160/2318] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:03.670601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b32ab1-809d-4a9c-ac8f-d3dde82cf554 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:03.682492 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b32ab1-809d-4a9c-ac8f-d3dde82cf554 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:03.692030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e446a-4654-492b-a628-a84eccecb224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:03.693239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e446a-4654-492b-a628-a84eccecb224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:03.693535 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e446a-4654-492b-a628-a84eccecb224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:03.693848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e446a-4654-492b-a628-a84eccecb224 admin admin] PATH_INFO: `/v3/projects/52ed3504d0ab471d88cd6c799b842608/users/00a49159060a45f7928ad034edbaec90/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:03.696447 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e446a-4654-492b-a628-a84eccecb224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ed3504d0ab471d88cd6c799b842608, user_id=00a49159060a45f7928ad034edbaec90, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:03.699225 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e446a-4654-492b-a628-a84eccecb224 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:03.711826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1159/2319] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:03 2022] PUT /identity/v3/projects/52ed3504d0ab471d88cd6c799b842608/users/00a49159060a45f7928ad034edbaec90/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:26:03.722328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa519-35ae-4721-8b86-78e075c12a87 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:03.722620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa519-35ae-4721-8b86-78e075c12a87 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:03.722897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa519-35ae-4721-8b86-78e075c12a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:03.753525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-cc5fa519-35ae-4721-8b86-78e075c12a87 None None] MFA Rules not processed for user `00a49159060a45f7928ad034edbaec90`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:03.754908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cc5fa519-35ae-4721-8b86-78e075c12a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:03.834961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1161/2320] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:03.851057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e446a-4654-492b-a628-a84eccecb224 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:03.852914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-cb2e446a-4654-492b-a628-a84eccecb224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:03.942023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e446a-4654-492b-a628-a84eccecb224 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:03.946432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc1ad9-57a8-46dd-b3e8-769734d36fcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:03.947071 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc1ad9-57a8-46dd-b3e8-769734d36fcd service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:03.947350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc1ad9-57a8-46dd-b3e8-769734d36fcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:03.947625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc1ad9-57a8-46dd-b3e8-769734d36fcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:03.957515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc1ad9-57a8-46dd-b3e8-769734d36fcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:03.958951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc1ad9-57a8-46dd-b3e8-769734d36fcd service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:03.969207 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1160/2321] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:03 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:04.173815 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fa519-35ae-4721-8b86-78e075c12a87 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:04.185358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:04.260281 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fa519-35ae-4721-8b86-78e075c12a87 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:04.266198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:04.267115 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:04.267401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:04.267679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] PATH_INFO: `/v3/users/3fa57821484040599fc1f25d1e4bb815` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:04.269028 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa57821484040599fc1f25d1e4bb815)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:04.271050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:04.336361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa57821484040599fc1f25d1e4bb815'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:04.337209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa57821484040599fc1f25d1e4bb815'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:04.338002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa57821484040599fc1f25d1e4bb815'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:04.347696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa57821484040599fc1f25d1e4bb815'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:04.356337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa57821484040599fc1f25d1e4bb815'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:04.375581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1162/2322] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:04 2022] DELETE /identity/v3/users/3fa57821484040599fc1f25d1e4bb815 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:04.380696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13a004-ec38-4259-9a0c-55e3f08e7412 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:04.381207 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13a004-ec38-4259-9a0c-55e3f08e7412 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:04.381326 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13a004-ec38-4259-9a0c-55e3f08e7412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:04.401683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-8b13a004-ec38-4259-9a0c-55e3f08e7412 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:04.402921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8b13a004-ec38-4259-9a0c-55e3f08e7412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:04.464363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1161/2323] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:04.474364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:04.475855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:04.536636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5838-758e-4813-be23-0a0390cdd9f4 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:04.540710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e679-8a5b-4720-b40e-7ad3a1895888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:04.541393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e679-8a5b-4720-b40e-7ad3a1895888 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:04.541665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e679-8a5b-4720-b40e-7ad3a1895888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:04.541941 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e679-8a5b-4720-b40e-7ad3a1895888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:04.552601 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3e679-8a5b-4720-b40e-7ad3a1895888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:04.554144 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3e679-8a5b-4720-b40e-7ad3a1895888 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:04.564967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1163/2324] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:04.770433 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13a004-ec38-4259-9a0c-55e3f08e7412 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:04.772153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8b13a004-ec38-4259-9a0c-55e3f08e7412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:04.861543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:04.871929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e679-8a5b-4720-b40e-7ad3a1895888 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:04.873776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4bb3e679-8a5b-4720-b40e-7ad3a1895888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:04.898291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e679-8a5b-4720-b40e-7ad3a1895888 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:04.905091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:04.906088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:04.906513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:04.906630 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] PATH_INFO: `/v3/projects/b18d2cc99fc54b1983836ca5e96c2197` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:04.908107 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18d2cc99fc54b1983836ca5e96c2197)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:04.910500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:04.918314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13a004-ec38-4259-9a0c-55e3f08e7412 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:04.924654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a21585-72ca-4ad3-a5cf-98fe1df0ce8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:04.925353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a21585-72ca-4ad3-a5cf-98fe1df0ce8e service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:04.925642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a21585-72ca-4ad3-a5cf-98fe1df0ce8e service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:04.925921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a21585-72ca-4ad3-a5cf-98fe1df0ce8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:04.927869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-45a21585-72ca-4ad3-a5cf-98fe1df0ce8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:04.945322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:04.966757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18d2cc99fc54b1983836ca5e96c2197', 'request_id': 'req-120a8941-aa90-4dc8-96d1-37c641e6b37d'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:04.976167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18d2cc99fc54b1983836ca5e96c2197', 'request_id': 'req-120a8941-aa90-4dc8-96d1-37c641e6b37d'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:04.984301 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18d2cc99fc54b1983836ca5e96c2197', 'request_id': 'req-120a8941-aa90-4dc8-96d1-37c641e6b37d'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:04.996164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a21585-72ca-4ad3-a5cf-98fe1df0ce8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:04.996763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] The token cache is being invalidate because project b18d2cc99fc54b1983836ca5e96c2197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:04.997052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:04.997825 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:04.997937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a21585-72ca-4ad3-a5cf-98fe1df0ce8e service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:04.999801 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1164/2325] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:04 2022] DELETE /identity/v3/projects/b18d2cc99fc54b1983836ca5e96c2197 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:05.003707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:05.005361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:05.008242 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1162/2326] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:26:05.085442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a8941-aa90-4dc8-96d1-37c641e6b37d admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:05.092377 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5e0b2-7b8f-4882-951e-cf44791526a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:05.093475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5e0b2-7b8f-4882-951e-cf44791526a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:05.093755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5e0b2-7b8f-4882-951e-cf44791526a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:05.094027 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5e0b2-7b8f-4882-951e-cf44791526a2 admin admin] PATH_INFO: `/v3/users/00a49159060a45f7928ad034edbaec90` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:05.095433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5e0b2-7b8f-4882-951e-cf44791526a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a49159060a45f7928ad034edbaec90)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:05.097986 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5e0b2-7b8f-4882-951e-cf44791526a2 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:05.176354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-69f5e0b2-7b8f-4882-951e-cf44791526a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a49159060a45f7928ad034edbaec90'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:05.177477 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-69f5e0b2-7b8f-4882-951e-cf44791526a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a49159060a45f7928ad034edbaec90'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:05.178458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-69f5e0b2-7b8f-4882-951e-cf44791526a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a49159060a45f7928ad034edbaec90'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:05.192135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-69f5e0b2-7b8f-4882-951e-cf44791526a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a49159060a45f7928ad034edbaec90'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:05.202032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-69f5e0b2-7b8f-4882-951e-cf44791526a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a49159060a45f7928ad034edbaec90'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:05.227356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1165/2327] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:05 2022] DELETE /identity/v3/users/00a49159060a45f7928ad034edbaec90 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:05.614843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a21585-72ca-4ad3-a5cf-98fe1df0ce8e service nova] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:05.633335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a21585-72ca-4ad3-a5cf-98fe1df0ce8e service nova] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:05.710241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bad8bd-6557-4b5b-a800-7948c38f7865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:05.711221 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bad8bd-6557-4b5b-a800-7948c38f7865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:05.711578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bad8bd-6557-4b5b-a800-7948c38f7865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:05.711932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bad8bd-6557-4b5b-a800-7948c38f7865 admin admin] PATH_INFO: `/v3/projects/52ed3504d0ab471d88cd6c799b842608` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:05.713458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bad8bd-6557-4b5b-a800-7948c38f7865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ed3504d0ab471d88cd6c799b842608)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:05.715468 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bad8bd-6557-4b5b-a800-7948c38f7865 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:05.774351 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-28bad8bd-6557-4b5b-a800-7948c38f7865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ed3504d0ab471d88cd6c799b842608', 'request_id': 'req-28bad8bd-6557-4b5b-a800-7948c38f7865'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:05.780712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-28bad8bd-6557-4b5b-a800-7948c38f7865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ed3504d0ab471d88cd6c799b842608', 'request_id': 'req-28bad8bd-6557-4b5b-a800-7948c38f7865'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:05.789962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-28bad8bd-6557-4b5b-a800-7948c38f7865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ed3504d0ab471d88cd6c799b842608', 'request_id': 'req-28bad8bd-6557-4b5b-a800-7948c38f7865'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:05.810652 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-28bad8bd-6557-4b5b-a800-7948c38f7865 admin admin] The token cache is being invalidate because project 52ed3504d0ab471d88cd6c799b842608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:05.811096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-28bad8bd-6557-4b5b-a800-7948c38f7865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:05.812262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-28bad8bd-6557-4b5b-a800-7948c38f7865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:05.814439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1163/2328] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:05 2022] DELETE /identity/v3/projects/52ed3504d0ab471d88cd6c799b842608 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:05.820432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea777f-ca69-4266-812d-d929548c5692 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:05.820828 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea777f-ca69-4266-812d-d929548c5692 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:05.821141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea777f-ca69-4266-812d-d929548c5692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:05.843246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-f2ea777f-ca69-4266-812d-d929548c5692 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:05.844680 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f2ea777f-ca69-4266-812d-d929548c5692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:05.883079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:05.920565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1166/2329] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:05.930992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb77f80-adf8-42a5-bae3-5b592617d4de None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:05.931329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb77f80-adf8-42a5-bae3-5b592617d4de None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:05.931638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb77f80-adf8-42a5-bae3-5b592617d4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:05.954763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-9fb77f80-adf8-42a5-bae3-5b592617d4de None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:05.956098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9fb77f80-adf8-42a5-bae3-5b592617d4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:05.964674 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1164/2330] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:05.969437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea777f-ca69-4266-812d-d929548c5692 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:05.981181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea777f-ca69-4266-812d-d929548c5692 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:05.986743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7d6f3-ca7e-4811-9b28-d711f3ec12d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:05.987421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7d6f3-ca7e-4811-9b28-d711f3ec12d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:05.987701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7d6f3-ca7e-4811-9b28-d711f3ec12d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:05.987973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7d6f3-ca7e-4811-9b28-d711f3ec12d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:05.988710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7d6f3-ca7e-4811-9b28-d711f3ec12d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:26:05.989017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7d6f3-ca7e-4811-9b28-d711f3ec12d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:05.990840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7d6f3-ca7e-4811-9b28-d711f3ec12d9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:06.005206 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1167/2331] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:26:06.009892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb77f80-adf8-42a5-bae3-5b592617d4de None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:06.020541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb77f80-adf8-42a5-bae3-5b592617d4de None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:06.027196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2981270-6926-4554-86bc-98276b5f6e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:06.027891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2981270-6926-4554-86bc-98276b5f6e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.028167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2981270-6926-4554-86bc-98276b5f6e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.028443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2981270-6926-4554-86bc-98276b5f6e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.029148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2981270-6926-4554-86bc-98276b5f6e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:06.031270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2981270-6926-4554-86bc-98276b5f6e1b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:06.041310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:06.068667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1165/2332] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:26:06 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:06.073138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7d6f3-ca7e-4811-9b28-d711f3ec12d9 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:06.084495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7d6f3-ca7e-4811-9b28-d711f3ec12d9 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:06.149724 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fc694-e626-4b55-83f4-d5f9a179ae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:06.150414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc694-e626-4b55-83f4-d5f9a179ae2f admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.150698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc694-e626-4b55-83f4-d5f9a179ae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.150978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc694-e626-4b55-83f4-d5f9a179ae2f admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.151682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fc694-e626-4b55-83f4-d5f9a179ae2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:06.153653 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fc694-e626-4b55-83f4-d5f9a179ae2f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:06.174910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1168/2333] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:26:06 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:06.179329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2981270-6926-4554-86bc-98276b5f6e1b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:06.190858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2981270-6926-4554-86bc-98276b5f6e1b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:06.195899 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c2ab-a943-4521-afac-9cd9ca67e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:06.196566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c2ab-a943-4521-afac-9cd9ca67e689 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.196872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c2ab-a943-4521-afac-9cd9ca67e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.197150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c2ab-a943-4521-afac-9cd9ca67e689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.197907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965c2ab-a943-4521-afac-9cd9ca67e689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:06.199530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965c2ab-a943-4521-afac-9cd9ca67e689 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:06.211397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1166/2334] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:06.216064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fc694-e626-4b55-83f4-d5f9a179ae2f admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:06.232390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fc694-e626-4b55-83f4-d5f9a179ae2f admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:06.238357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b2771-58dd-4745-ba60-f1274e84c22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:06.239578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b2771-58dd-4745-ba60-f1274e84c22c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.240260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b2771-58dd-4745-ba60-f1274e84c22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.240674 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b2771-58dd-4745-ba60-f1274e84c22c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.241904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b2771-58dd-4745-ba60-f1274e84c22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:06.244500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b2771-58dd-4745-ba60-f1274e84c22c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:06.259501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1169/2335] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:06.264178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c2ab-a943-4521-afac-9cd9ca67e689 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:06.275366 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c2ab-a943-4521-afac-9cd9ca67e689 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:06.281297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa864d-44b6-493c-8987-a196cf9a48b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:06.282197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa864d-44b6-493c-8987-a196cf9a48b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.282484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa864d-44b6-493c-8987-a196cf9a48b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.282768 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa864d-44b6-493c-8987-a196cf9a48b5 admin admin] PATH_INFO: `/v3/projects/2792f31da0e44a6b9543b8378306cec1/users/3b36f31af1b9405dbd4e55d3fb57cf88/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.307395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa864d-44b6-493c-8987-a196cf9a48b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2792f31da0e44a6b9543b8378306cec1, user_id=3b36f31af1b9405dbd4e55d3fb57cf88, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:06.310647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa864d-44b6-493c-8987-a196cf9a48b5 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:06.328458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1167/2336] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:06 2022] PUT /identity/v3/projects/2792f31da0e44a6b9543b8378306cec1/users/3b36f31af1b9405dbd4e55d3fb57cf88/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:06.343223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1f7bc-1700-4cbe-a10e-7aafa11617b9 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.343565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1f7bc-1700-4cbe-a10e-7aafa11617b9 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.343845 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1f7bc-1700-4cbe-a10e-7aafa11617b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.372311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-06d1f7bc-1700-4cbe-a10e-7aafa11617b9 None None] MFA Rules not processed for user `3b36f31af1b9405dbd4e55d3fb57cf88`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:06.373615 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-06d1f7bc-1700-4cbe-a10e-7aafa11617b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:06.454012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1170/2337] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:06.460091 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa864d-44b6-493c-8987-a196cf9a48b5 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:06.534248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa864d-44b6-493c-8987-a196cf9a48b5 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:06.542637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9296fa-1e63-47b2-9d9f-f91388ed3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:06.544598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9296fa-1e63-47b2-9d9f-f91388ed3f5b admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.544598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9296fa-1e63-47b2-9d9f-f91388ed3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.544598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9296fa-1e63-47b2-9d9f-f91388ed3f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.544903 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9296fa-1e63-47b2-9d9f-f91388ed3f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:06.546802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9296fa-1e63-47b2-9d9f-f91388ed3f5b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:06.578132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1168/2338] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:26:06 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:06.584401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1f7bc-1700-4cbe-a10e-7aafa11617b9 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:06.600216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1f7bc-1700-4cbe-a10e-7aafa11617b9 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:06.628467 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:06.664217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ded80a-3226-4cd5-85c0-5c84c29f5b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:06.664825 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ded80a-3226-4cd5-85c0-5c84c29f5b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.665108 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ded80a-3226-4cd5-85c0-5c84c29f5b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.665415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ded80a-3226-4cd5-85c0-5c84c29f5b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.666131 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ded80a-3226-4cd5-85c0-5c84c29f5b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:06.668090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ded80a-3226-4cd5-85c0-5c84c29f5b53 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:06.695303 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1171/2339] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:26:06 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:06.697105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9296fa-1e63-47b2-9d9f-f91388ed3f5b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:06.713663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9296fa-1e63-47b2-9d9f-f91388ed3f5b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:06.719502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e611a0-43e0-4f01-aa77-803a9a9fef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:06.720514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e611a0-43e0-4f01-aa77-803a9a9fef4d admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.720809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e611a0-43e0-4f01-aa77-803a9a9fef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.721092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e611a0-43e0-4f01-aa77-803a9a9fef4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.721910 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e611a0-43e0-4f01-aa77-803a9a9fef4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:06.723698 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e611a0-43e0-4f01-aa77-803a9a9fef4d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:06.737063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1169/2340] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:06.741759 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ded80a-3226-4cd5-85c0-5c84c29f5b53 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:06.752865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ded80a-3226-4cd5-85c0-5c84c29f5b53 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:06.758531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c37154-135c-405b-93f5-d1553ea6d193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:06.759453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c37154-135c-405b-93f5-d1553ea6d193 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.759730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c37154-135c-405b-93f5-d1553ea6d193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.760034 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c37154-135c-405b-93f5-d1553ea6d193 admin admin] PATH_INFO: `/v3/projects/c05fb6db2cd647a795696df8dddaa4d3/users/49f65369cd2a4886b086ab97e92d8ad8/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.776755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c37154-135c-405b-93f5-d1553ea6d193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05fb6db2cd647a795696df8dddaa4d3, user_id=49f65369cd2a4886b086ab97e92d8ad8, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:06.779457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c37154-135c-405b-93f5-d1553ea6d193 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:06.794850 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1172/2341] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:06 2022] PUT /identity/v3/projects/c05fb6db2cd647a795696df8dddaa4d3/users/49f65369cd2a4886b086ab97e92d8ad8/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:06.799370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e611a0-43e0-4f01-aa77-803a9a9fef4d admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:06.810076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e611a0-43e0-4f01-aa77-803a9a9fef4d admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:06.870219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cae23a-9fc5-4370-ac7d-8260440d7fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:06.870902 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cae23a-9fc5-4370-ac7d-8260440d7fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.871185 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cae23a-9fc5-4370-ac7d-8260440d7fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.871464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cae23a-9fc5-4370-ac7d-8260440d7fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.872195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cae23a-9fc5-4370-ac7d-8260440d7fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:06.873868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cae23a-9fc5-4370-ac7d-8260440d7fd1 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:06.886896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1170/2342] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:06.891584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c37154-135c-405b-93f5-d1553ea6d193 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:06.902610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c37154-135c-405b-93f5-d1553ea6d193 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:06.907502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722963d5-84da-43a1-85d8-28c583daec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:06.908322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722963d5-84da-43a1-85d8-28c583daec0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.908610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722963d5-84da-43a1-85d8-28c583daec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.908885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722963d5-84da-43a1-85d8-28c583daec0e admin admin] PATH_INFO: `/v3/projects/c05fb6db2cd647a795696df8dddaa4d3/users/49f65369cd2a4886b086ab97e92d8ad8/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.910938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722963d5-84da-43a1-85d8-28c583daec0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05fb6db2cd647a795696df8dddaa4d3, user_id=49f65369cd2a4886b086ab97e92d8ad8, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:06.913714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722963d5-84da-43a1-85d8-28c583daec0e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:06.925390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1173/2343] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:06 2022] PUT /identity/v3/projects/c05fb6db2cd647a795696df8dddaa4d3/users/49f65369cd2a4886b086ab97e92d8ad8/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:06.936526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c30384-7192-4029-b8c5-b334fb7d78e7 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:06.936667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c30384-7192-4029-b8c5-b334fb7d78e7 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:06.936889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c30384-7192-4029-b8c5-b334fb7d78e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:06.965189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a0c30384-7192-4029-b8c5-b334fb7d78e7 None None] MFA Rules not processed for user `49f65369cd2a4886b086ab97e92d8ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:06.966524 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a0c30384-7192-4029-b8c5-b334fb7d78e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:06.980027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:07.046182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1171/2344] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:07.057472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722963d5-84da-43a1-85d8-28c583daec0e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:07.059572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-722963d5-84da-43a1-85d8-28c583daec0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:07.115581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722963d5-84da-43a1-85d8-28c583daec0e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:07.119578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76775df6-80a5-4cf0-871a-553b2eb43245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:07.120222 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76775df6-80a5-4cf0-871a-553b2eb43245 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:07.120511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76775df6-80a5-4cf0-871a-553b2eb43245 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:07.120787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76775df6-80a5-4cf0-871a-553b2eb43245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:07.182627 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76775df6-80a5-4cf0-871a-553b2eb43245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:07.184304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76775df6-80a5-4cf0-871a-553b2eb43245 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:07.195141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1174/2345] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:12.855753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c30384-7192-4029-b8c5-b334fb7d78e7 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:12.857996 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a0c30384-7192-4029-b8c5-b334fb7d78e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:12.872675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c30384-7192-4029-b8c5-b334fb7d78e7 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:12.877905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3383041-edc8-4897-8e3f-d5b06541cc21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:12.878581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3383041-edc8-4897-8e3f-d5b06541cc21 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:12.878864 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3383041-edc8-4897-8e3f-d5b06541cc21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:12.879127 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3383041-edc8-4897-8e3f-d5b06541cc21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:12.891080 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3383041-edc8-4897-8e3f-d5b06541cc21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:12.892628 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3383041-edc8-4897-8e3f-d5b06541cc21 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:12.902923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1172/2346] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:17.190392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:17.376609 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76775df6-80a5-4cf0-871a-553b2eb43245 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:17.378599 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-76775df6-80a5-4cf0-871a-553b2eb43245 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:17.585812 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76775df6-80a5-4cf0-871a-553b2eb43245 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:17.597476 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454306d-467c-484c-9f5e-8ec981a93676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:17.598405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454306d-467c-484c-9f5e-8ec981a93676 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:17.598984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454306d-467c-484c-9f5e-8ec981a93676 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:17.599514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454306d-467c-484c-9f5e-8ec981a93676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:17.601641 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6454306d-467c-484c-9f5e-8ec981a93676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:17.616797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454306d-467c-484c-9f5e-8ec981a93676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:17.618682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454306d-467c-484c-9f5e-8ec981a93676 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:17.641837 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1175/2347] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:22.898250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=29 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:27.629951 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=34 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:36.213583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3383041-edc8-4897-8e3f-d5b06541cc21 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:36.228527 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3383041-edc8-4897-8e3f-d5b06541cc21 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:36.236235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706b0ee-b9aa-41d0-ba1d-ebf9ee1cce1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:36.237054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706b0ee-b9aa-41d0-ba1d-ebf9ee1cce1f service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:36.237441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706b0ee-b9aa-41d0-ba1d-ebf9ee1cce1f service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:36.237787 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706b0ee-b9aa-41d0-ba1d-ebf9ee1cce1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:36.239940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a706b0ee-b9aa-41d0-ba1d-ebf9ee1cce1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:36.252964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706b0ee-b9aa-41d0-ba1d-ebf9ee1cce1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:36.254710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706b0ee-b9aa-41d0-ba1d-ebf9ee1cce1f service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:36.265749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1173/2348] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:37.315091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709be86b-8b2d-4f5d-8500-20d8c020982e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:37.316770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709be86b-8b2d-4f5d-8500-20d8c020982e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:37.317248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709be86b-8b2d-4f5d-8500-20d8c020982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:37.340734 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-709be86b-8b2d-4f5d-8500-20d8c020982e None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:37.342107 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-709be86b-8b2d-4f5d-8500-20d8c020982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:37.472397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1176/2349] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:26:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:37.524258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706b0ee-b9aa-41d0-ba1d-ebf9ee1cce1f service nova] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:37.527155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a706b0ee-b9aa-41d0-ba1d-ebf9ee1cce1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:37.611165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706b0ee-b9aa-41d0-ba1d-ebf9ee1cce1f service nova] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:37.617376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97b6c6-1ae9-414b-a59e-b36ebed509e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:37.618555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97b6c6-1ae9-414b-a59e-b36ebed509e8 service swift] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:37.618710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97b6c6-1ae9-414b-a59e-b36ebed509e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:37.619041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97b6c6-1ae9-414b-a59e-b36ebed509e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:37.637419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97b6c6-1ae9-414b-a59e-b36ebed509e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:37.639282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97b6c6-1ae9-414b-a59e-b36ebed509e8 service swift] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:37.650668 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1174/2350] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:26:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:26:37.988746 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9f1ad-ac76-42b1-a812-801b5a2d4c52 None None] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:37.989062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9f1ad-ac76-42b1-a812-801b5a2d4c52 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:37.989619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9f1ad-ac76-42b1-a812-801b5a2d4c52 None None] PATH_INFO: `/` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:37.991395 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1177/2351] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:26:37.999061 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434e34b-5b91-4e78-8c20-38c2ad285613 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:37.999352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434e34b-5b91-4e78-8c20-38c2ad285613 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:37.999642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434e34b-5b91-4e78-8c20-38c2ad285613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:38.025089 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-0434e34b-5b91-4e78-8c20-38c2ad285613 None None] MFA Rules not processed for user `4d0c6b46b5d248e5bed2b1bbdfa74f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:38.029922 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0434e34b-5b91-4e78-8c20-38c2ad285613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:38.126304 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1175/2352] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:26:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:38.141112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9f1ad-ac76-42b1-a812-801b5a2d4c52 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:38.143094 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6be9f1ad-ac76-42b1-a812-801b5a2d4c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:38.165040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9f1ad-ac76-42b1-a812-801b5a2d4c52 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:38.181138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6ad81-11eb-4c01-820a-c07634201620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:38.182247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6ad81-11eb-4c01-820a-c07634201620 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:38.182732 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6ad81-11eb-4c01-820a-c07634201620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:38.183557 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6ad81-11eb-4c01-820a-c07634201620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:38.194521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6ad81-11eb-4c01-820a-c07634201620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:38.197901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6ad81-11eb-4c01-820a-c07634201620 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:38.220218 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1178/2353] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:26:38.378812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcae59-eeea-4805-876f-45fa904a428a None None] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:38.379104 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcae59-eeea-4805-876f-45fa904a428a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:38.379380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcae59-eeea-4805-876f-45fa904a428a None None] PATH_INFO: `/` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:38.381074 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1176/2354] 10.222.0.62 () {54 vars in 921 bytes} [Thu Jul 7 07:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 07:26:38.398738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb311e-4cb3-4872-b31a-9867783b530e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:38.399533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb311e-4cb3-4872-b31a-9867783b530e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:38.399533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb311e-4cb3-4872-b31a-9867783b530e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:38.431233 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1bfb311e-4cb3-4872-b31a-9867783b530e None None] MFA Rules not processed for user `42acdb53c342401da6b32be6b9f3d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:38.432849 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1bfb311e-4cb3-4872-b31a-9867783b530e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:38.454481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1179/2355] 10.222.0.62 () {58 vars in 1018 bytes} [Thu Jul 7 07:26:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:26:38.460037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcae59-eeea-4805-876f-45fa904a428a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:38.462067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-43dcae59-eeea-4805-876f-45fa904a428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:38.478217 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcae59-eeea-4805-876f-45fa904a428a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:38.488913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb311e-4cb3-4872-b31a-9867783b530e None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:38.489513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695775f-a319-4af8-843e-1d9a257b46e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:38.490694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695775f-a319-4af8-843e-1d9a257b46e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:38.513538 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695775f-a319-4af8-843e-1d9a257b46e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:38.518962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695775f-a319-4af8-843e-1d9a257b46e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:38.564538 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695775f-a319-4af8-843e-1d9a257b46e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:38.567789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695775f-a319-4af8-843e-1d9a257b46e2 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:38.581667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb311e-4cb3-4872-b31a-9867783b530e None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:38.586661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24661ddc-72dc-4894-86f9-982eb7a8e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:38.589155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24661ddc-72dc-4894-86f9-982eb7a8e0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:38.589742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24661ddc-72dc-4894-86f9-982eb7a8e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:38.590378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24661ddc-72dc-4894-86f9-982eb7a8e0c4 admin admin] PATH_INFO: `/v3/users/3b36f31af1b9405dbd4e55d3fb57cf88` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:38.591751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24661ddc-72dc-4894-86f9-982eb7a8e0c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b36f31af1b9405dbd4e55d3fb57cf88)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:38.594348 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24661ddc-72dc-4894-86f9-982eb7a8e0c4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:38.623310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1177/2356] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:38.688475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-24661ddc-72dc-4894-86f9-982eb7a8e0c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b36f31af1b9405dbd4e55d3fb57cf88'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:38.690820 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-24661ddc-72dc-4894-86f9-982eb7a8e0c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b36f31af1b9405dbd4e55d3fb57cf88'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:38.691571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-24661ddc-72dc-4894-86f9-982eb7a8e0c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b36f31af1b9405dbd4e55d3fb57cf88'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:38.709299 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-24661ddc-72dc-4894-86f9-982eb7a8e0c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b36f31af1b9405dbd4e55d3fb57cf88'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:38.723290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-24661ddc-72dc-4894-86f9-982eb7a8e0c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b36f31af1b9405dbd4e55d3fb57cf88'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:38.756759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695775f-a319-4af8-843e-1d9a257b46e2 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:38.758220 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3695775f-a319-4af8-843e-1d9a257b46e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:38.764878 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1180/2357] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:38 2022] DELETE /identity/v3/users/3b36f31af1b9405dbd4e55d3fb57cf88 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:38.778345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3e77c-e491-4729-96df-c43944c54f8b None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:38.778996 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3e77c-e491-4729-96df-c43944c54f8b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:38.779193 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3e77c-e491-4729-96df-c43944c54f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:38.794318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:38.815107 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-4fa3e77c-e491-4729-96df-c43944c54f8b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:38.816696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4fa3e77c-e491-4729-96df-c43944c54f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:38.864489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695775f-a319-4af8-843e-1d9a257b46e2 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:38.892656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:38.939419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1181/2358] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:38.947125 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3e77c-e491-4729-96df-c43944c54f8b None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:38.949713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-4fa3e77c-e491-4729-96df-c43944c54f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:38.974542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7dabd-0c70-4b6d-ab86-43e9a748a949 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:38.975213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7dabd-0c70-4b6d-ab86-43e9a748a949 service placement] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:38.975495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7dabd-0c70-4b6d-ab86-43e9a748a949 service placement] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:38.975770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7dabd-0c70-4b6d-ab86-43e9a748a949 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:38.979127 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-86e7dabd-0c70-4b6d-ab86-43e9a748a949 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:38.995806 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7dabd-0c70-4b6d-ab86-43e9a748a949 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:38.997254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7dabd-0c70-4b6d-ab86-43e9a748a949 service placement] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:39.011627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1178/2359] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:26:39.067915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3e77c-e491-4729-96df-c43944c54f8b None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:39.071753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743f0c9-3b00-4c53-a206-12eeeffd4972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:39.072400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743f0c9-3b00-4c53-a206-12eeeffd4972 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:39.072676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743f0c9-3b00-4c53-a206-12eeeffd4972 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:39.072948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743f0c9-3b00-4c53-a206-12eeeffd4972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:39.086983 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743f0c9-3b00-4c53-a206-12eeeffd4972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:39.088582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743f0c9-3b00-4c53-a206-12eeeffd4972 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:39.105743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1182/2360] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:39.629637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3e1df-3656-44a6-883b-59b26fcd2fa0 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:39.631130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3e1df-3656-44a6-883b-59b26fcd2fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:39.631130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3e1df-3656-44a6-883b-59b26fcd2fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:39.667422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-9cf3e1df-3656-44a6-883b-59b26fcd2fa0 None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:39.668716 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9cf3e1df-3656-44a6-883b-59b26fcd2fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:39.711015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743f0c9-3b00-4c53-a206-12eeeffd4972 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:39.712592 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1743f0c9-3b00-4c53-a206-12eeeffd4972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:39.738982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743f0c9-3b00-4c53-a206-12eeeffd4972 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:39.745247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:39.746855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:39.747123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:39.747631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] PATH_INFO: `/v3/projects/2792f31da0e44a6b9543b8378306cec1` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:39.749028 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2792f31da0e44a6b9543b8378306cec1)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:39.751417 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:39.784187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1179/2361] 10.222.0.62 () {58 vars in 967 bytes} [Thu Jul 7 07:26:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:39.816207 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3e1df-3656-44a6-883b-59b26fcd2fa0 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:39.817803 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9cf3e1df-3656-44a6-883b-59b26fcd2fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:39.825993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2792f31da0e44a6b9543b8378306cec1', 'request_id': 'req-70bbd942-eef6-4fc4-ba75-35723900f29a'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:39.840520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2792f31da0e44a6b9543b8378306cec1', 'request_id': 'req-70bbd942-eef6-4fc4-ba75-35723900f29a'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:39.851854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2792f31da0e44a6b9543b8378306cec1', 'request_id': 'req-70bbd942-eef6-4fc4-ba75-35723900f29a'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:39.873706 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] The token cache is being invalidate because project 2792f31da0e44a6b9543b8378306cec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:39.874058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:39.874827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:39.881253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1183/2362] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:39 2022] DELETE /identity/v3/projects/2792f31da0e44a6b9543b8378306cec1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:39.883797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:39.886306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:39.939622 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:39.964892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3e1df-3656-44a6-883b-59b26fcd2fa0 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:40.014995 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbd942-eef6-4fc4-ba75-35723900f29a admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:40.021044 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:40.022023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:40.022308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:40.022589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] PATH_INFO: `/v3/users/49f65369cd2a4886b086ab97e92d8ad8` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:40.023907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f65369cd2a4886b086ab97e92d8ad8)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:40.026094 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:40.052975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:40.071904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf4c49-330c-480f-8406-c168aa5505bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:40.072658 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf4c49-330c-480f-8406-c168aa5505bc service swift] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:40.073009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf4c49-330c-480f-8406-c168aa5505bc service swift] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:40.073382 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf4c49-330c-480f-8406-c168aa5505bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:40.075477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0baf4c49-330c-480f-8406-c168aa5505bc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:40.119912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f65369cd2a4886b086ab97e92d8ad8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:40.120917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f65369cd2a4886b086ab97e92d8ad8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:40.121951 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f65369cd2a4886b086ab97e92d8ad8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:40.131509 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f65369cd2a4886b086ab97e92d8ad8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:40.144171 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f65369cd2a4886b086ab97e92d8ad8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:40.173707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf4c49-330c-480f-8406-c168aa5505bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:40.175694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf4c49-330c-480f-8406-c168aa5505bc service swift] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:40.179677 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1184/2363] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:39 2022] DELETE /identity/v3/users/49f65369cd2a4886b086ab97e92d8ad8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:40.197622 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1180/2364] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:26:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:26:40.531182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:40.533838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:40.706565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbae093-474c-4786-8d5e-46a55e630614 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:40.718969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa6631-85d5-4c32-80ea-639793287749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:40.719843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6631-85d5-4c32-80ea-639793287749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:40.720123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6631-85d5-4c32-80ea-639793287749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:40.720532 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6631-85d5-4c32-80ea-639793287749 admin admin] PATH_INFO: `/v3/projects/c05fb6db2cd647a795696df8dddaa4d3` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:40.721904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa6631-85d5-4c32-80ea-639793287749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05fb6db2cd647a795696df8dddaa4d3)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:40.723842 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa6631-85d5-4c32-80ea-639793287749 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:40.839223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-30fa6631-85d5-4c32-80ea-639793287749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05fb6db2cd647a795696df8dddaa4d3', 'request_id': 'req-30fa6631-85d5-4c32-80ea-639793287749'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:40.844737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:40.858080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-30fa6631-85d5-4c32-80ea-639793287749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05fb6db2cd647a795696df8dddaa4d3', 'request_id': 'req-30fa6631-85d5-4c32-80ea-639793287749'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:40.864339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-30fa6631-85d5-4c32-80ea-639793287749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05fb6db2cd647a795696df8dddaa4d3', 'request_id': 'req-30fa6631-85d5-4c32-80ea-639793287749'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:40.880521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-30fa6631-85d5-4c32-80ea-639793287749 admin admin] The token cache is being invalidate because project c05fb6db2cd647a795696df8dddaa4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:40.880521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-30fa6631-85d5-4c32-80ea-639793287749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:40.884717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-30fa6631-85d5-4c32-80ea-639793287749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:40.918895 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1185/2365] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:40 2022] DELETE /identity/v3/projects/c05fb6db2cd647a795696df8dddaa4d3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:40.920686 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0857d70-8f3f-47c5-b8ec-592de2cbb0ec None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:40.921158 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0857d70-8f3f-47c5-b8ec-592de2cbb0ec None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:40.921351 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0857d70-8f3f-47c5-b8ec-592de2cbb0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:40.966617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e0857d70-8f3f-47c5-b8ec-592de2cbb0ec None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:40.967800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e0857d70-8f3f-47c5-b8ec-592de2cbb0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:41.149415 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1181/2366] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:41.151331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44698e-bcc7-4678-ab25-9ec5e9136e96 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:41.151619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44698e-bcc7-4678-ab25-9ec5e9136e96 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:41.151894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44698e-bcc7-4678-ab25-9ec5e9136e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:41.192399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-ee44698e-bcc7-4678-ab25-9ec5e9136e96 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:41.193712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ee44698e-bcc7-4678-ab25-9ec5e9136e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:41.212508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1186/2367] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:41.214465 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0857d70-8f3f-47c5-b8ec-592de2cbb0ec None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:41.229185 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0857d70-8f3f-47c5-b8ec-592de2cbb0ec None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:41.247607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e0890-6951-47aa-83ee-1ee2415000fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:41.248354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e0890-6951-47aa-83ee-1ee2415000fc admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:41.248641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e0890-6951-47aa-83ee-1ee2415000fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:41.248924 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e0890-6951-47aa-83ee-1ee2415000fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:41.249717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e0890-6951-47aa-83ee-1ee2415000fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:26:41.250027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e0890-6951-47aa-83ee-1ee2415000fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:41.256840 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e0890-6951-47aa-83ee-1ee2415000fc admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:41.323134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1182/2368] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:26:41.327494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44698e-bcc7-4678-ab25-9ec5e9136e96 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:41.340262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44698e-bcc7-4678-ab25-9ec5e9136e96 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:41.351099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449151c-7bc4-475e-aebe-6257d031f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:41.351793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449151c-7bc4-475e-aebe-6257d031f045 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:41.352079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449151c-7bc4-475e-aebe-6257d031f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:41.352504 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449151c-7bc4-475e-aebe-6257d031f045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:41.354776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449151c-7bc4-475e-aebe-6257d031f045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:41.357915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449151c-7bc4-475e-aebe-6257d031f045 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:41.441556 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e0890-6951-47aa-83ee-1ee2415000fc admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:41.442906 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1187/2369] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:26:41 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:41.465486 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e0890-6951-47aa-83ee-1ee2415000fc admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:41.544402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7d7d4-1c57-4dd1-a3b4-202d91921dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:41.545182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7d7d4-1c57-4dd1-a3b4-202d91921dde admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:41.545559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7d7d4-1c57-4dd1-a3b4-202d91921dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:41.545905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7d7d4-1c57-4dd1-a3b4-202d91921dde admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:41.546881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7d7d4-1c57-4dd1-a3b4-202d91921dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:41.549631 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7d7d4-1c57-4dd1-a3b4-202d91921dde admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:41.588574 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1183/2370] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:26:41 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:26:41.591071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449151c-7bc4-475e-aebe-6257d031f045 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:41.602438 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449151c-7bc4-475e-aebe-6257d031f045 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:41.608067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5d571-1ca1-4f65-b2ea-46a8949458e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:41.608891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5d571-1ca1-4f65-b2ea-46a8949458e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:41.611289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5d571-1ca1-4f65-b2ea-46a8949458e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:41.611289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5d571-1ca1-4f65-b2ea-46a8949458e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:41.611289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5d571-1ca1-4f65-b2ea-46a8949458e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:41.614950 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5d571-1ca1-4f65-b2ea-46a8949458e0 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:41.631272 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1188/2371] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:41.637630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7d7d4-1c57-4dd1-a3b4-202d91921dde admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:41.648182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7d7d4-1c57-4dd1-a3b4-202d91921dde admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:41.662056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5b17a-57c8-4ed6-8a21-868bd4060526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:41.662701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b17a-57c8-4ed6-8a21-868bd4060526 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:41.663051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b17a-57c8-4ed6-8a21-868bd4060526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:41.663426 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b17a-57c8-4ed6-8a21-868bd4060526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:41.664300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5b17a-57c8-4ed6-8a21-868bd4060526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:41.666223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5b17a-57c8-4ed6-8a21-868bd4060526 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:41.686055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:41.695045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1184/2372] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:41.701287 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5d571-1ca1-4f65-b2ea-46a8949458e0 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:41.713289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5d571-1ca1-4f65-b2ea-46a8949458e0 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:41.719067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda820c-8b81-4794-97ea-834bfb49ea1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:41.720642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda820c-8b81-4794-97ea-834bfb49ea1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:41.720642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda820c-8b81-4794-97ea-834bfb49ea1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:41.720870 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda820c-8b81-4794-97ea-834bfb49ea1f admin admin] PATH_INFO: `/v3/projects/dd20364b59f54c31955be0da58a0a445/users/c2fae8f68b244d268a613343bd6fd7d6/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:41.742610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda820c-8b81-4794-97ea-834bfb49ea1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd20364b59f54c31955be0da58a0a445, user_id=c2fae8f68b244d268a613343bd6fd7d6, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:41.752129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda820c-8b81-4794-97ea-834bfb49ea1f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:41.792765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1189/2373] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:41 2022] PUT /identity/v3/projects/dd20364b59f54c31955be0da58a0a445/users/c2fae8f68b244d268a613343bd6fd7d6/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:41.794765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bbe48-b2c5-481e-bdd6-c883cea46fda None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:41.795162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bbe48-b2c5-481e-bdd6-c883cea46fda None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:41.795707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bbe48-b2c5-481e-bdd6-c883cea46fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:41.833629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-536bbe48-b2c5-481e-bdd6-c883cea46fda None None] MFA Rules not processed for user `c2fae8f68b244d268a613343bd6fd7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:41.836236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-536bbe48-b2c5-481e-bdd6-c883cea46fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:41.946033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1185/2374] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:41.950360 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda820c-8b81-4794-97ea-834bfb49ea1f admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:42.067346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda820c-8b81-4794-97ea-834bfb49ea1f admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:42.074695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123a364-6212-4fdd-b97b-1630bf09a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:42.075368 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123a364-6212-4fdd-b97b-1630bf09a9fe admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:42.076127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123a364-6212-4fdd-b97b-1630bf09a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:42.076127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123a364-6212-4fdd-b97b-1630bf09a9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:42.077328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123a364-6212-4fdd-b97b-1630bf09a9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:42.079807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123a364-6212-4fdd-b97b-1630bf09a9fe admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:42.127110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1190/2375] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:26:41 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:26:42.127731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bbe48-b2c5-481e-bdd6-c883cea46fda None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:42.148202 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bbe48-b2c5-481e-bdd6-c883cea46fda None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:42.303695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4379e-307f-422a-a412-b0d4a64384b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:42.304475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4379e-307f-422a-a412-b0d4a64384b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:42.304761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4379e-307f-422a-a412-b0d4a64384b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:42.305045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4379e-307f-422a-a412-b0d4a64384b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:42.305802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4379e-307f-422a-a412-b0d4a64384b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:42.308993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4379e-307f-422a-a412-b0d4a64384b5 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:42.361527 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1186/2376] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:26:42 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:26:42.363027 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123a364-6212-4fdd-b97b-1630bf09a9fe admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:42.406932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123a364-6212-4fdd-b97b-1630bf09a9fe admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:42.422358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb818a8-8c3c-430f-a494-0530d8bfecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:42.423124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb818a8-8c3c-430f-a494-0530d8bfecdb admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:42.423414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb818a8-8c3c-430f-a494-0530d8bfecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:42.424136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb818a8-8c3c-430f-a494-0530d8bfecdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:42.425963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb818a8-8c3c-430f-a494-0530d8bfecdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:42.427620 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb818a8-8c3c-430f-a494-0530d8bfecdb admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:42.477857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1191/2377] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:42.478032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4379e-307f-422a-a412-b0d4a64384b5 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:42.490079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4379e-307f-422a-a412-b0d4a64384b5 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:42.496967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b6b13-6985-4751-8931-1adb3d40b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:42.498679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6b13-6985-4751-8931-1adb3d40b8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:42.498966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6b13-6985-4751-8931-1adb3d40b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:42.499246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6b13-6985-4751-8931-1adb3d40b8c3 admin admin] PATH_INFO: `/v3/projects/649aa3f85c7e4e739f0ff4b9ed11130e/users/a27a75de11354e83a34fe279f3acd4bc/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:42.521273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b6b13-6985-4751-8931-1adb3d40b8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649aa3f85c7e4e739f0ff4b9ed11130e, user_id=a27a75de11354e83a34fe279f3acd4bc, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:42.524268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b6b13-6985-4751-8931-1adb3d40b8c3 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:42.596706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1187/2378] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:42 2022] PUT /identity/v3/projects/649aa3f85c7e4e739f0ff4b9ed11130e/users/a27a75de11354e83a34fe279f3acd4bc/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:42.607252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb818a8-8c3c-430f-a494-0530d8bfecdb admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:42.625361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb818a8-8c3c-430f-a494-0530d8bfecdb admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:42.730256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:42.772294 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8094724-5fe2-4388-bf2e-5c065218e593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:42.772757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8094724-5fe2-4388-bf2e-5c065218e593 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:42.773028 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8094724-5fe2-4388-bf2e-5c065218e593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:42.773366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8094724-5fe2-4388-bf2e-5c065218e593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:42.774153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8094724-5fe2-4388-bf2e-5c065218e593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:42.779324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8094724-5fe2-4388-bf2e-5c065218e593 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:42.796745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b6b13-6985-4751-8931-1adb3d40b8c3 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:42.804807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1192/2379] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:42.813782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b6b13-6985-4751-8931-1adb3d40b8c3 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:42.821281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34734b8b-7b22-46ad-8122-76533b8ce9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:42.822992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34734b8b-7b22-46ad-8122-76533b8ce9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:42.823392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34734b8b-7b22-46ad-8122-76533b8ce9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:42.823793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34734b8b-7b22-46ad-8122-76533b8ce9bf admin admin] PATH_INFO: `/v3/projects/649aa3f85c7e4e739f0ff4b9ed11130e/users/a27a75de11354e83a34fe279f3acd4bc/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:42.827897 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34734b8b-7b22-46ad-8122-76533b8ce9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=649aa3f85c7e4e739f0ff4b9ed11130e, user_id=a27a75de11354e83a34fe279f3acd4bc, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:42.831007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34734b8b-7b22-46ad-8122-76533b8ce9bf admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:42.860974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1188/2380] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:42 2022] PUT /identity/v3/projects/649aa3f85c7e4e739f0ff4b9ed11130e/users/a27a75de11354e83a34fe279f3acd4bc/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:42.863531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b07e0-ac51-4e3b-860f-29a309e8dcfc None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:42.864137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b07e0-ac51-4e3b-860f-29a309e8dcfc None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:42.864622 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b07e0-ac51-4e3b-860f-29a309e8dcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:42.905420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-9e4b07e0-ac51-4e3b-860f-29a309e8dcfc None None] MFA Rules not processed for user `a27a75de11354e83a34fe279f3acd4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:42.907277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-9e4b07e0-ac51-4e3b-860f-29a309e8dcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:43.020614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1193/2381] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:43.028697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34734b8b-7b22-46ad-8122-76533b8ce9bf admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:43.033402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-34734b8b-7b22-46ad-8122-76533b8ce9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:43.119747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:43.155740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34734b8b-7b22-46ad-8122-76533b8ce9bf admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:43.159979 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09567b-91d2-47b1-9cc9-c2ffd10425ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:43.160650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09567b-91d2-47b1-9cc9-c2ffd10425ba service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:43.160948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09567b-91d2-47b1-9cc9-c2ffd10425ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:43.161211 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09567b-91d2-47b1-9cc9-c2ffd10425ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:43.177247 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09567b-91d2-47b1-9cc9-c2ffd10425ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:43.178722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09567b-91d2-47b1-9cc9-c2ffd10425ba service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:43.193911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1189/2382] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:26:43.279457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b07e0-ac51-4e3b-860f-29a309e8dcfc None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:43.410468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b07e0-ac51-4e3b-860f-29a309e8dcfc None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:43.415455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:43.416890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:43.417545 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:43.417971 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] PATH_INFO: `/v3/users/c2fae8f68b244d268a613343bd6fd7d6` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:43.420139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2fae8f68b244d268a613343bd6fd7d6)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:43.422671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:43.524730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2fae8f68b244d268a613343bd6fd7d6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:43.526205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2fae8f68b244d268a613343bd6fd7d6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:43.531334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2fae8f68b244d268a613343bd6fd7d6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:43.546359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2fae8f68b244d268a613343bd6fd7d6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:43.597400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2fae8f68b244d268a613343bd6fd7d6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:43.600649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:43.630711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1194/2383] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:43 2022] DELETE /identity/v3/users/c2fae8f68b244d268a613343bd6fd7d6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:43.632286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c27429-2fe1-4986-b4d7-87cf29ae7d86 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:43.632577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c27429-2fe1-4986-b4d7-87cf29ae7d86 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:43.632854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c27429-2fe1-4986-b4d7-87cf29ae7d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:43.670288 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c7c27429-2fe1-4986-b4d7-87cf29ae7d86 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:43.672685 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c7c27429-2fe1-4986-b4d7-87cf29ae7d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:43.750177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1190/2384] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:26:43.764401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:43.766466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:43.864057 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f3b7c-dd37-4679-9099-a33f1a2e07c6 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:43.870931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67578db6-d8c5-4892-8b2f-4efa145c665d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:43.872028 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67578db6-d8c5-4892-8b2f-4efa145c665d service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:43.872403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67578db6-d8c5-4892-8b2f-4efa145c665d service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:43.873354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67578db6-d8c5-4892-8b2f-4efa145c665d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:43.894106 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67578db6-d8c5-4892-8b2f-4efa145c665d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:43.896612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67578db6-d8c5-4892-8b2f-4efa145c665d service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:43.914763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1195/2385] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:44.526645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c27429-2fe1-4986-b4d7-87cf29ae7d86 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:44.528419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c7c27429-2fe1-4986-b4d7-87cf29ae7d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:44.566598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c27429-2fe1-4986-b4d7-87cf29ae7d86 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:44.574808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:44.575672 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:44.576044 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:44.576713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] PATH_INFO: `/v3/projects/dd20364b59f54c31955be0da58a0a445` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:44.577769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd20364b59f54c31955be0da58a0a445)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:44.579798 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:44.661554 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd20364b59f54c31955be0da58a0a445', 'request_id': 'req-357937dc-7d53-4b07-a461-cca3ddb64bbd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:44.672459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd20364b59f54c31955be0da58a0a445', 'request_id': 'req-357937dc-7d53-4b07-a461-cca3ddb64bbd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:44.716862 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd20364b59f54c31955be0da58a0a445', 'request_id': 'req-357937dc-7d53-4b07-a461-cca3ddb64bbd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:44.743860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] The token cache is being invalidate because project dd20364b59f54c31955be0da58a0a445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:44.744069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:44.744857 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:44.748830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1191/2386] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:44 2022] DELETE /identity/v3/projects/dd20364b59f54c31955be0da58a0a445 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:44.755148 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67578db6-d8c5-4892-8b2f-4efa145c665d service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:44.769619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67578db6-d8c5-4892-8b2f-4efa145c665d service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:44.929864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4f88a-7d2d-4844-a843-a9645927e694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:44.933833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4f88a-7d2d-4844-a843-a9645927e694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:44.934334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4f88a-7d2d-4844-a843-a9645927e694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:44.935511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4f88a-7d2d-4844-a843-a9645927e694 admin admin] PATH_INFO: `/v3/users/a27a75de11354e83a34fe279f3acd4bc` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:44.938639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4f88a-7d2d-4844-a843-a9645927e694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a27a75de11354e83a34fe279f3acd4bc)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:44.945871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4f88a-7d2d-4844-a843-a9645927e694 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:45.048827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e9b4f88a-7d2d-4844-a843-a9645927e694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a27a75de11354e83a34fe279f3acd4bc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:45.049388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e9b4f88a-7d2d-4844-a843-a9645927e694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a27a75de11354e83a34fe279f3acd4bc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:45.050010 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e9b4f88a-7d2d-4844-a843-a9645927e694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a27a75de11354e83a34fe279f3acd4bc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:45.065582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e9b4f88a-7d2d-4844-a843-a9645927e694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a27a75de11354e83a34fe279f3acd4bc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:45.081533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e9b4f88a-7d2d-4844-a843-a9645927e694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a27a75de11354e83a34fe279f3acd4bc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:45.133268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1196/2387] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:44 2022] DELETE /identity/v3/users/a27a75de11354e83a34fe279f3acd4bc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:46.316097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:46.317675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:46.347985 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357937dc-7d53-4b07-a461-cca3ddb64bbd admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:46.478338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07046326-8277-465e-b961-c05fd91cef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:46.479072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07046326-8277-465e-b961-c05fd91cef2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:46.479351 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07046326-8277-465e-b961-c05fd91cef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:46.479626 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07046326-8277-465e-b961-c05fd91cef2b admin admin] PATH_INFO: `/v3/projects/649aa3f85c7e4e739f0ff4b9ed11130e` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:46.481184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07046326-8277-465e-b961-c05fd91cef2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=649aa3f85c7e4e739f0ff4b9ed11130e)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:46.483350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07046326-8277-465e-b961-c05fd91cef2b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:46.501974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:46.590352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-07046326-8277-465e-b961-c05fd91cef2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649aa3f85c7e4e739f0ff4b9ed11130e', 'request_id': 'req-07046326-8277-465e-b961-c05fd91cef2b'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:46.605515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-07046326-8277-465e-b961-c05fd91cef2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649aa3f85c7e4e739f0ff4b9ed11130e', 'request_id': 'req-07046326-8277-465e-b961-c05fd91cef2b'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:46.637827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-07046326-8277-465e-b961-c05fd91cef2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649aa3f85c7e4e739f0ff4b9ed11130e', 'request_id': 'req-07046326-8277-465e-b961-c05fd91cef2b'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:46.657568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-07046326-8277-465e-b961-c05fd91cef2b admin admin] The token cache is being invalidate because project 649aa3f85c7e4e739f0ff4b9ed11130e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:46.658031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-07046326-8277-465e-b961-c05fd91cef2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:46.658852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-07046326-8277-465e-b961-c05fd91cef2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:46.661178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1192/2388] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:46 2022] DELETE /identity/v3/projects/649aa3f85c7e4e739f0ff4b9ed11130e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:46.665993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab215d1-f260-48dd-884f-138d222bbd5a None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:46.666582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab215d1-f260-48dd-884f-138d222bbd5a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:46.666832 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab215d1-f260-48dd-884f-138d222bbd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:46.680224 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:46.708978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1ab215d1-f260-48dd-884f-138d222bbd5a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:46.711534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1ab215d1-f260-48dd-884f-138d222bbd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:46.823984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1197/2389] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:46.831927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b19ce-4a87-4e6e-926f-c21910300a4c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:46.832580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b19ce-4a87-4e6e-926f-c21910300a4c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:46.834250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b19ce-4a87-4e6e-926f-c21910300a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:46.879549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ab5b19ce-4a87-4e6e-926f-c21910300a4c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:46.882057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ab5b19ce-4a87-4e6e-926f-c21910300a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:46.901923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1193/2390] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:46.903780 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab215d1-f260-48dd-884f-138d222bbd5a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:46.914673 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab215d1-f260-48dd-884f-138d222bbd5a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:46.919979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21168879-ed62-4d3b-b1e5-8022333a9421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:46.925296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21168879-ed62-4d3b-b1e5-8022333a9421 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:46.925296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21168879-ed62-4d3b-b1e5-8022333a9421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:46.925296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21168879-ed62-4d3b-b1e5-8022333a9421 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:46.925296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21168879-ed62-4d3b-b1e5-8022333a9421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:26:46.925296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21168879-ed62-4d3b-b1e5-8022333a9421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:46.925296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21168879-ed62-4d3b-b1e5-8022333a9421 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:46.944493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1198/2391] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:26:46.945781 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b19ce-4a87-4e6e-926f-c21910300a4c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:46.959303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b19ce-4a87-4e6e-926f-c21910300a4c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:46.978233 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6ca52-f6ba-4597-9d53-5e842685cdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:46.978943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6ca52-f6ba-4597-9d53-5e842685cdef admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:46.979234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6ca52-f6ba-4597-9d53-5e842685cdef admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:46.979520 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6ca52-f6ba-4597-9d53-5e842685cdef admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:46.980618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6ca52-f6ba-4597-9d53-5e842685cdef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:46.982703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6ca52-f6ba-4597-9d53-5e842685cdef admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:47.053270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1194/2392] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:26:46 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:47.058798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21168879-ed62-4d3b-b1e5-8022333a9421 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:47.089508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21168879-ed62-4d3b-b1e5-8022333a9421 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:47.291176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39a8d9-ba43-4293-aae6-ade8ef7b59ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:47.292443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39a8d9-ba43-4293-aae6-ade8ef7b59ae admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:47.292572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39a8d9-ba43-4293-aae6-ade8ef7b59ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:47.293026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39a8d9-ba43-4293-aae6-ade8ef7b59ae admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:47.294065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39a8d9-ba43-4293-aae6-ade8ef7b59ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:47.296354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39a8d9-ba43-4293-aae6-ade8ef7b59ae admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:47.336240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1199/2393] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:26:47 2022] POST /identity/v3/users => generated 292 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:26:47.341295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6ca52-f6ba-4597-9d53-5e842685cdef admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:47.356415 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6ca52-f6ba-4597-9d53-5e842685cdef admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:47.376283 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879096aa-4cf6-4291-8b73-2f6ccd491da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:47.377059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879096aa-4cf6-4291-8b73-2f6ccd491da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:47.377477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879096aa-4cf6-4291-8b73-2f6ccd491da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:47.378187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879096aa-4cf6-4291-8b73-2f6ccd491da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:47.379177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879096aa-4cf6-4291-8b73-2f6ccd491da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:47.381761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879096aa-4cf6-4291-8b73-2f6ccd491da9 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:47.438048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1195/2394] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:47.443031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39a8d9-ba43-4293-aae6-ade8ef7b59ae admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:47.466626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39a8d9-ba43-4293-aae6-ade8ef7b59ae admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:47.486175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a9b1e-6f42-4f99-b3b0-451dd8614d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:47.489858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9b1e-6f42-4f99-b3b0-451dd8614d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:47.490447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9b1e-6f42-4f99-b3b0-451dd8614d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:47.490970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9b1e-6f42-4f99-b3b0-451dd8614d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:47.492600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a9b1e-6f42-4f99-b3b0-451dd8614d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:47.495513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a9b1e-6f42-4f99-b3b0-451dd8614d8c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:47.525919 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1200/2395] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:26:47.527214 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879096aa-4cf6-4291-8b73-2f6ccd491da9 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:47.548414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879096aa-4cf6-4291-8b73-2f6ccd491da9 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:47.554699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e70518-e742-4ec2-9c23-c73b5f1eefb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:47.556679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e70518-e742-4ec2-9c23-c73b5f1eefb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:47.557450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e70518-e742-4ec2-9c23-c73b5f1eefb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:47.558443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e70518-e742-4ec2-9c23-c73b5f1eefb3 admin admin] PATH_INFO: `/v3/projects/95fee3616d8c49cc937319d559e3dce1/users/8d4c2a0f8b2e43f4b9f81d9dd7b165a7/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:47.583920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e70518-e742-4ec2-9c23-c73b5f1eefb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95fee3616d8c49cc937319d559e3dce1, user_id=8d4c2a0f8b2e43f4b9f81d9dd7b165a7, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:47.587177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e70518-e742-4ec2-9c23-c73b5f1eefb3 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:47.610982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1196/2396] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:47 2022] PUT /identity/v3/projects/95fee3616d8c49cc937319d559e3dce1/users/8d4c2a0f8b2e43f4b9f81d9dd7b165a7/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:47.622112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47728a-270d-4b4c-aefb-b3032e981541 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:47.622555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47728a-270d-4b4c-aefb-b3032e981541 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:47.622841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47728a-270d-4b4c-aefb-b3032e981541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:47.675782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-3d47728a-270d-4b4c-aefb-b3032e981541 None None] MFA Rules not processed for user `8d4c2a0f8b2e43f4b9f81d9dd7b165a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:47.677254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3d47728a-270d-4b4c-aefb-b3032e981541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:47.776829 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:47.792562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1201/2397] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:47.794079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e70518-e742-4ec2-9c23-c73b5f1eefb3 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:47.954182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e70518-e742-4ec2-9c23-c73b5f1eefb3 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:47.962733 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a30e4-77a7-4e8b-95cb-6e122275a219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:47.963428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a30e4-77a7-4e8b-95cb-6e122275a219 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:47.963711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a30e4-77a7-4e8b-95cb-6e122275a219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:47.963991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a30e4-77a7-4e8b-95cb-6e122275a219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:47.964708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a30e4-77a7-4e8b-95cb-6e122275a219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:47.976023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a30e4-77a7-4e8b-95cb-6e122275a219 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:48.031813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1197/2398] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:26:47 2022] POST /identity/v3/projects => generated 383 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:48.036904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47728a-270d-4b4c-aefb-b3032e981541 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:48.068860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47728a-270d-4b4c-aefb-b3032e981541 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:48.221252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a834b-f5c6-425a-baca-8bd9a4699160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:48.221252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a834b-f5c6-425a-baca-8bd9a4699160 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:48.221252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a834b-f5c6-425a-baca-8bd9a4699160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:48.221252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a834b-f5c6-425a-baca-8bd9a4699160 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:48.221879 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a834b-f5c6-425a-baca-8bd9a4699160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:48.230940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a834b-f5c6-425a-baca-8bd9a4699160 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:48.299577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1202/2399] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:26:48 2022] POST /identity/v3/users => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:48.300890 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a30e4-77a7-4e8b-95cb-6e122275a219 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:48.316863 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a30e4-77a7-4e8b-95cb-6e122275a219 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:48.332092 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06082ed-6c1c-4195-990c-4ee18a1b995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:48.333176 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06082ed-6c1c-4195-990c-4ee18a1b995a admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:48.333643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06082ed-6c1c-4195-990c-4ee18a1b995a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:48.335129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06082ed-6c1c-4195-990c-4ee18a1b995a admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:48.336238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06082ed-6c1c-4195-990c-4ee18a1b995a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:48.343020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06082ed-6c1c-4195-990c-4ee18a1b995a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:48.378781 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1198/2400] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:26:48.380143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a834b-f5c6-425a-baca-8bd9a4699160 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:48.412072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a834b-f5c6-425a-baca-8bd9a4699160 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:48.433632 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0aa02-5bdc-42cc-ae54-cec13c89e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:48.434681 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0aa02-5bdc-42cc-ae54-cec13c89e1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:48.438588 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0aa02-5bdc-42cc-ae54-cec13c89e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:48.439029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0aa02-5bdc-42cc-ae54-cec13c89e1f2 admin admin] PATH_INFO: `/v3/projects/2d74f1fdb7274a3380383928d1c0aa06/users/344950cfe70a419fac220c9d86d9c981/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:48.480558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0aa02-5bdc-42cc-ae54-cec13c89e1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d74f1fdb7274a3380383928d1c0aa06, user_id=344950cfe70a419fac220c9d86d9c981, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:48.488867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0aa02-5bdc-42cc-ae54-cec13c89e1f2 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:48.534080 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1203/2401] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:48 2022] PUT /identity/v3/projects/2d74f1fdb7274a3380383928d1c0aa06/users/344950cfe70a419fac220c9d86d9c981/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:48.535296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06082ed-6c1c-4195-990c-4ee18a1b995a admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:48.546273 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06082ed-6c1c-4195-990c-4ee18a1b995a admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:48.553601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:48.703585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3276875-08d5-47a0-b31a-194bf9a21db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:48.704374 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3276875-08d5-47a0-b31a-194bf9a21db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:48.704695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3276875-08d5-47a0-b31a-194bf9a21db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:48.705004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3276875-08d5-47a0-b31a-194bf9a21db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:48.705802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3276875-08d5-47a0-b31a-194bf9a21db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:48.711524 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3276875-08d5-47a0-b31a-194bf9a21db7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:48.728935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1199/2402] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:48.735304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0aa02-5bdc-42cc-ae54-cec13c89e1f2 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:48.758850 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0aa02-5bdc-42cc-ae54-cec13c89e1f2 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:48.773371 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb5907-8237-428b-8954-23d1c731466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:48.774355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb5907-8237-428b-8954-23d1c731466e admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:48.774880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb5907-8237-428b-8954-23d1c731466e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:48.775256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb5907-8237-428b-8954-23d1c731466e admin admin] PATH_INFO: `/v3/projects/2d74f1fdb7274a3380383928d1c0aa06/users/344950cfe70a419fac220c9d86d9c981/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:48.777560 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb5907-8237-428b-8954-23d1c731466e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d74f1fdb7274a3380383928d1c0aa06, user_id=344950cfe70a419fac220c9d86d9c981, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:48.781199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb5907-8237-428b-8954-23d1c731466e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:48.802552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1204/2403] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:48 2022] PUT /identity/v3/projects/2d74f1fdb7274a3380383928d1c0aa06/users/344950cfe70a419fac220c9d86d9c981/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:26:48.878580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8891dd-67ad-4066-8225-ddba30edb7b7 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:48.878993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8891dd-67ad-4066-8225-ddba30edb7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:48.879369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8891dd-67ad-4066-8225-ddba30edb7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:48.923275 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-cc8891dd-67ad-4066-8225-ddba30edb7b7 None None] MFA Rules not processed for user `344950cfe70a419fac220c9d86d9c981`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:48.925270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-cc8891dd-67ad-4066-8225-ddba30edb7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:49.057339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1200/2404] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:49.066310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb5907-8237-428b-8954-23d1c731466e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:49.068835 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-12cb5907-8237-428b-8954-23d1c731466e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:49.147207 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb5907-8237-428b-8954-23d1c731466e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:49.151013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db910946-2fc7-4643-9deb-05f8e6a97a88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:49.151686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db910946-2fc7-4643-9deb-05f8e6a97a88 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:49.152410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db910946-2fc7-4643-9deb-05f8e6a97a88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:49.152695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db910946-2fc7-4643-9deb-05f8e6a97a88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:49.164481 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db910946-2fc7-4643-9deb-05f8e6a97a88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:49.166260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db910946-2fc7-4643-9deb-05f8e6a97a88 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:49.179082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1205/2405] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:26:49.324203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8891dd-67ad-4066-8225-ddba30edb7b7 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:49.351678 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8891dd-67ad-4066-8225-ddba30edb7b7 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:49.361168 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c89f-7613-4218-976e-3d43adc7f844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:49.364864 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c89f-7613-4218-976e-3d43adc7f844 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:49.365041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c89f-7613-4218-976e-3d43adc7f844 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:49.365265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c89f-7613-4218-976e-3d43adc7f844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:49.485816 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583c89f-7613-4218-976e-3d43adc7f844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:49.487568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583c89f-7613-4218-976e-3d43adc7f844 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:49.499241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1201/2406] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:52.791028 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db910946-2fc7-4643-9deb-05f8e6a97a88 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:52.964156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:52.972509 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db910946-2fc7-4643-9deb-05f8e6a97a88 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:52.987093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6b947-af43-4a23-ac2a-830e490b58e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:52.989664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6b947-af43-4a23-ac2a-830e490b58e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:52.991163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6b947-af43-4a23-ac2a-830e490b58e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:52.992257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6b947-af43-4a23-ac2a-830e490b58e3 admin admin] PATH_INFO: `/v3/users/8d4c2a0f8b2e43f4b9f81d9dd7b165a7` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:53.002795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6b947-af43-4a23-ac2a-830e490b58e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4c2a0f8b2e43f4b9f81d9dd7b165a7)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:53.021756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6b947-af43-4a23-ac2a-830e490b58e3 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:53.071893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c89f-7613-4218-976e-3d43adc7f844 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:53.075662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7583c89f-7613-4218-976e-3d43adc7f844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:53.187928 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-65d6b947-af43-4a23-ac2a-830e490b58e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4c2a0f8b2e43f4b9f81d9dd7b165a7'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:53.189004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-65d6b947-af43-4a23-ac2a-830e490b58e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4c2a0f8b2e43f4b9f81d9dd7b165a7'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:53.190058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-65d6b947-af43-4a23-ac2a-830e490b58e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4c2a0f8b2e43f4b9f81d9dd7b165a7'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:53.201944 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-65d6b947-af43-4a23-ac2a-830e490b58e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4c2a0f8b2e43f4b9f81d9dd7b165a7'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:53.208358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:53.212822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-65d6b947-af43-4a23-ac2a-830e490b58e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4c2a0f8b2e43f4b9f81d9dd7b165a7'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:53.245164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c89f-7613-4218-976e-3d43adc7f844 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:53.251940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1206/2407] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:52 2022] DELETE /identity/v3/users/8d4c2a0f8b2e43f4b9f81d9dd7b165a7 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:53.258119 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4a0f6-5598-477e-8698-3c8a01f5154f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:53.258891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5304a-309f-46f4-baf2-fbace6d66992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:53.259609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5304a-309f-46f4-baf2-fbace6d66992 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:53.259959 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4a0f6-5598-477e-8698-3c8a01f5154f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:53.260324 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4a0f6-5598-477e-8698-3c8a01f5154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:53.260772 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5304a-309f-46f4-baf2-fbace6d66992 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:53.261891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5304a-309f-46f4-baf2-fbace6d66992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:53.265425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6fe5304a-309f-46f4-baf2-fbace6d66992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:53.298988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-c1a4a0f6-5598-477e-8698-3c8a01f5154f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:53.300786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c1a4a0f6-5598-477e-8698-3c8a01f5154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:53.301860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5304a-309f-46f4-baf2-fbace6d66992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:53.303538 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5304a-309f-46f4-baf2-fbace6d66992 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:53.322956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1202/2408] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:53.407366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1207/2409] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:53.537896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5304a-309f-46f4-baf2-fbace6d66992 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:53.539512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6fe5304a-309f-46f4-baf2-fbace6d66992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:53.558795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5304a-309f-46f4-baf2-fbace6d66992 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:53.679266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38e4cb-46c1-40c2-b5fe-0aaa6cb831f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:53.680096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38e4cb-46c1-40c2-b5fe-0aaa6cb831f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:53.680601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38e4cb-46c1-40c2-b5fe-0aaa6cb831f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:53.680955 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38e4cb-46c1-40c2-b5fe-0aaa6cb831f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:53.707812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38e4cb-46c1-40c2-b5fe-0aaa6cb831f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:53.709480 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38e4cb-46c1-40c2-b5fe-0aaa6cb831f4 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:53.732287 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1203/2410] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:54.449872 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4a0f6-5598-477e-8698-3c8a01f5154f None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:54.451503 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c1a4a0f6-5598-477e-8698-3c8a01f5154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:54.531871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4a0f6-5598-477e-8698-3c8a01f5154f None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:54.542457 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4abda-1263-4987-87a3-7c4829b0798f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:54.544431 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4abda-1263-4987-87a3-7c4829b0798f service placement] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:54.545286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4abda-1263-4987-87a3-7c4829b0798f service placement] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:54.546002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4abda-1263-4987-87a3-7c4829b0798f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:54.550548 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-88d4abda-1263-4987-87a3-7c4829b0798f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:54.586875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4abda-1263-4987-87a3-7c4829b0798f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:54.587896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4abda-1263-4987-87a3-7c4829b0798f service placement] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:54.588154 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38e4cb-46c1-40c2-b5fe-0aaa6cb831f4 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:54.589881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7e38e4cb-46c1-40c2-b5fe-0aaa6cb831f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:54.602556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1208/2411] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:54.603354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38e4cb-46c1-40c2-b5fe-0aaa6cb831f4 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:54.608402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:54.609714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:54.610163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:54.610611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] PATH_INFO: `/v3/users/cee7676762a04042a599439058ba90ad` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:54.612055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee7676762a04042a599439058ba90ad)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:54.614352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:54.678296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee7676762a04042a599439058ba90ad'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:54.679277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee7676762a04042a599439058ba90ad'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:54.679888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee7676762a04042a599439058ba90ad'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:54.690262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee7676762a04042a599439058ba90ad'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:54.704141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee7676762a04042a599439058ba90ad'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:54.732128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1204/2412] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:54 2022] DELETE /identity/v3/users/cee7676762a04042a599439058ba90ad => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:54.878604 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4abda-1263-4987-87a3-7c4829b0798f service placement] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:54.882505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-88d4abda-1263-4987-87a3-7c4829b0798f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:54.894739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:54.902558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4abda-1263-4987-87a3-7c4829b0798f service placement] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:55.008712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:55.009752 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:55.010341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:55.010629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] PATH_INFO: `/v3/projects/95fee3616d8c49cc937319d559e3dce1` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:55.012582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] RBAC: Authorizing `identity:delete_project(project_id=95fee3616d8c49cc937319d559e3dce1)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:55.015801 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:55.097535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95fee3616d8c49cc937319d559e3dce1', 'request_id': 'req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.102285 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:55.104031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:55.109675 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95fee3616d8c49cc937319d559e3dce1', 'request_id': 'req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.124128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95fee3616d8c49cc937319d559e3dce1', 'request_id': 'req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.131827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d302c7-1481-47e2-b2e0-0aa43087f9d4 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:55.137667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] The token cache is being invalidate because project 95fee3616d8c49cc937319d559e3dce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:55.138370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.139110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.141503 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1209/2413] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:54 2022] DELETE /identity/v3/projects/95fee3616d8c49cc937319d559e3dce1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:55.149768 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:55.152988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:55.209837 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:55.227901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:55.228807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:55.229086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:55.229398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] PATH_INFO: `/v3/projects/e976a7167fc84b0ca11b4d0d1effcff3` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:55.230967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e976a7167fc84b0ca11b4d0d1effcff3)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:55.231838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6e19f-f7d4-4cc3-9f0f-44afeb67e39c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:55.233269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:55.243196 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:55.244153 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:55.244521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:55.244903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] PATH_INFO: `/v3/users/344950cfe70a419fac220c9d86d9c981` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:55.246918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=344950cfe70a419fac220c9d86d9c981)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:55.250466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:55.299285 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e976a7167fc84b0ca11b4d0d1effcff3', 'request_id': 'req-e5e64bd7-e9aa-4799-85a8-e572da0018d3'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.305346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e976a7167fc84b0ca11b4d0d1effcff3', 'request_id': 'req-e5e64bd7-e9aa-4799-85a8-e572da0018d3'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.316220 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e976a7167fc84b0ca11b4d0d1effcff3', 'request_id': 'req-e5e64bd7-e9aa-4799-85a8-e572da0018d3'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.321057 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:55.333711 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344950cfe70a419fac220c9d86d9c981'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.335497 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344950cfe70a419fac220c9d86d9c981'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.335816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344950cfe70a419fac220c9d86d9c981'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.341363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] The token cache is being invalidate because project e976a7167fc84b0ca11b4d0d1effcff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:55.342053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.343528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.344792 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344950cfe70a419fac220c9d86d9c981'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.346547 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1205/2414] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:55 2022] DELETE /identity/v3/projects/e976a7167fc84b0ca11b4d0d1effcff3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:26:55.350510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:55.352396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:55.364520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344950cfe70a419fac220c9d86d9c981'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.399745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1210/2415] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:55 2022] DELETE /identity/v3/users/344950cfe70a419fac220c9d86d9c981 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:55.491261 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e64bd7-e9aa-4799-85a8-e572da0018d3 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:55.575419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be52427-796c-4e85-911f-738b0e83d1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:55.576437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be52427-796c-4e85-911f-738b0e83d1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:55.577515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be52427-796c-4e85-911f-738b0e83d1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:55.578022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be52427-796c-4e85-911f-738b0e83d1ad admin admin] PATH_INFO: `/v3/users/5f7dae0b24104840854cf75bb62a078f` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:55.580145 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be52427-796c-4e85-911f-738b0e83d1ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7dae0b24104840854cf75bb62a078f)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:55.583890 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be52427-796c-4e85-911f-738b0e83d1ad admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:55.619929 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:55.668165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-3be52427-796c-4e85-911f-738b0e83d1ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7dae0b24104840854cf75bb62a078f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.669457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-3be52427-796c-4e85-911f-738b0e83d1ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7dae0b24104840854cf75bb62a078f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.672153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-3be52427-796c-4e85-911f-738b0e83d1ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7dae0b24104840854cf75bb62a078f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.681891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-3be52427-796c-4e85-911f-738b0e83d1ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7dae0b24104840854cf75bb62a078f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.693970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-3be52427-796c-4e85-911f-738b0e83d1ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7dae0b24104840854cf75bb62a078f'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:55.723088 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1206/2416] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:55 2022] DELETE /identity/v3/users/5f7dae0b24104840854cf75bb62a078f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:26:55.905460 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:55.907276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:55.925671 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21b387-20fe-411e-a733-38184df39569 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:56.015169 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:56.016366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:56.016366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:56.016570 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] PATH_INFO: `/v3/projects/2d74f1fdb7274a3380383928d1c0aa06` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:56.017759 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d74f1fdb7274a3380383928d1c0aa06)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:56.019700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:56.079957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d74f1fdb7274a3380383928d1c0aa06', 'request_id': 'req-baba6377-a592-4994-aa6a-2f8c160848a4'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:56.090267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d74f1fdb7274a3380383928d1c0aa06', 'request_id': 'req-baba6377-a592-4994-aa6a-2f8c160848a4'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:56.097042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d74f1fdb7274a3380383928d1c0aa06', 'request_id': 'req-baba6377-a592-4994-aa6a-2f8c160848a4'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:56.113174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] The token cache is being invalidate because project 2d74f1fdb7274a3380383928d1c0aa06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:56.113531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:56.115390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:56.116933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1211/2417] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:55 2022] DELETE /identity/v3/projects/2d74f1fdb7274a3380383928d1c0aa06 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:56.129345 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7f079-982b-4780-a0fd-7f277cfbe7cc None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:56.129883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7f079-982b-4780-a0fd-7f277cfbe7cc None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:56.130344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7f079-982b-4780-a0fd-7f277cfbe7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:56.160490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-04e7f079-982b-4780-a0fd-7f277cfbe7cc None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:56.162016 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-04e7f079-982b-4780-a0fd-7f277cfbe7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:56.184756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:56.186959 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:56.263868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:56.289052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba6377-a592-4994-aa6a-2f8c160848a4 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:56.299576 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:56.300581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:56.301506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:56.301884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] PATH_INFO: `/v3/projects/9cc00a8f0ac346bd9cf75058a651f019` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:56.303312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc00a8f0ac346bd9cf75058a651f019)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:56.305491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:56.330274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1207/2418] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:56.339139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7458-c37b-4bf0-b3ef-56ad4cb5e596 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:56.339608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7458-c37b-4bf0-b3ef-56ad4cb5e596 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:56.339820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7458-c37b-4bf0-b3ef-56ad4cb5e596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:56.375298 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-fd1e7458-c37b-4bf0-b3ef-56ad4cb5e596 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:56.377022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-fd1e7458-c37b-4bf0-b3ef-56ad4cb5e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:56.418371 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc00a8f0ac346bd9cf75058a651f019', 'request_id': 'req-216d3cb7-b3ce-46a1-a29d-a6a82038b747'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:56.439553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc00a8f0ac346bd9cf75058a651f019', 'request_id': 'req-216d3cb7-b3ce-46a1-a29d-a6a82038b747'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:56.453081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc00a8f0ac346bd9cf75058a651f019', 'request_id': 'req-216d3cb7-b3ce-46a1-a29d-a6a82038b747'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:56.481353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] The token cache is being invalidate because project 9cc00a8f0ac346bd9cf75058a651f019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:56.481657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:56.482607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:56.487182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1212/2419] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:56 2022] DELETE /identity/v3/projects/9cc00a8f0ac346bd9cf75058a651f019 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:26:56.518042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:56.519907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1208/2420] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:26:56.549384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d3cb7-b3ce-46a1-a29d-a6a82038b747 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:56.579903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa09c5-fde0-4a77-a15f-16d5d13a07c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:56.580610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa09c5-fde0-4a77-a15f-16d5d13a07c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:56.580892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa09c5-fde0-4a77-a15f-16d5d13a07c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:56.581170 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa09c5-fde0-4a77-a15f-16d5d13a07c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:56.584072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa09c5-fde0-4a77-a15f-16d5d13a07c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:26:56.584475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa09c5-fde0-4a77-a15f-16d5d13a07c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:56.586195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa09c5-fde0-4a77-a15f-16d5d13a07c8 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:56.609268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e7458-c37b-4bf0-b3ef-56ad4cb5e596 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:56.620553 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e7458-c37b-4bf0-b3ef-56ad4cb5e596 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:56.621799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1213/2421] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:26:56.626452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85880bf0-fa23-4567-93ed-d3a031e4abe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:56.627280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85880bf0-fa23-4567-93ed-d3a031e4abe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:56.627802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85880bf0-fa23-4567-93ed-d3a031e4abe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:56.628285 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85880bf0-fa23-4567-93ed-d3a031e4abe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:56.629456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85880bf0-fa23-4567-93ed-d3a031e4abe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:56.631795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85880bf0-fa23-4567-93ed-d3a031e4abe6 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:56.711867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa09c5-fde0-4a77-a15f-16d5d13a07c8 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:56.718581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1209/2422] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:26:56 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:56.723802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa09c5-fde0-4a77-a15f-16d5d13a07c8 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:56.842187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bbfc1-8e87-4e63-8425-a76b684762b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:56.842912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bbfc1-8e87-4e63-8425-a76b684762b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:56.843191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bbfc1-8e87-4e63-8425-a76b684762b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:56.843466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bbfc1-8e87-4e63-8425-a76b684762b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:56.844160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bbfc1-8e87-4e63-8425-a76b684762b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:56.846114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bbfc1-8e87-4e63-8425-a76b684762b9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:56.875819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1214/2423] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:26:56 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:56.876222 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85880bf0-fa23-4567-93ed-d3a031e4abe6 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:56.892310 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85880bf0-fa23-4567-93ed-d3a031e4abe6 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:56.899570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26459115-0ee9-4f0e-9870-1156074bdd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:56.900354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26459115-0ee9-4f0e-9870-1156074bdd20 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:56.900798 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26459115-0ee9-4f0e-9870-1156074bdd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:56.901140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26459115-0ee9-4f0e-9870-1156074bdd20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:56.903921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26459115-0ee9-4f0e-9870-1156074bdd20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:56.907084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26459115-0ee9-4f0e-9870-1156074bdd20 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:56.920448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1210/2424] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:26:56.925158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bbfc1-8e87-4e63-8425-a76b684762b9 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:56.939226 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bbfc1-8e87-4e63-8425-a76b684762b9 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:56.944288 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861d27c-2cd2-4b5b-afa2-b29beffb325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:56.945167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861d27c-2cd2-4b5b-afa2-b29beffb325c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:56.945670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861d27c-2cd2-4b5b-afa2-b29beffb325c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:56.946020 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861d27c-2cd2-4b5b-afa2-b29beffb325c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:56.947997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861d27c-2cd2-4b5b-afa2-b29beffb325c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:56.950412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861d27c-2cd2-4b5b-afa2-b29beffb325c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:56.974735 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1215/2425] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:56.976183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26459115-0ee9-4f0e-9870-1156074bdd20 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:56.988369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26459115-0ee9-4f0e-9870-1156074bdd20 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:57.018370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc2c0a-a2f7-48d1-83d9-236be7f5ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:57.019399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2c0a-a2f7-48d1-83d9-236be7f5ef27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:57.019749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2c0a-a2f7-48d1-83d9-236be7f5ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:57.020129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2c0a-a2f7-48d1-83d9-236be7f5ef27 admin admin] PATH_INFO: `/v3/projects/8e5428bbc51f4ce8b0c4e746a131bc20/users/24fe648c8ade490abe8ec3f845de38ad/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:57.036193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:57.044371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc2c0a-a2f7-48d1-83d9-236be7f5ef27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5428bbc51f4ce8b0c4e746a131bc20, user_id=24fe648c8ade490abe8ec3f845de38ad, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:57.047775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc2c0a-a2f7-48d1-83d9-236be7f5ef27 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:57.067845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1211/2426] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:56 2022] PUT /identity/v3/projects/8e5428bbc51f4ce8b0c4e746a131bc20/users/24fe648c8ade490abe8ec3f845de38ad/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:57.080010 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8a99-65a1-455e-a0e1-aff73162edd5 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:57.080690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8a99-65a1-455e-a0e1-aff73162edd5 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:57.081074 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8a99-65a1-455e-a0e1-aff73162edd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:57.119242 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-9dfd8a99-65a1-455e-a0e1-aff73162edd5 None None] MFA Rules not processed for user `24fe648c8ade490abe8ec3f845de38ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:57.120008 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-9dfd8a99-65a1-455e-a0e1-aff73162edd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:57.155407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:57.217276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1216/2427] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:57.231440 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc2c0a-a2f7-48d1-83d9-236be7f5ef27 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:57.302183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc2c0a-a2f7-48d1-83d9-236be7f5ef27 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:57.306896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db4c20-d96a-41b2-acff-41a5d5e5b994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:57.307559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db4c20-d96a-41b2-acff-41a5d5e5b994 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:57.308169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db4c20-d96a-41b2-acff-41a5d5e5b994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:57.309175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db4c20-d96a-41b2-acff-41a5d5e5b994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:57.309911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db4c20-d96a-41b2-acff-41a5d5e5b994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:57.311866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db4c20-d96a-41b2-acff-41a5d5e5b994 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:57.345736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1212/2428] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:26:57 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:57.347067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd8a99-65a1-455e-a0e1-aff73162edd5 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:57.359159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd8a99-65a1-455e-a0e1-aff73162edd5 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:57.424411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dda170-1372-4bb3-b325-8ea1104fbd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:57.426982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dda170-1372-4bb3-b325-8ea1104fbd2c admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:57.426982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dda170-1372-4bb3-b325-8ea1104fbd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:57.426982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dda170-1372-4bb3-b325-8ea1104fbd2c admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:57.426982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dda170-1372-4bb3-b325-8ea1104fbd2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:57.429166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dda170-1372-4bb3-b325-8ea1104fbd2c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:57.455077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1217/2429] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:26:57 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:57.460210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db4c20-d96a-41b2-acff-41a5d5e5b994 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:57.478179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db4c20-d96a-41b2-acff-41a5d5e5b994 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:57.488791 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e9769-9c74-43b7-aee0-1cbcfac3af0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:57.489907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e9769-9c74-43b7-aee0-1cbcfac3af0c admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:57.491609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e9769-9c74-43b7-aee0-1cbcfac3af0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:57.492117 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e9769-9c74-43b7-aee0-1cbcfac3af0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:57.493789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e9769-9c74-43b7-aee0-1cbcfac3af0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:57.497066 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e9769-9c74-43b7-aee0-1cbcfac3af0c admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:57.530108 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1213/2430] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:57.534556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dda170-1372-4bb3-b325-8ea1104fbd2c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:57.545924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dda170-1372-4bb3-b325-8ea1104fbd2c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:57.551390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765f279-1318-415d-b357-6d50319da926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:57.552415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765f279-1318-415d-b357-6d50319da926 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:57.552765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765f279-1318-415d-b357-6d50319da926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:57.553212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765f279-1318-415d-b357-6d50319da926 admin admin] PATH_INFO: `/v3/projects/c66c4c3a94f948a093679607d9e48e7c/users/220f366c00844a81a59ccda74f1fb968/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:57.583189 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765f279-1318-415d-b357-6d50319da926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66c4c3a94f948a093679607d9e48e7c, user_id=220f366c00844a81a59ccda74f1fb968, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:57.587212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765f279-1318-415d-b357-6d50319da926 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:57.624104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1218/2431] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:57 2022] PUT /identity/v3/projects/c66c4c3a94f948a093679607d9e48e7c/users/220f366c00844a81a59ccda74f1fb968/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:57.631251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e9769-9c74-43b7-aee0-1cbcfac3af0c admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:57.642714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e9769-9c74-43b7-aee0-1cbcfac3af0c admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:57.711949 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fcf9e-8faa-4954-898b-46ac41300733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:57.713412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fcf9e-8faa-4954-898b-46ac41300733 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:57.713412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fcf9e-8faa-4954-898b-46ac41300733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:57.713647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fcf9e-8faa-4954-898b-46ac41300733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:57.714759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fcf9e-8faa-4954-898b-46ac41300733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:57.716815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fcf9e-8faa-4954-898b-46ac41300733 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:57.731965 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1214/2432] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:26:57.733203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765f279-1318-415d-b357-6d50319da926 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:57.744463 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765f279-1318-415d-b357-6d50319da926 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:57.750880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe2e7a-6182-4430-a405-f2017573abf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:57.751997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe2e7a-6182-4430-a405-f2017573abf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:57.752431 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe2e7a-6182-4430-a405-f2017573abf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:57.752887 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe2e7a-6182-4430-a405-f2017573abf4 admin admin] PATH_INFO: `/v3/projects/c66c4c3a94f948a093679607d9e48e7c/users/220f366c00844a81a59ccda74f1fb968/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:57.755254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe2e7a-6182-4430-a405-f2017573abf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66c4c3a94f948a093679607d9e48e7c, user_id=220f366c00844a81a59ccda74f1fb968, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:57.758248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe2e7a-6182-4430-a405-f2017573abf4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:57.773852 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1219/2433] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:26:57 2022] PUT /identity/v3/projects/c66c4c3a94f948a093679607d9e48e7c/users/220f366c00844a81a59ccda74f1fb968/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:57.785030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39180fb-fb12-428c-b52a-10f9e3ccea48 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:57.785437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39180fb-fb12-428c-b52a-10f9e3ccea48 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:57.785790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39180fb-fb12-428c-b52a-10f9e3ccea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:57.817391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c39180fb-fb12-428c-b52a-10f9e3ccea48 None None] MFA Rules not processed for user `220f366c00844a81a59ccda74f1fb968`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:57.819014 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c39180fb-fb12-428c-b52a-10f9e3ccea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:57.919853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:57.966880 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1215/2434] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:57.978126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe2e7a-6182-4430-a405-f2017573abf4 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:57.981500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ddbe2e7a-6182-4430-a405-f2017573abf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:58.067256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe2e7a-6182-4430-a405-f2017573abf4 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:58.071888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4dff8-3f48-493b-944e-816896e04da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:58.072561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4dff8-3f48-493b-944e-816896e04da9 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:58.073132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4dff8-3f48-493b-944e-816896e04da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:58.073626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4dff8-3f48-493b-944e-816896e04da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:58.088279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4dff8-3f48-493b-944e-816896e04da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:58.090894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4dff8-3f48-493b-944e-816896e04da9 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:58.108831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1220/2435] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:58.327521 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39180fb-fb12-428c-b52a-10f9e3ccea48 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:58.430354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39180fb-fb12-428c-b52a-10f9e3ccea48 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:58.435839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:58.436745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:58.437032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:58.437972 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] PATH_INFO: `/v3/users/24fe648c8ade490abe8ec3f845de38ad` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:58.439731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24fe648c8ade490abe8ec3f845de38ad)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:58.442900 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:58.563340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24fe648c8ade490abe8ec3f845de38ad'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:58.565051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24fe648c8ade490abe8ec3f845de38ad'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:58.566399 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24fe648c8ade490abe8ec3f845de38ad'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:58.577858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24fe648c8ade490abe8ec3f845de38ad'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:58.591612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24fe648c8ade490abe8ec3f845de38ad'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:58.625808 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1216/2436] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:58 2022] DELETE /identity/v3/users/24fe648c8ade490abe8ec3f845de38ad => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:58.630141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e0f0-43be-4cce-adf5-35627ddb3ff0 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:58.630397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e0f0-43be-4cce-adf5-35627ddb3ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:58.630684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e0f0-43be-4cce-adf5-35627ddb3ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:58.654358 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-51e5e0f0-43be-4cce-adf5-35627ddb3ff0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:58.655717 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-51e5e0f0-43be-4cce-adf5-35627ddb3ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:58.707562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:58.814232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1221/2437] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:58.827038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:58.829005 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:58.877793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e0f0-43be-4cce-adf5-35627ddb3ff0 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:58.880187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-51e5e0f0-43be-4cce-adf5-35627ddb3ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:58.899321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e0f0-43be-4cce-adf5-35627ddb3ff0 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:58.915826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:58.917142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:58.918195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:58.921637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] PATH_INFO: `/v3/users/16293fa03ced44cc994a0b8ad19ebb89` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:58.923145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16293fa03ced44cc994a0b8ad19ebb89)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:58.925169 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:58.937249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8002a4-adf4-40e1-acd0-4547aa531636 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:58.941790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e116af-52c1-4e94-8676-bd976f00ce00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:58.943353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e116af-52c1-4e94-8676-bd976f00ce00 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:58.943933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e116af-52c1-4e94-8676-bd976f00ce00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:58.944360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e116af-52c1-4e94-8676-bd976f00ce00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:58.956650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e116af-52c1-4e94-8676-bd976f00ce00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:58.958474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e116af-52c1-4e94-8676-bd976f00ce00 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:58.970688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1217/2438] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:26:59.010683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16293fa03ced44cc994a0b8ad19ebb89'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.010683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16293fa03ced44cc994a0b8ad19ebb89'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.010683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16293fa03ced44cc994a0b8ad19ebb89'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.031748 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16293fa03ced44cc994a0b8ad19ebb89'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.041590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16293fa03ced44cc994a0b8ad19ebb89'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.069040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1222/2439] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:58 2022] DELETE /identity/v3/users/16293fa03ced44cc994a0b8ad19ebb89 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:26:59.320083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e116af-52c1-4e94-8676-bd976f00ce00 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:59.322016 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:59.324545 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:59.325512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:59.338386 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e116af-52c1-4e94-8676-bd976f00ce00 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:59.446139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d32f3-b38e-4561-b9a5-05f1bb84c862 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:59.452782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:59.453881 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:59.454257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:59.454629 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] PATH_INFO: `/v3/projects/8e5428bbc51f4ce8b0c4e746a131bc20` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:59.456065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5428bbc51f4ce8b0c4e746a131bc20)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:59.457751 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d65b6-ff4c-48e3-b21e-a5fa349eec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:59.458305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:59.458641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d65b6-ff4c-48e3-b21e-a5fa349eec22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:59.458923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d65b6-ff4c-48e3-b21e-a5fa349eec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:59.459202 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d65b6-ff4c-48e3-b21e-a5fa349eec22 admin admin] PATH_INFO: `/v3/projects/35c14f84eaf04060acc489e77027c824` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:59.463461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d65b6-ff4c-48e3-b21e-a5fa349eec22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c14f84eaf04060acc489e77027c824)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:59.465555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d65b6-ff4c-48e3-b21e-a5fa349eec22 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:59.511989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:59.521795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5428bbc51f4ce8b0c4e746a131bc20', 'request_id': 'req-366e2da0-4cd7-4710-91fd-dadd158d2517'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.541727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5428bbc51f4ce8b0c4e746a131bc20', 'request_id': 'req-366e2da0-4cd7-4710-91fd-dadd158d2517'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.553846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5428bbc51f4ce8b0c4e746a131bc20', 'request_id': 'req-366e2da0-4cd7-4710-91fd-dadd158d2517'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.574952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-707d65b6-ff4c-48e3-b21e-a5fa349eec22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c14f84eaf04060acc489e77027c824', 'request_id': 'req-707d65b6-ff4c-48e3-b21e-a5fa349eec22'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.587131 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] The token cache is being invalidate because project 8e5428bbc51f4ce8b0c4e746a131bc20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:59.588844 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-707d65b6-ff4c-48e3-b21e-a5fa349eec22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c14f84eaf04060acc489e77027c824', 'request_id': 'req-707d65b6-ff4c-48e3-b21e-a5fa349eec22'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.589002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.590390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.596316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1223/2440] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:59 2022] DELETE /identity/v3/projects/8e5428bbc51f4ce8b0c4e746a131bc20 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:59.600262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:59.603613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-707d65b6-ff4c-48e3-b21e-a5fa349eec22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c14f84eaf04060acc489e77027c824', 'request_id': 'req-707d65b6-ff4c-48e3-b21e-a5fa349eec22'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.614456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:59.623757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-707d65b6-ff4c-48e3-b21e-a5fa349eec22 admin admin] The token cache is being invalidate because project 35c14f84eaf04060acc489e77027c824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:26:59.624347 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-707d65b6-ff4c-48e3-b21e-a5fa349eec22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.625163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-707d65b6-ff4c-48e3-b21e-a5fa349eec22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.631467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1218/2441] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:26:59 2022] DELETE /identity/v3/projects/35c14f84eaf04060acc489e77027c824 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:59.637156 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7e88a-a202-494d-94be-be15f947f72a None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:59.637156 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7e88a-a202-494d-94be-be15f947f72a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:59.638053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7e88a-a202-494d-94be-be15f947f72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:59.665527 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e5b7e88a-a202-494d-94be-be15f947f72a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:59.667557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e5b7e88a-a202-494d-94be-be15f947f72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:59.706863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2da0-4cd7-4710-91fd-dadd158d2517 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:59.738130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1219/2442] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:59.747245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd6bb6-951d-4303-b320-7db76e562820 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:59.747692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd6bb6-951d-4303-b320-7db76e562820 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:59.748033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd6bb6-951d-4303-b320-7db76e562820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:59.768603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-9efd6bb6-951d-4303-b320-7db76e562820 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:26:59.770086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9efd6bb6-951d-4303-b320-7db76e562820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:59.770992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:59.771882 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:59.772170 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:59.772445 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] PATH_INFO: `/v3/users/220f366c00844a81a59ccda74f1fb968` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:59.773664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=220f366c00844a81a59ccda74f1fb968)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:59.775586 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:59.778680 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1220/2443] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:26:59.782713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd6bb6-951d-4303-b320-7db76e562820 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:59.792353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd6bb6-951d-4303-b320-7db76e562820 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:59.797274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd8bef-130b-4e15-aaac-9e083caaa3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:59.798018 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd8bef-130b-4e15-aaac-9e083caaa3cc admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:59.798367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd8bef-130b-4e15-aaac-9e083caaa3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:59.798721 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd8bef-130b-4e15-aaac-9e083caaa3cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:59.799519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd8bef-130b-4e15-aaac-9e083caaa3cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:26:59.799888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd8bef-130b-4e15-aaac-9e083caaa3cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:59.801881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd8bef-130b-4e15-aaac-9e083caaa3cc admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:59.818641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1221/2444] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:26:59.820203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd8bef-130b-4e15-aaac-9e083caaa3cc admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:59.826582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '220f366c00844a81a59ccda74f1fb968'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.827810 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '220f366c00844a81a59ccda74f1fb968'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.828426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '220f366c00844a81a59ccda74f1fb968'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.831786 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd8bef-130b-4e15-aaac-9e083caaa3cc admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:26:59.837193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cfc43-ca87-4106-b7af-b9d0d24cc6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:26:59.837939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cfc43-ca87-4106-b7af-b9d0d24cc6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:26:59.838227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cfc43-ca87-4106-b7af-b9d0d24cc6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:26:59.838589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '220f366c00844a81a59ccda74f1fb968'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.838711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cfc43-ca87-4106-b7af-b9d0d24cc6f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:26:59.839288 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cfc43-ca87-4106-b7af-b9d0d24cc6f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:26:59.841403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cfc43-ca87-4106-b7af-b9d0d24cc6f4 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:26:59.849023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '220f366c00844a81a59ccda74f1fb968'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:26:59.859595 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:59.864784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:59.875619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1222/2445] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:26:59 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:26:59.879508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cfc43-ca87-4106-b7af-b9d0d24cc6f4 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:26:59.881295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1224/2446] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:26:59 2022] DELETE /identity/v3/users/220f366c00844a81a59ccda74f1fb968 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:26:59.881437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-492cfc43-ca87-4106-b7af-b9d0d24cc6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:26:59.970867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cfc43-ca87-4106-b7af-b9d0d24cc6f4 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:00.033118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cb9da-807f-473b-a5f1-247044c7979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:00.033950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cb9da-807f-473b-a5f1-247044c7979d admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.034289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cb9da-807f-473b-a5f1-247044c7979d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.034657 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cb9da-807f-473b-a5f1-247044c7979d admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.035419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cb9da-807f-473b-a5f1-247044c7979d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:00.037503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cb9da-807f-473b-a5f1-247044c7979d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:00.066800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1223/2447] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:26:59 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:00.070622 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:00.081212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fa518-3685-423a-8c5b-7839a709d722 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:00.086535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3fb8f-b484-45d7-95a3-eb403b2c2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:00.087322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3fb8f-b484-45d7-95a3-eb403b2c2dad admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.087607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3fb8f-b484-45d7-95a3-eb403b2c2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.087883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3fb8f-b484-45d7-95a3-eb403b2c2dad admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.088611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3fb8f-b484-45d7-95a3-eb403b2c2dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:00.090312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3fb8f-b484-45d7-95a3-eb403b2c2dad admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:00.101891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1225/2448] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:00.106441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cb9da-807f-473b-a5f1-247044c7979d admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:00.116956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cb9da-807f-473b-a5f1-247044c7979d admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:00.122524 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1f8bf-d2c8-44cb-9734-7f3d31699bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:00.123206 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1f8bf-d2c8-44cb-9734-7f3d31699bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.123488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1f8bf-d2c8-44cb-9734-7f3d31699bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.123771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1f8bf-d2c8-44cb-9734-7f3d31699bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.124501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1f8bf-d2c8-44cb-9734-7f3d31699bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:00.126164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1f8bf-d2c8-44cb-9734-7f3d31699bbe admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:00.139479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1224/2449] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:27:00.143599 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3fb8f-b484-45d7-95a3-eb403b2c2dad admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:00.153908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3fb8f-b484-45d7-95a3-eb403b2c2dad admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:00.158868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0b530-6980-4d0f-9a19-504c671052fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:00.159769 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0b530-6980-4d0f-9a19-504c671052fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.160054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0b530-6980-4d0f-9a19-504c671052fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.160330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0b530-6980-4d0f-9a19-504c671052fd admin admin] PATH_INFO: `/v3/projects/e1db85029a5c4585a3dd489d5302ccea/users/e49432b51d0e4a18b872e9a05c7708c6/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.177123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0b530-6980-4d0f-9a19-504c671052fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1db85029a5c4585a3dd489d5302ccea, user_id=e49432b51d0e4a18b872e9a05c7708c6, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:00.179985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0b530-6980-4d0f-9a19-504c671052fd admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:00.192758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1f8bf-d2c8-44cb-9734-7f3d31699bbe admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:00.194699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7bf1f8bf-d2c8-44cb-9734-7f3d31699bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:00.203875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1226/2450] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:00 2022] PUT /identity/v3/projects/e1db85029a5c4585a3dd489d5302ccea/users/e49432b51d0e4a18b872e9a05c7708c6/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:00.206357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb80163-a9a6-4fe1-886c-6e16c0ee3106 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.206673 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb80163-a9a6-4fe1-886c-6e16c0ee3106 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.206949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb80163-a9a6-4fe1-886c-6e16c0ee3106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.216408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1f8bf-d2c8-44cb-9734-7f3d31699bbe admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:00.237515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-feb80163-a9a6-4fe1-886c-6e16c0ee3106 None None] MFA Rules not processed for user `e49432b51d0e4a18b872e9a05c7708c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:00.239014 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-feb80163-a9a6-4fe1-886c-6e16c0ee3106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:00.278677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfc16e-1fd7-4655-8863-588abf176443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:00.279559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfc16e-1fd7-4655-8863-588abf176443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.279870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfc16e-1fd7-4655-8863-588abf176443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.280354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfc16e-1fd7-4655-8863-588abf176443 admin admin] PATH_INFO: `/v3/projects/c66c4c3a94f948a093679607d9e48e7c` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.281510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfc16e-1fd7-4655-8863-588abf176443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66c4c3a94f948a093679607d9e48e7c)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:00.283445 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfc16e-1fd7-4655-8863-588abf176443 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:00.305296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1227/2451] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:00.305981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:00.318546 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb80163-a9a6-4fe1-886c-6e16c0ee3106 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:00.319952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-feb80163-a9a6-4fe1-886c-6e16c0ee3106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:00.339167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-cfcfc16e-1fd7-4655-8863-588abf176443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66c4c3a94f948a093679607d9e48e7c', 'request_id': 'req-cfcfc16e-1fd7-4655-8863-588abf176443'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:00.345776 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-cfcfc16e-1fd7-4655-8863-588abf176443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66c4c3a94f948a093679607d9e48e7c', 'request_id': 'req-cfcfc16e-1fd7-4655-8863-588abf176443'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:00.354208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-cfcfc16e-1fd7-4655-8863-588abf176443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66c4c3a94f948a093679607d9e48e7c', 'request_id': 'req-cfcfc16e-1fd7-4655-8863-588abf176443'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:00.366450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-cfcfc16e-1fd7-4655-8863-588abf176443 admin admin] The token cache is being invalidate because project c66c4c3a94f948a093679607d9e48e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:00.366732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-cfcfc16e-1fd7-4655-8863-588abf176443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:00.367405 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-cfcfc16e-1fd7-4655-8863-588abf176443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:00.368964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1225/2452] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:00 2022] DELETE /identity/v3/projects/c66c4c3a94f948a093679607d9e48e7c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:00.373970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc5a95-92f5-4f0b-9dd2-682066745a4b None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.374253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc5a95-92f5-4f0b-9dd2-682066745a4b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.374531 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc5a95-92f5-4f0b-9dd2-682066745a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.380846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb80163-a9a6-4fe1-886c-6e16c0ee3106 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:00.397851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-88dc5a95-92f5-4f0b-9dd2-682066745a4b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:00.399481 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-88dc5a95-92f5-4f0b-9dd2-682066745a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:00.429731 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51151070-bd4d-4b2c-a09c-b31ff53991e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:00.430301 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51151070-bd4d-4b2c-a09c-b31ff53991e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.430580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51151070-bd4d-4b2c-a09c-b31ff53991e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.430853 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51151070-bd4d-4b2c-a09c-b31ff53991e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.433234 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-51151070-bd4d-4b2c-a09c-b31ff53991e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:00.451076 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:00.462789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1226/2453] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:00.470780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47940da-97a9-436b-a423-8d6904b5f0f0 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.471070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47940da-97a9-436b-a423-8d6904b5f0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.471353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47940da-97a9-436b-a423-8d6904b5f0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.488982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c47940da-97a9-436b-a423-8d6904b5f0f0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:00.490228 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c47940da-97a9-436b-a423-8d6904b5f0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:00.496309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51151070-bd4d-4b2c-a09c-b31ff53991e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:00.497784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51151070-bd4d-4b2c-a09c-b31ff53991e6 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:00.498382 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1227/2454] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:00.502340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47940da-97a9-436b-a423-8d6904b5f0f0 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:00.507976 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1228/2455] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:27:00.511411 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47940da-97a9-436b-a423-8d6904b5f0f0 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:00.516191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cba77c-07d0-48a7-a6fd-4ebeb0abe093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:00.516839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cba77c-07d0-48a7-a6fd-4ebeb0abe093 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.517127 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cba77c-07d0-48a7-a6fd-4ebeb0abe093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.517435 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cba77c-07d0-48a7-a6fd-4ebeb0abe093 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.518256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cba77c-07d0-48a7-a6fd-4ebeb0abe093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:00.518563 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cba77c-07d0-48a7-a6fd-4ebeb0abe093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:00.520148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cba77c-07d0-48a7-a6fd-4ebeb0abe093 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:00.532115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1228/2456] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:27:00.536338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51151070-bd4d-4b2c-a09c-b31ff53991e6 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:00.548243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51151070-bd4d-4b2c-a09c-b31ff53991e6 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:00.555029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410ddb-3a49-44dd-829b-b9f0406cffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:00.555694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410ddb-3a49-44dd-829b-b9f0406cffcd admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.555973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410ddb-3a49-44dd-829b-b9f0406cffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.556240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410ddb-3a49-44dd-829b-b9f0406cffcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.556923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69410ddb-3a49-44dd-829b-b9f0406cffcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:00.560168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69410ddb-3a49-44dd-829b-b9f0406cffcd admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:00.586582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1229/2457] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:00 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:00.591008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cba77c-07d0-48a7-a6fd-4ebeb0abe093 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:00.601152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cba77c-07d0-48a7-a6fd-4ebeb0abe093 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:00.672853 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367dbca-c617-4a2d-be5f-f20a33d51f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:00.673684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367dbca-c617-4a2d-be5f-f20a33d51f32 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.674043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367dbca-c617-4a2d-be5f-f20a33d51f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.674395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367dbca-c617-4a2d-be5f-f20a33d51f32 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.675252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367dbca-c617-4a2d-be5f-f20a33d51f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:00.677351 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367dbca-c617-4a2d-be5f-f20a33d51f32 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:00.708927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1229/2458] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:00 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:00.713089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410ddb-3a49-44dd-829b-b9f0406cffcd admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:00.725916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410ddb-3a49-44dd-829b-b9f0406cffcd admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:00.733664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc769472-d078-4b2c-937c-6e9921affa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:00.735713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc769472-d078-4b2c-937c-6e9921affa0c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.736064 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc769472-d078-4b2c-937c-6e9921affa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.736383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc769472-d078-4b2c-937c-6e9921affa0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.737794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc769472-d078-4b2c-937c-6e9921affa0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:00.739519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc769472-d078-4b2c-937c-6e9921affa0c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:00.760397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1230/2459] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:00.761924 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367dbca-c617-4a2d-be5f-f20a33d51f32 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:00.789811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367dbca-c617-4a2d-be5f-f20a33d51f32 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:00.802816 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed20d1-2552-468c-a422-be791d694e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:00.804107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed20d1-2552-468c-a422-be791d694e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.804107 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed20d1-2552-468c-a422-be791d694e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.804401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed20d1-2552-468c-a422-be791d694e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.806133 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed20d1-2552-468c-a422-be791d694e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:00.811565 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed20d1-2552-468c-a422-be791d694e21 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:00.829504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1230/2460] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:00.833402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc769472-d078-4b2c-937c-6e9921affa0c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:00.847740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc769472-d078-4b2c-937c-6e9921affa0c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:00.854222 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79d66-f519-4892-b62b-db0578f46352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:00.855851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79d66-f519-4892-b62b-db0578f46352 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.856436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79d66-f519-4892-b62b-db0578f46352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.856934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79d66-f519-4892-b62b-db0578f46352 admin admin] PATH_INFO: `/v3/projects/16092f6825864744a177c384642bec6c/users/18c0eb7ce51540cb99a20edd4cdf26a0/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.875633 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d79d66-f519-4892-b62b-db0578f46352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16092f6825864744a177c384642bec6c, user_id=18c0eb7ce51540cb99a20edd4cdf26a0, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:00.878953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d79d66-f519-4892-b62b-db0578f46352 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:00.901266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1231/2461] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:00 2022] PUT /identity/v3/projects/16092f6825864744a177c384642bec6c/users/18c0eb7ce51540cb99a20edd4cdf26a0/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:00.910491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683f334-00ea-4489-9375-5b40f0519b25 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:00.911422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683f334-00ea-4489-9375-5b40f0519b25 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:00.911788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683f334-00ea-4489-9375-5b40f0519b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:00.941147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:00.953860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-1683f334-00ea-4489-9375-5b40f0519b25 None None] MFA Rules not processed for user `18c0eb7ce51540cb99a20edd4cdf26a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:00.955991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1683f334-00ea-4489-9375-5b40f0519b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:01.021322 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1231/2462] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:01.035807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79d66-f519-4892-b62b-db0578f46352 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:01.038668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-36d79d66-f519-4892-b62b-db0578f46352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:01.108500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79d66-f519-4892-b62b-db0578f46352 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:01.112917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b14ff-7baa-438d-84ea-c00d7392e4db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:01.113576 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b14ff-7baa-438d-84ea-c00d7392e4db service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:01.113861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b14ff-7baa-438d-84ea-c00d7392e4db service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:01.114138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b14ff-7baa-438d-84ea-c00d7392e4db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:01.127868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b14ff-7baa-438d-84ea-c00d7392e4db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:01.129740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b14ff-7baa-438d-84ea-c00d7392e4db service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:01.141070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1232/2463] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:03.803473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683f334-00ea-4489-9375-5b40f0519b25 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:03.868476 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683f334-00ea-4489-9375-5b40f0519b25 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:03.874390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:03.875276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:03.875553 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:03.875821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] PATH_INFO: `/v3/users/18c0eb7ce51540cb99a20edd4cdf26a0` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:03.877011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c0eb7ce51540cb99a20edd4cdf26a0)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:03.878987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:03.928956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c0eb7ce51540cb99a20edd4cdf26a0'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:03.929619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c0eb7ce51540cb99a20edd4cdf26a0'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:03.930201 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c0eb7ce51540cb99a20edd4cdf26a0'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:03.937931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c0eb7ce51540cb99a20edd4cdf26a0'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:03.947882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c0eb7ce51540cb99a20edd4cdf26a0'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:03.968281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1232/2464] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:03 2022] DELETE /identity/v3/users/18c0eb7ce51540cb99a20edd4cdf26a0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:03.972880 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f397bd-4cce-4a9f-b05d-95f2f8d53b7e None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:03.973484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f397bd-4cce-4a9f-b05d-95f2f8d53b7e None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:03.973484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f397bd-4cce-4a9f-b05d-95f2f8d53b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:03.994353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-17f397bd-4cce-4a9f-b05d-95f2f8d53b7e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:03.997769 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-17f397bd-4cce-4a9f-b05d-95f2f8d53b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:04.080561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1233/2465] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:04.094182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:04.096177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:04.130441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:04.179189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179c118-5928-4004-9e1a-d52fcd0c6194 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:04.183680 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf425-e850-445e-8196-06e2f7043826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:04.184460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf425-e850-445e-8196-06e2f7043826 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:04.184747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf425-e850-445e-8196-06e2f7043826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:04.185027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf425-e850-445e-8196-06e2f7043826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:04.202467 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbf425-e850-445e-8196-06e2f7043826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:04.204221 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbf425-e850-445e-8196-06e2f7043826 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:04.215694 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1233/2466] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:04.498248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f397bd-4cce-4a9f-b05d-95f2f8d53b7e None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:04.500189 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-17f397bd-4cce-4a9f-b05d-95f2f8d53b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:04.510448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:04.514972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f397bd-4cce-4a9f-b05d-95f2f8d53b7e None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:04.522167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae078414-506b-4e5a-9543-de9cc4693d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:04.523150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae078414-506b-4e5a-9543-de9cc4693d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:04.523445 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae078414-506b-4e5a-9543-de9cc4693d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:04.523736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae078414-506b-4e5a-9543-de9cc4693d70 admin admin] PATH_INFO: `/v3/projects/16092f6825864744a177c384642bec6c` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:04.525109 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae078414-506b-4e5a-9543-de9cc4693d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16092f6825864744a177c384642bec6c)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:04.527132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae078414-506b-4e5a-9543-de9cc4693d70 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:04.579155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ae078414-506b-4e5a-9543-de9cc4693d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16092f6825864744a177c384642bec6c', 'request_id': 'req-ae078414-506b-4e5a-9543-de9cc4693d70'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:04.588293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ae078414-506b-4e5a-9543-de9cc4693d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16092f6825864744a177c384642bec6c', 'request_id': 'req-ae078414-506b-4e5a-9543-de9cc4693d70'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:04.594535 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ae078414-506b-4e5a-9543-de9cc4693d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16092f6825864744a177c384642bec6c', 'request_id': 'req-ae078414-506b-4e5a-9543-de9cc4693d70'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:04.606155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ae078414-506b-4e5a-9543-de9cc4693d70 admin admin] The token cache is being invalidate because project 16092f6825864744a177c384642bec6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:04.606441 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ae078414-506b-4e5a-9543-de9cc4693d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:04.607113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-ae078414-506b-4e5a-9543-de9cc4693d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:04.608653 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1234/2467] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:04 2022] DELETE /identity/v3/projects/16092f6825864744a177c384642bec6c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:04.613592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962347b-4fd3-42bc-846d-dc6c728d835d None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:04.613886 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962347b-4fd3-42bc-846d-dc6c728d835d None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:04.614170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962347b-4fd3-42bc-846d-dc6c728d835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:04.634093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-0962347b-4fd3-42bc-846d-dc6c728d835d None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:04.635339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0962347b-4fd3-42bc-846d-dc6c728d835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:04.718650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1234/2468] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:04.726270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b036eb-41c0-4fe9-b70f-f8bcca8bd3ff None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:04.726625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b036eb-41c0-4fe9-b70f-f8bcca8bd3ff None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:04.726969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b036eb-41c0-4fe9-b70f-f8bcca8bd3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:04.749476 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-85b036eb-41c0-4fe9-b70f-f8bcca8bd3ff None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:04.750967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-85b036eb-41c0-4fe9-b70f-f8bcca8bd3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:04.762306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1235/2469] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:04.766675 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962347b-4fd3-42bc-846d-dc6c728d835d None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:04.784025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962347b-4fd3-42bc-846d-dc6c728d835d None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:04.791281 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d808b-8c5e-4276-ae9e-71bd0ae638ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:04.792496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d808b-8c5e-4276-ae9e-71bd0ae638ad admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:04.793164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d808b-8c5e-4276-ae9e-71bd0ae638ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:04.793657 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d808b-8c5e-4276-ae9e-71bd0ae638ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:04.794914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d808b-8c5e-4276-ae9e-71bd0ae638ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:04.795747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d808b-8c5e-4276-ae9e-71bd0ae638ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:04.803735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d808b-8c5e-4276-ae9e-71bd0ae638ad admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:04.821435 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1235/2470] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:27:04.822653 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b036eb-41c0-4fe9-b70f-f8bcca8bd3ff None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:04.832824 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b036eb-41c0-4fe9-b70f-f8bcca8bd3ff None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:04.837782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6159610-67c6-47fe-ad7e-818df4b20c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:04.838517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159610-67c6-47fe-ad7e-818df4b20c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:04.839496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159610-67c6-47fe-ad7e-818df4b20c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:04.839839 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159610-67c6-47fe-ad7e-818df4b20c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:04.840605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6159610-67c6-47fe-ad7e-818df4b20c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:04.842909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6159610-67c6-47fe-ad7e-818df4b20c4a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:04.878319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1236/2471] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:04 2022] POST /identity/v3/projects => generated 397 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:04.879608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d808b-8c5e-4276-ae9e-71bd0ae638ad admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:04.890843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d808b-8c5e-4276-ae9e-71bd0ae638ad admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:04.961717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f785b7a-04ec-476c-af97-6feaaed2e0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:04.962672 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f785b7a-04ec-476c-af97-6feaaed2e0fa admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:04.962960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f785b7a-04ec-476c-af97-6feaaed2e0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:04.963370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f785b7a-04ec-476c-af97-6feaaed2e0fa admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:04.964461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f785b7a-04ec-476c-af97-6feaaed2e0fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:04.966195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f785b7a-04ec-476c-af97-6feaaed2e0fa admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:04.989472 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1236/2472] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:04 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:04.993573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6159610-67c6-47fe-ad7e-818df4b20c4a admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:05.004860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6159610-67c6-47fe-ad7e-818df4b20c4a admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:05.010723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec7a3f-0b75-427a-acd0-bdca8d955cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:05.011421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec7a3f-0b75-427a-acd0-bdca8d955cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:05.011701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec7a3f-0b75-427a-acd0-bdca8d955cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:05.011971 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec7a3f-0b75-427a-acd0-bdca8d955cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:05.012899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec7a3f-0b75-427a-acd0-bdca8d955cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:05.014581 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec7a3f-0b75-427a-acd0-bdca8d955cf1 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:05.027062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1237/2473] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:05.031440 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f785b7a-04ec-476c-af97-6feaaed2e0fa admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:05.042693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f785b7a-04ec-476c-af97-6feaaed2e0fa admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:05.048269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e47ac3-1777-45e5-a924-7cc80f4b769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:05.048973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e47ac3-1777-45e5-a924-7cc80f4b769e admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:05.049290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e47ac3-1777-45e5-a924-7cc80f4b769e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:05.049989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e47ac3-1777-45e5-a924-7cc80f4b769e admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:05.050322 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e47ac3-1777-45e5-a924-7cc80f4b769e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:05.051960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e47ac3-1777-45e5-a924-7cc80f4b769e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:05.064428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1237/2474] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:05.068507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec7a3f-0b75-427a-acd0-bdca8d955cf1 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:05.079991 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec7a3f-0b75-427a-acd0-bdca8d955cf1 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:05.084992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4246287-b8db-4d90-9f80-3a3abaf175a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:05.086069 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4246287-b8db-4d90-9f80-3a3abaf175a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:05.086473 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4246287-b8db-4d90-9f80-3a3abaf175a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:05.086843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4246287-b8db-4d90-9f80-3a3abaf175a1 admin admin] PATH_INFO: `/v3/projects/935609f47f354b80a0b4fc51e427ee99/users/ff64aa8d41d544799fef9962022cdd92/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:05.103039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4246287-b8db-4d90-9f80-3a3abaf175a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935609f47f354b80a0b4fc51e427ee99, user_id=ff64aa8d41d544799fef9962022cdd92, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:05.106079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4246287-b8db-4d90-9f80-3a3abaf175a1 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:05.126974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1238/2475] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:05 2022] PUT /identity/v3/projects/935609f47f354b80a0b4fc51e427ee99/users/ff64aa8d41d544799fef9962022cdd92/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:05.137976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac426a-d1c1-43a7-b22c-e710bceab927 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:05.138832 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac426a-d1c1-43a7-b22c-e710bceab927 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:05.139186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac426a-d1c1-43a7-b22c-e710bceab927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:05.175267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-8eac426a-d1c1-43a7-b22c-e710bceab927 None None] MFA Rules not processed for user `ff64aa8d41d544799fef9962022cdd92`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:05.176802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8eac426a-d1c1-43a7-b22c-e710bceab927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:05.191494 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:05.264401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1238/2476] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:05.282003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4246287-b8db-4d90-9f80-3a3abaf175a1 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:05.283938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c4246287-b8db-4d90-9f80-3a3abaf175a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:05.360808 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4246287-b8db-4d90-9f80-3a3abaf175a1 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:05.365375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966e45-7919-4a21-b99c-4fb737f17045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:05.367125 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966e45-7919-4a21-b99c-4fb737f17045 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:05.367412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966e45-7919-4a21-b99c-4fb737f17045 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:05.367716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966e45-7919-4a21-b99c-4fb737f17045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:05.377940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5966e45-7919-4a21-b99c-4fb737f17045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:05.379493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5966e45-7919-4a21-b99c-4fb737f17045 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:05.391089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1239/2477] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:05.437447 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e68f0-2ba1-419a-ac17-f6c0231ddc95 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:05.437933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e68f0-2ba1-419a-ac17-f6c0231ddc95 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:05.438212 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e68f0-2ba1-419a-ac17-f6c0231ddc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:05.463566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-342e68f0-2ba1-419a-ac17-f6c0231ddc95 None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:05.464850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-342e68f0-2ba1-419a-ac17-f6c0231ddc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:05.548009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1239/2478] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:27:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:05.561464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966e45-7919-4a21-b99c-4fb737f17045 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:05.563123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f5966e45-7919-4a21-b99c-4fb737f17045 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:05.604992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:05.653985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966e45-7919-4a21-b99c-4fb737f17045 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:05.661898 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338ee3e-b22c-4811-86bf-cb969e5f5421 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:05.662564 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338ee3e-b22c-4811-86bf-cb969e5f5421 service swift] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:05.662854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338ee3e-b22c-4811-86bf-cb969e5f5421 service swift] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:05.663119 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338ee3e-b22c-4811-86bf-cb969e5f5421 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:05.672289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338ee3e-b22c-4811-86bf-cb969e5f5421 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:05.673917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338ee3e-b22c-4811-86bf-cb969e5f5421 service swift] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:05.685636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1240/2479] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:27:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:27:06.666038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e68f0-2ba1-419a-ac17-f6c0231ddc95 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:06.667653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-342e68f0-2ba1-419a-ac17-f6c0231ddc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:06.736060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e68f0-2ba1-419a-ac17-f6c0231ddc95 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:06.740255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950daf9-e042-4bde-a911-a09af4e7f77c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:06.740913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950daf9-e042-4bde-a911-a09af4e7f77c service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:06.741197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950daf9-e042-4bde-a911-a09af4e7f77c service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:06.741672 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950daf9-e042-4bde-a911-a09af4e7f77c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:06.743498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b950daf9-e042-4bde-a911-a09af4e7f77c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:06.814799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950daf9-e042-4bde-a911-a09af4e7f77c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:06.816280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950daf9-e042-4bde-a911-a09af4e7f77c service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:06.827095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1240/2480] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:11.097916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338ee3e-b22c-4811-86bf-cb969e5f5421 service swift] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:11.101764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a338ee3e-b22c-4811-86bf-cb969e5f5421 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:11.137559 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338ee3e-b22c-4811-86bf-cb969e5f5421 service swift] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:11.142976 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:11.144179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:11.144616 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:11.145920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] PATH_INFO: `/v3/users/58366850e234491cafe268bb56e9e3a1` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:11.147456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58366850e234491cafe268bb56e9e3a1)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:11.150731 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:11.231066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58366850e234491cafe268bb56e9e3a1'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.231806 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58366850e234491cafe268bb56e9e3a1'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.232987 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58366850e234491cafe268bb56e9e3a1'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.242032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58366850e234491cafe268bb56e9e3a1'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.254445 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58366850e234491cafe268bb56e9e3a1'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.278684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1241/2481] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:11 2022] DELETE /identity/v3/users/58366850e234491cafe268bb56e9e3a1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:11.489981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950daf9-e042-4bde-a911-a09af4e7f77c service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:11.502998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950daf9-e042-4bde-a911-a09af4e7f77c service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:11.514519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:11.591352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:11.591728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:11.592414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:11.592768 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:11.593535 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9 admin admin] PATH_INFO: `/v3/projects/883f7310b404427fa3ddda37a8d04acc` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:11.595629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=883f7310b404427fa3ddda37a8d04acc)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:11.595756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:11.597762 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:11.617780 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df07cb-ec14-4ce6-9c0c-eb5a2c58dcf9 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:11.625636 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333caecc-13c3-4483-9194-bb8560f1da33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:11.626890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333caecc-13c3-4483-9194-bb8560f1da33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:11.627483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333caecc-13c3-4483-9194-bb8560f1da33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:11.627775 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333caecc-13c3-4483-9194-bb8560f1da33 admin admin] PATH_INFO: `/v3/users/e49432b51d0e4a18b872e9a05c7708c6` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:11.629984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333caecc-13c3-4483-9194-bb8560f1da33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49432b51d0e4a18b872e9a05c7708c6)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:11.632502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333caecc-13c3-4483-9194-bb8560f1da33 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:11.668573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883f7310b404427fa3ddda37a8d04acc', 'request_id': 'req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.677253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883f7310b404427fa3ddda37a8d04acc', 'request_id': 'req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.691928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883f7310b404427fa3ddda37a8d04acc', 'request_id': 'req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.707243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-333caecc-13c3-4483-9194-bb8560f1da33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49432b51d0e4a18b872e9a05c7708c6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.707903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-333caecc-13c3-4483-9194-bb8560f1da33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49432b51d0e4a18b872e9a05c7708c6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.708155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9 admin admin] The token cache is being invalidate because project 883f7310b404427fa3ddda37a8d04acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:11.708510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.709201 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e4eccf3f-20f5-40bc-81e6-9d430a3f4df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.711237 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1241/2482] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:11 2022] DELETE /identity/v3/projects/883f7310b404427fa3ddda37a8d04acc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:11.713317 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-333caecc-13c3-4483-9194-bb8560f1da33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49432b51d0e4a18b872e9a05c7708c6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.716706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ccd48-be05-46cd-8422-b41ead330d24 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:11.718256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ccd48-be05-46cd-8422-b41ead330d24 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:11.718615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ccd48-be05-46cd-8422-b41ead330d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:11.726718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-333caecc-13c3-4483-9194-bb8560f1da33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49432b51d0e4a18b872e9a05c7708c6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.737249 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-333caecc-13c3-4483-9194-bb8560f1da33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49432b51d0e4a18b872e9a05c7708c6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:11.741543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-cb3ccd48-be05-46cd-8422-b41ead330d24 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:11.743013 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-cb3ccd48-be05-46cd-8422-b41ead330d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:11.754745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:11.762049 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1242/2483] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:11 2022] DELETE /identity/v3/users/e49432b51d0e4a18b872e9a05c7708c6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:11.769683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5da46-1613-41a4-aa1b-154438fc22cb None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:11.770242 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5da46-1613-41a4-aa1b-154438fc22cb None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:11.770730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5da46-1613-41a4-aa1b-154438fc22cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:11.801039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-58d5da46-1613-41a4-aa1b-154438fc22cb None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:11.802677 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-58d5da46-1613-41a4-aa1b-154438fc22cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:11.894584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1242/2484] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:11.897997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f24ea-c190-4491-892a-1945c5ce912c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:11.898475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f24ea-c190-4491-892a-1945c5ce912c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:11.898763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f24ea-c190-4491-892a-1945c5ce912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:11.915697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1243/2485] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:11.930216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5da46-1613-41a4-aa1b-154438fc22cb None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:11.931639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-58d5da46-1613-41a4-aa1b-154438fc22cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:11.946128 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-717f24ea-c190-4491-892a-1945c5ce912c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:11.947379 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-717f24ea-c190-4491-892a-1945c5ce912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:11.962269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1243/2486] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:11.962269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f24ea-c190-4491-892a-1945c5ce912c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:11.970756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f24ea-c190-4491-892a-1945c5ce912c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:11.976001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dea7b-8b6f-4ae0-b757-6fafcc4bf030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:11.976619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dea7b-8b6f-4ae0-b757-6fafcc4bf030 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:11.977003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dea7b-8b6f-4ae0-b757-6fafcc4bf030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:11.977412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dea7b-8b6f-4ae0-b757-6fafcc4bf030 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:11.978264 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dea7b-8b6f-4ae0-b757-6fafcc4bf030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:11.978659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dea7b-8b6f-4ae0-b757-6fafcc4bf030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:11.980564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dea7b-8b6f-4ae0-b757-6fafcc4bf030 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:11.995306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1244/2487] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:27:11.999967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dea7b-8b6f-4ae0-b757-6fafcc4bf030 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:12.014002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5da46-1613-41a4-aa1b-154438fc22cb None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:12.014809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dea7b-8b6f-4ae0-b757-6fafcc4bf030 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:12.017790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b718d-0685-41d4-8228-6a4b710df3fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:12.018449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b718d-0685-41d4-8228-6a4b710df3fc service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:12.018768 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b718d-0685-41d4-8228-6a4b710df3fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:12.019045 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b718d-0685-41d4-8228-6a4b710df3fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:12.019539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42471c1-750a-4edc-a7c6-c7bcdecca16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:12.020435 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42471c1-750a-4edc-a7c6-c7bcdecca16f admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:12.020882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42471c1-750a-4edc-a7c6-c7bcdecca16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:12.021113 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42471c1-750a-4edc-a7c6-c7bcdecca16f admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:12.021981 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42471c1-750a-4edc-a7c6-c7bcdecca16f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:12.024136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42471c1-750a-4edc-a7c6-c7bcdecca16f admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:12.034081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b718d-0685-41d4-8228-6a4b710df3fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:12.047770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b718d-0685-41d4-8228-6a4b710df3fc service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:12.048591 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:12.059963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1245/2488] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:11 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:12.063827 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42471c1-750a-4edc-a7c6-c7bcdecca16f admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:12.073597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1244/2489] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:27:12.173924 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42471c1-750a-4edc-a7c6-c7bcdecca16f admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:12.194817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9398d-c98e-41d4-bff8-a68d3525fc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:12.195534 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9398d-c98e-41d4-bff8-a68d3525fc34 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:12.195820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9398d-c98e-41d4-bff8-a68d3525fc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:12.196097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9398d-c98e-41d4-bff8-a68d3525fc34 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:12.196799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9398d-c98e-41d4-bff8-a68d3525fc34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:12.202164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9398d-c98e-41d4-bff8-a68d3525fc34 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:12.250233 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1246/2490] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:12 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:12.254805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b718d-0685-41d4-8228-6a4b710df3fc service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:12.273134 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b718d-0685-41d4-8228-6a4b710df3fc service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:12.279223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9ec02-049d-4068-919f-fbb0950d2959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:12.280756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9ec02-049d-4068-919f-fbb0950d2959 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:12.281330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9ec02-049d-4068-919f-fbb0950d2959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:12.281954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9ec02-049d-4068-919f-fbb0950d2959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:12.283013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9ec02-049d-4068-919f-fbb0950d2959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:12.285020 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9ec02-049d-4068-919f-fbb0950d2959 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:12.310734 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1245/2491] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:12.314834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9398d-c98e-41d4-bff8-a68d3525fc34 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:12.347246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9398d-c98e-41d4-bff8-a68d3525fc34 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:12.366258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14400767-c554-4aaa-adb7-285bd2faba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:12.366944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14400767-c554-4aaa-adb7-285bd2faba9b admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:12.367234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14400767-c554-4aaa-adb7-285bd2faba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:12.367515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14400767-c554-4aaa-adb7-285bd2faba9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:12.368263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14400767-c554-4aaa-adb7-285bd2faba9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:12.371307 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14400767-c554-4aaa-adb7-285bd2faba9b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:12.386636 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1247/2492] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:12.390641 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9ec02-049d-4068-919f-fbb0950d2959 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:12.402502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9ec02-049d-4068-919f-fbb0950d2959 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:12.408574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e2f94-0eb4-426b-be23-6b9b943e3838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:12.410554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e2f94-0eb4-426b-be23-6b9b943e3838 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:12.411612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e2f94-0eb4-426b-be23-6b9b943e3838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:12.412077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e2f94-0eb4-426b-be23-6b9b943e3838 admin admin] PATH_INFO: `/v3/projects/d0d2ac10b1894b5c8eb63b19db6130d7/users/f8b3f83c8c504de990ba9f5d900e52af/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:12.435485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e2f94-0eb4-426b-be23-6b9b943e3838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d2ac10b1894b5c8eb63b19db6130d7, user_id=f8b3f83c8c504de990ba9f5d900e52af, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:12.438770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e2f94-0eb4-426b-be23-6b9b943e3838 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:12.465351 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1246/2493] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:12 2022] PUT /identity/v3/projects/d0d2ac10b1894b5c8eb63b19db6130d7/users/f8b3f83c8c504de990ba9f5d900e52af/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:12.476440 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de259dc-1e02-4abf-a9ca-321be2766630 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:12.476730 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de259dc-1e02-4abf-a9ca-321be2766630 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:12.477016 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de259dc-1e02-4abf-a9ca-321be2766630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:12.536873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-0de259dc-1e02-4abf-a9ca-321be2766630 None None] MFA Rules not processed for user `f8b3f83c8c504de990ba9f5d900e52af`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:12.539403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0de259dc-1e02-4abf-a9ca-321be2766630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:12.570619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e2f94-0eb4-426b-be23-6b9b943e3838 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:12.580209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ab5e2f94-0eb4-426b-be23-6b9b943e3838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:12.673804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e2f94-0eb4-426b-be23-6b9b943e3838 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:12.687205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:12.688418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:12.688796 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:12.689571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96 admin admin] PATH_INFO: `/v3/projects/e1db85029a5c4585a3dd489d5302ccea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:12.691522 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1db85029a5c4585a3dd489d5302ccea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:12.694026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1248/2494] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:12.695246 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:12.706613 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de259dc-1e02-4abf-a9ca-321be2766630 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:12.709856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0de259dc-1e02-4abf-a9ca-321be2766630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:12.716684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:12.770409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1db85029a5c4585a3dd489d5302ccea', 'request_id': 'req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:12.781683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1db85029a5c4585a3dd489d5302ccea', 'request_id': 'req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:12.791563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1db85029a5c4585a3dd489d5302ccea', 'request_id': 'req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:12.812271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96 admin admin] The token cache is being invalidate because project e1db85029a5c4585a3dd489d5302ccea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:12.812970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:12.814617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-686ebbb1-4d0d-455f-a79d-bb7a8c0efe96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:12.817256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1247/2495] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:12 2022] DELETE /identity/v3/projects/e1db85029a5c4585a3dd489d5302ccea => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:12.823640 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b833b98-9dab-42d5-aba0-856aa2968f58 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:12.824172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b833b98-9dab-42d5-aba0-856aa2968f58 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:12.824612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b833b98-9dab-42d5-aba0-856aa2968f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:12.848084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de259dc-1e02-4abf-a9ca-321be2766630 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:12.853577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1b833b98-9dab-42d5-aba0-856aa2968f58 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:12.855180 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1b833b98-9dab-42d5-aba0-856aa2968f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:12.858446 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:12.944691 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1248/2496] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:12.953835 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab0ccb-3ab1-4739-839b-cee7e2f80e82 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:12.954169 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab0ccb-3ab1-4739-839b-cee7e2f80e82 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:12.954416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab0ccb-3ab1-4739-839b-cee7e2f80e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:12.958864 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5357d-49b5-4c94-a0ae-372912e86643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:12.959845 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5357d-49b5-4c94-a0ae-372912e86643 service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:12.960227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5357d-49b5-4c94-a0ae-372912e86643 service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:12.960608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5357d-49b5-4c94-a0ae-372912e86643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:12.962890 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-60e5357d-49b5-4c94-a0ae-372912e86643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:12.990608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-5fab0ccb-3ab1-4739-839b-cee7e2f80e82 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:12.993130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5fab0ccb-3ab1-4739-839b-cee7e2f80e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:13.012370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1249/2497] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:13.016604 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab0ccb-3ab1-4739-839b-cee7e2f80e82 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:13.034838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab0ccb-3ab1-4739-839b-cee7e2f80e82 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:13.043041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d2ded-e62c-43e7-a70d-1025380293b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:13.043743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d2ded-e62c-43e7-a70d-1025380293b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:13.044135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d2ded-e62c-43e7-a70d-1025380293b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:13.044573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d2ded-e62c-43e7-a70d-1025380293b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:13.045646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d2ded-e62c-43e7-a70d-1025380293b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:13.046093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d2ded-e62c-43e7-a70d-1025380293b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:13.048522 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d2ded-e62c-43e7-a70d-1025380293b4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:13.069289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1250/2498] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:27:13.070915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d2ded-e62c-43e7-a70d-1025380293b4 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:13.083175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d2ded-e62c-43e7-a70d-1025380293b4 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:13.089012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7379a1-6fb0-40b7-bb30-d203fbc56c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:13.089873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7379a1-6fb0-40b7-bb30-d203fbc56c9e admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:13.090270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7379a1-6fb0-40b7-bb30-d203fbc56c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:13.090664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7379a1-6fb0-40b7-bb30-d203fbc56c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:13.091315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5357d-49b5-4c94-a0ae-372912e86643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:13.091611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7379a1-6fb0-40b7-bb30-d203fbc56c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:13.093427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5357d-49b5-4c94-a0ae-372912e86643 service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:13.093985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7379a1-6fb0-40b7-bb30-d203fbc56c9e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:13.105854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1249/2499] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:27:13.135840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1251/2500] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:13 2022] POST /identity/v3/projects => generated 399 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:13.141345 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5357d-49b5-4c94-a0ae-372912e86643 service nova] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:13.169834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5357d-49b5-4c94-a0ae-372912e86643 service nova] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:13.259167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846d8bd-4989-4fa8-9bf9-62d89f58ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:13.259864 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846d8bd-4989-4fa8-9bf9-62d89f58ea0b admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:13.260153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846d8bd-4989-4fa8-9bf9-62d89f58ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:13.260432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846d8bd-4989-4fa8-9bf9-62d89f58ea0b admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:13.261363 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846d8bd-4989-4fa8-9bf9-62d89f58ea0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:13.264031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846d8bd-4989-4fa8-9bf9-62d89f58ea0b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:13.291060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1250/2501] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:13 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:13.297348 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7379a1-6fb0-40b7-bb30-d203fbc56c9e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:13.325990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7379a1-6fb0-40b7-bb30-d203fbc56c9e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:13.349584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fce6cd-4758-448a-a160-c2b321d7bd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:13.349584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fce6cd-4758-448a-a160-c2b321d7bd19 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:13.349584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fce6cd-4758-448a-a160-c2b321d7bd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:13.349584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fce6cd-4758-448a-a160-c2b321d7bd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:13.351962 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fce6cd-4758-448a-a160-c2b321d7bd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:13.355045 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fce6cd-4758-448a-a160-c2b321d7bd19 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:13.441286 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1252/2502] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:13.445096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846d8bd-4989-4fa8-9bf9-62d89f58ea0b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:13.486817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846d8bd-4989-4fa8-9bf9-62d89f58ea0b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:13.495943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f6fec-3191-4a6a-9f5e-6685f5668576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:13.496649 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f6fec-3191-4a6a-9f5e-6685f5668576 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:13.496935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f6fec-3191-4a6a-9f5e-6685f5668576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:13.497213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f6fec-3191-4a6a-9f5e-6685f5668576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:13.498039 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f6fec-3191-4a6a-9f5e-6685f5668576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:13.499867 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f6fec-3191-4a6a-9f5e-6685f5668576 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:13.517685 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1251/2503] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:13.519218 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fce6cd-4758-448a-a160-c2b321d7bd19 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:13.543643 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fce6cd-4758-448a-a160-c2b321d7bd19 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:13.549266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8a116-55fd-466d-b3dd-ca189a948477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:13.550143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8a116-55fd-466d-b3dd-ca189a948477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:13.550430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8a116-55fd-466d-b3dd-ca189a948477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:13.550701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8a116-55fd-466d-b3dd-ca189a948477 admin admin] PATH_INFO: `/v3/projects/9191f0bf4bbc4235aede5fcbb072428a/users/d97e64029503420dadf876eabdee78cc/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:13.586347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8a116-55fd-466d-b3dd-ca189a948477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9191f0bf4bbc4235aede5fcbb072428a, user_id=d97e64029503420dadf876eabdee78cc, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:13.589251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8a116-55fd-466d-b3dd-ca189a948477 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:13.633590 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1253/2504] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:13 2022] PUT /identity/v3/projects/9191f0bf4bbc4235aede5fcbb072428a/users/d97e64029503420dadf876eabdee78cc/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:13.644558 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f0790-b52e-496a-986d-4b8ff193070b None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:13.645883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f0790-b52e-496a-986d-4b8ff193070b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:13.645883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f0790-b52e-496a-986d-4b8ff193070b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:13.716909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-649f0790-b52e-496a-986d-4b8ff193070b None None] MFA Rules not processed for user `d97e64029503420dadf876eabdee78cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:13.721891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-649f0790-b52e-496a-986d-4b8ff193070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:13.746099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:13.843090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1252/2505] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:13.847326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8a116-55fd-466d-b3dd-ca189a948477 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:13.886375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:13.928627 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8a116-55fd-466d-b3dd-ca189a948477 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:13.934409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f35e19-e4d9-41f8-abb5-94b96a1d7e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:13.935162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f35e19-e4d9-41f8-abb5-94b96a1d7e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:13.935517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f35e19-e4d9-41f8-abb5-94b96a1d7e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:13.935859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f35e19-e4d9-41f8-abb5-94b96a1d7e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:13.936582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f35e19-e4d9-41f8-abb5-94b96a1d7e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:13.938560 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f35e19-e4d9-41f8-abb5-94b96a1d7e7c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:13.969203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1254/2506] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:13 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:13.974267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f0790-b52e-496a-986d-4b8ff193070b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:13.987883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f0790-b52e-496a-986d-4b8ff193070b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:14.050051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac347f0-dbbe-4442-a8c0-59e3d1596d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:14.050855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac347f0-dbbe-4442-a8c0-59e3d1596d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:14.051182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac347f0-dbbe-4442-a8c0-59e3d1596d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:14.051525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac347f0-dbbe-4442-a8c0-59e3d1596d48 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:14.052474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac347f0-dbbe-4442-a8c0-59e3d1596d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:14.054645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac347f0-dbbe-4442-a8c0-59e3d1596d48 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:14.077622 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1253/2507] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:13 2022] POST /identity/v3/users => generated 307 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:14.081905 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f35e19-e4d9-41f8-abb5-94b96a1d7e7c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:14.092885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f35e19-e4d9-41f8-abb5-94b96a1d7e7c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:14.097708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b67eef-4ced-4120-a3da-04bf119f5f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:14.098402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b67eef-4ced-4120-a3da-04bf119f5f7c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:14.098684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b67eef-4ced-4120-a3da-04bf119f5f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:14.098964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b67eef-4ced-4120-a3da-04bf119f5f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:14.099695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b67eef-4ced-4120-a3da-04bf119f5f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:14.101359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b67eef-4ced-4120-a3da-04bf119f5f7c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:14.116993 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1255/2508] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:14.119990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac347f0-dbbe-4442-a8c0-59e3d1596d48 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:14.135232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac347f0-dbbe-4442-a8c0-59e3d1596d48 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:14.142223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4963d-4880-4dc5-a5ea-fa1f2a8e3632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:14.143196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4963d-4880-4dc5-a5ea-fa1f2a8e3632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:14.143481 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4963d-4880-4dc5-a5ea-fa1f2a8e3632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:14.143765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4963d-4880-4dc5-a5ea-fa1f2a8e3632 admin admin] PATH_INFO: `/v3/projects/6b2522ef2b56485ba1af1595a9418642/users/9fe99335466e47e0be7b69a368f8e2bd/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:14.160895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4963d-4880-4dc5-a5ea-fa1f2a8e3632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2522ef2b56485ba1af1595a9418642, user_id=9fe99335466e47e0be7b69a368f8e2bd, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:14.163626 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4963d-4880-4dc5-a5ea-fa1f2a8e3632 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:14.177730 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b67eef-4ced-4120-a3da-04bf119f5f7c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:14.179447 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1254/2509] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:14 2022] PUT /identity/v3/projects/6b2522ef2b56485ba1af1595a9418642/users/9fe99335466e47e0be7b69a368f8e2bd/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:14.180195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-73b67eef-4ced-4120-a3da-04bf119f5f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:14.184059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4963d-4880-4dc5-a5ea-fa1f2a8e3632 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:14.195355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b67eef-4ced-4120-a3da-04bf119f5f7c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:14.256586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4963d-4880-4dc5-a5ea-fa1f2a8e3632 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:14.259772 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb048d9-32d4-449d-9c5b-6ca6c081e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:14.260712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb048d9-32d4-449d-9c5b-6ca6c081e7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:14.260988 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb048d9-32d4-449d-9c5b-6ca6c081e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:14.261312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb048d9-32d4-449d-9c5b-6ca6c081e7ff admin admin] PATH_INFO: `/v3/users/ff64aa8d41d544799fef9962022cdd92` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:14.261545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade09454-bc0d-489d-b9a3-65d1743c138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:14.262230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade09454-bc0d-489d-b9a3-65d1743c138d admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:14.262526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade09454-bc0d-489d-b9a3-65d1743c138d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:14.262724 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb048d9-32d4-449d-9c5b-6ca6c081e7ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff64aa8d41d544799fef9962022cdd92)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:14.262887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade09454-bc0d-489d-b9a3-65d1743c138d admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:14.263572 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade09454-bc0d-489d-b9a3-65d1743c138d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:14.264747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb048d9-32d4-449d-9c5b-6ca6c081e7ff admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:14.265212 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade09454-bc0d-489d-b9a3-65d1743c138d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:14.280591 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1255/2510] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:27:14.284834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade09454-bc0d-489d-b9a3-65d1743c138d admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:14.295784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade09454-bc0d-489d-b9a3-65d1743c138d admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:14.302162 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811ccfd-f11b-4a09-992e-12fbc2d61ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:14.303084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811ccfd-f11b-4a09-992e-12fbc2d61ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:14.303370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811ccfd-f11b-4a09-992e-12fbc2d61ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:14.303654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811ccfd-f11b-4a09-992e-12fbc2d61ee5 admin admin] PATH_INFO: `/v3/projects/6b2522ef2b56485ba1af1595a9418642/users/9fe99335466e47e0be7b69a368f8e2bd/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:14.306341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811ccfd-f11b-4a09-992e-12fbc2d61ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2522ef2b56485ba1af1595a9418642, user_id=9fe99335466e47e0be7b69a368f8e2bd, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:14.310213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811ccfd-f11b-4a09-992e-12fbc2d61ee5 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:14.317922 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:14.332889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1256/2511] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:14 2022] PUT /identity/v3/projects/6b2522ef2b56485ba1af1595a9418642/users/9fe99335466e47e0be7b69a368f8e2bd/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:14.333149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-aeb048d9-32d4-449d-9c5b-6ca6c081e7ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff64aa8d41d544799fef9962022cdd92'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:14.333149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-aeb048d9-32d4-449d-9c5b-6ca6c081e7ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff64aa8d41d544799fef9962022cdd92'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:14.333149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-aeb048d9-32d4-449d-9c5b-6ca6c081e7ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff64aa8d41d544799fef9962022cdd92'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:14.335491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd57e8d-24e9-41b5-a45b-e42555e5e264 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:14.336766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd57e8d-24e9-41b5-a45b-e42555e5e264 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:14.337137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-aeb048d9-32d4-449d-9c5b-6ca6c081e7ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff64aa8d41d544799fef9962022cdd92'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:14.337861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd57e8d-24e9-41b5-a45b-e42555e5e264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:14.348126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-aeb048d9-32d4-449d-9c5b-6ca6c081e7ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff64aa8d41d544799fef9962022cdd92'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:14.369731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-edd57e8d-24e9-41b5-a45b-e42555e5e264 None None] MFA Rules not processed for user `9fe99335466e47e0be7b69a368f8e2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:14.371088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1256/2512] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:14 2022] DELETE /identity/v3/users/ff64aa8d41d544799fef9962022cdd92 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:14.371464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-edd57e8d-24e9-41b5-a45b-e42555e5e264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:14.375987 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424712ae-fbbd-43f2-b89c-7f0a89bdf9c9 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:14.376283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424712ae-fbbd-43f2-b89c-7f0a89bdf9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:14.377385 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424712ae-fbbd-43f2-b89c-7f0a89bdf9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:14.396567 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-424712ae-fbbd-43f2-b89c-7f0a89bdf9c9 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:14.397817 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-424712ae-fbbd-43f2-b89c-7f0a89bdf9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:14.408438 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:14.446778 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1257/2513] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:14.458299 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd57e8d-24e9-41b5-a45b-e42555e5e264 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:14.459690 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-edd57e8d-24e9-41b5-a45b-e42555e5e264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:14.468002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1257/2514] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:14.475176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424712ae-fbbd-43f2-b89c-7f0a89bdf9c9 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:14.476709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-424712ae-fbbd-43f2-b89c-7f0a89bdf9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:14.524375 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd57e8d-24e9-41b5-a45b-e42555e5e264 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:14.528199 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344a8f3-15eb-4c21-ab37-02446733ee7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:14.528820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344a8f3-15eb-4c21-ab37-02446733ee7e service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:14.529052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344a8f3-15eb-4c21-ab37-02446733ee7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:14.529365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344a8f3-15eb-4c21-ab37-02446733ee7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:14.536303 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424712ae-fbbd-43f2-b89c-7f0a89bdf9c9 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:14.539369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344a8f3-15eb-4c21-ab37-02446733ee7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:14.540141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed92ca-9b8e-4dca-bc53-bb78c2d0eb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:14.540794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed92ca-9b8e-4dca-bc53-bb78c2d0eb9a service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:14.540955 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344a8f3-15eb-4c21-ab37-02446733ee7e service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:14.541059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed92ca-9b8e-4dca-bc53-bb78c2d0eb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:14.541372 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed92ca-9b8e-4dca-bc53-bb78c2d0eb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:14.550829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1258/2515] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:14 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:27:14.553000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed92ca-9b8e-4dca-bc53-bb78c2d0eb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:14.554498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed92ca-9b8e-4dca-bc53-bb78c2d0eb9a service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:14.565725 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1258/2516] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:27:14.624831 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344a8f3-15eb-4c21-ab37-02446733ee7e service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:14.635004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344a8f3-15eb-4c21-ab37-02446733ee7e service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:14.639585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db809a8a-be96-4860-a77b-f5f5ff51afc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:14.640364 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db809a8a-be96-4860-a77b-f5f5ff51afc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:14.640632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db809a8a-be96-4860-a77b-f5f5ff51afc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:14.640895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db809a8a-be96-4860-a77b-f5f5ff51afc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:14.643023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-db809a8a-be96-4860-a77b-f5f5ff51afc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:14.706178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db809a8a-be96-4860-a77b-f5f5ff51afc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:14.707659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db809a8a-be96-4860-a77b-f5f5ff51afc7 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:14.719434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1259/2517] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:14.850295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed92ca-9b8e-4dca-bc53-bb78c2d0eb9a service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:14.851776 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e9ed92ca-9b8e-4dca-bc53-bb78c2d0eb9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:14.874938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed92ca-9b8e-4dca-bc53-bb78c2d0eb9a service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:14.894982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add08f63-f019-49bc-8c55-87e9e98813a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:14.898625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add08f63-f019-49bc-8c55-87e9e98813a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:14.898937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add08f63-f019-49bc-8c55-87e9e98813a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:14.900252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add08f63-f019-49bc-8c55-87e9e98813a8 admin admin] PATH_INFO: `/v3/projects/935609f47f354b80a0b4fc51e427ee99` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:14.901709 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add08f63-f019-49bc-8c55-87e9e98813a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935609f47f354b80a0b4fc51e427ee99)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:14.903799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add08f63-f019-49bc-8c55-87e9e98813a8 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:14.983447 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-add08f63-f019-49bc-8c55-87e9e98813a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935609f47f354b80a0b4fc51e427ee99', 'request_id': 'req-add08f63-f019-49bc-8c55-87e9e98813a8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:14.994940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-add08f63-f019-49bc-8c55-87e9e98813a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935609f47f354b80a0b4fc51e427ee99', 'request_id': 'req-add08f63-f019-49bc-8c55-87e9e98813a8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:15.004000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-add08f63-f019-49bc-8c55-87e9e98813a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935609f47f354b80a0b4fc51e427ee99', 'request_id': 'req-add08f63-f019-49bc-8c55-87e9e98813a8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:15.019387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-add08f63-f019-49bc-8c55-87e9e98813a8 admin admin] The token cache is being invalidate because project 935609f47f354b80a0b4fc51e427ee99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:15.019766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-add08f63-f019-49bc-8c55-87e9e98813a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:15.020419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-add08f63-f019-49bc-8c55-87e9e98813a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:15.022683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1259/2518] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:14 2022] DELETE /identity/v3/projects/935609f47f354b80a0b4fc51e427ee99 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:19.934651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db809a8a-be96-4860-a77b-f5f5ff51afc7 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:19.936347 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-db809a8a-be96-4860-a77b-f5f5ff51afc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:19.951189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db809a8a-be96-4860-a77b-f5f5ff51afc7 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:19.979152 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=100 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:20.013908 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:20.014806 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:20.015082 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:20.015369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] PATH_INFO: `/v3/users/d97e64029503420dadf876eabdee78cc` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:20.016581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97e64029503420dadf876eabdee78cc)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:20.018568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:20.072430 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97e64029503420dadf876eabdee78cc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.073182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97e64029503420dadf876eabdee78cc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.073932 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97e64029503420dadf876eabdee78cc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.082541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97e64029503420dadf876eabdee78cc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.092521 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97e64029503420dadf876eabdee78cc'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.118769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1260/2519] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:19 2022] DELETE /identity/v3/users/d97e64029503420dadf876eabdee78cc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:20.125055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2853bb-7969-486a-9330-a20eacfc363c None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:20.125605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2853bb-7969-486a-9330-a20eacfc363c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:20.125701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2853bb-7969-486a-9330-a20eacfc363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:20.145267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-8e2853bb-7969-486a-9330-a20eacfc363c None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:20.146492 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-8e2853bb-7969-486a-9330-a20eacfc363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:20.187155 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:20.210499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1260/2520] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:20.221247 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:20.222520 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:20.284009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072da06-93f9-474c-9d46-ff30ded2308b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:20.288214 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b223-c874-44d4-b1ac-3583ba541436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:20.288885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b223-c874-44d4-b1ac-3583ba541436 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:20.289165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b223-c874-44d4-b1ac-3583ba541436 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:20.289473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b223-c874-44d4-b1ac-3583ba541436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:20.302305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b223-c874-44d4-b1ac-3583ba541436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:20.303777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b223-c874-44d4-b1ac-3583ba541436 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:20.314640 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1261/2521] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:20.619154 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2853bb-7969-486a-9330-a20eacfc363c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:20.621131 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-8e2853bb-7969-486a-9330-a20eacfc363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:20.635327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2853bb-7969-486a-9330-a20eacfc363c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:20.641400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:20.642295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:20.642567 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:20.642841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] PATH_INFO: `/v3/projects/9191f0bf4bbc4235aede5fcbb072428a` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:20.644184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] RBAC: Authorizing `identity:delete_project(project_id=9191f0bf4bbc4235aede5fcbb072428a)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:20.646327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:20.708432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9191f0bf4bbc4235aede5fcbb072428a', 'request_id': 'req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.714203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9191f0bf4bbc4235aede5fcbb072428a', 'request_id': 'req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.722781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9191f0bf4bbc4235aede5fcbb072428a', 'request_id': 'req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.742785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] The token cache is being invalidate because project 9191f0bf4bbc4235aede5fcbb072428a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:20.743110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.743739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.745766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1261/2522] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:20 2022] DELETE /identity/v3/projects/9191f0bf4bbc4235aede5fcbb072428a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:20.750017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b223-c874-44d4-b1ac-3583ba541436 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:20.763043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b223-c874-44d4-b1ac-3583ba541436 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:20.824951 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:20.849459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8365abf-d0be-4f72-b17b-cf0fc438483a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:20.850852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8365abf-d0be-4f72-b17b-cf0fc438483a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:20.852067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8365abf-d0be-4f72-b17b-cf0fc438483a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:20.852582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8365abf-d0be-4f72-b17b-cf0fc438483a admin admin] PATH_INFO: `/v3/users/9fe99335466e47e0be7b69a368f8e2bd` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:20.854010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8365abf-d0be-4f72-b17b-cf0fc438483a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe99335466e47e0be7b69a368f8e2bd)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:20.856082 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8365abf-d0be-4f72-b17b-cf0fc438483a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:20.921311 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f8365abf-d0be-4f72-b17b-cf0fc438483a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe99335466e47e0be7b69a368f8e2bd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.922355 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f8365abf-d0be-4f72-b17b-cf0fc438483a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe99335466e47e0be7b69a368f8e2bd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.923224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f8365abf-d0be-4f72-b17b-cf0fc438483a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe99335466e47e0be7b69a368f8e2bd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.939424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f8365abf-d0be-4f72-b17b-cf0fc438483a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe99335466e47e0be7b69a368f8e2bd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.950767 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f8365abf-d0be-4f72-b17b-cf0fc438483a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe99335466e47e0be7b69a368f8e2bd'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:20.983728 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1262/2523] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:20 2022] DELETE /identity/v3/users/9fe99335466e47e0be7b69a368f8e2bd => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:21.294957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:21.296763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:21.312040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ba272-c39c-4fbd-b4ae-b7f872a221de admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:21.373611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bb91f-9e12-4c61-aee9-935ea409d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:21.374484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bb91f-9e12-4c61-aee9-935ea409d78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:21.374765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bb91f-9e12-4c61-aee9-935ea409d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:21.375068 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bb91f-9e12-4c61-aee9-935ea409d78e admin admin] PATH_INFO: `/v3/projects/6b2522ef2b56485ba1af1595a9418642` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:21.376262 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bb91f-9e12-4c61-aee9-935ea409d78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2522ef2b56485ba1af1595a9418642)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:21.378243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bb91f-9e12-4c61-aee9-935ea409d78e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:21.427103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-dd8bb91f-9e12-4c61-aee9-935ea409d78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2522ef2b56485ba1af1595a9418642', 'request_id': 'req-dd8bb91f-9e12-4c61-aee9-935ea409d78e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:21.437869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-dd8bb91f-9e12-4c61-aee9-935ea409d78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2522ef2b56485ba1af1595a9418642', 'request_id': 'req-dd8bb91f-9e12-4c61-aee9-935ea409d78e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:21.443863 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-dd8bb91f-9e12-4c61-aee9-935ea409d78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2522ef2b56485ba1af1595a9418642', 'request_id': 'req-dd8bb91f-9e12-4c61-aee9-935ea409d78e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:21.445812 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:21.456774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-dd8bb91f-9e12-4c61-aee9-935ea409d78e admin admin] The token cache is being invalidate because project 6b2522ef2b56485ba1af1595a9418642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:21.457379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-dd8bb91f-9e12-4c61-aee9-935ea409d78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:21.458191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-dd8bb91f-9e12-4c61-aee9-935ea409d78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:21.459774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1262/2524] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:21 2022] DELETE /identity/v3/projects/6b2522ef2b56485ba1af1595a9418642 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:21.464852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119537d-39c1-431b-b653-96bcb83514ff None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:21.465140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119537d-39c1-431b-b653-96bcb83514ff None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:21.465477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119537d-39c1-431b-b653-96bcb83514ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:21.487448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-1119537d-39c1-431b-b653-96bcb83514ff None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:21.488774 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1119537d-39c1-431b-b653-96bcb83514ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:21.554431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1263/2525] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:21.567665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ad3dc-1ddd-47fd-8544-53f154c0ef43 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:21.568012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ad3dc-1ddd-47fd-8544-53f154c0ef43 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:21.568375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ad3dc-1ddd-47fd-8544-53f154c0ef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:21.591465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-355ad3dc-1ddd-47fd-8544-53f154c0ef43 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:21.592723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-355ad3dc-1ddd-47fd-8544-53f154c0ef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:21.602743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1263/2526] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:21.607301 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119537d-39c1-431b-b653-96bcb83514ff None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:21.617903 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119537d-39c1-431b-b653-96bcb83514ff None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:21.624054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df516158-5927-47f0-849e-e6ccebd7581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:21.624732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df516158-5927-47f0-849e-e6ccebd7581f admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:21.625007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df516158-5927-47f0-849e-e6ccebd7581f admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:21.625319 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df516158-5927-47f0-849e-e6ccebd7581f admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:21.626216 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df516158-5927-47f0-849e-e6ccebd7581f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:21.626534 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df516158-5927-47f0-849e-e6ccebd7581f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:21.628141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df516158-5927-47f0-849e-e6ccebd7581f admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:21.640357 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1264/2527] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:27:21.644804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ad3dc-1ddd-47fd-8544-53f154c0ef43 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:21.656551 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ad3dc-1ddd-47fd-8544-53f154c0ef43 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:21.663657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea7748-f3e0-4880-9a66-0774a22a6930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:21.664301 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea7748-f3e0-4880-9a66-0774a22a6930 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:21.664578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea7748-f3e0-4880-9a66-0774a22a6930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:21.664855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea7748-f3e0-4880-9a66-0774a22a6930 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:21.665683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea7748-f3e0-4880-9a66-0774a22a6930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:21.667697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea7748-f3e0-4880-9a66-0774a22a6930 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:21.696824 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1264/2528] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:21 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:21.701071 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df516158-5927-47f0-849e-e6ccebd7581f admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:21.711582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df516158-5927-47f0-849e-e6ccebd7581f admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:21.765007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:21.773562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10da910-34d0-411c-aa2e-9e7a0863d7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:21.774401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10da910-34d0-411c-aa2e-9e7a0863d7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:21.774904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10da910-34d0-411c-aa2e-9e7a0863d7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:21.775339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10da910-34d0-411c-aa2e-9e7a0863d7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:21.776255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10da910-34d0-411c-aa2e-9e7a0863d7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:21.778248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10da910-34d0-411c-aa2e-9e7a0863d7a5 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:21.800461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1265/2529] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:21 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:21.806285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea7748-f3e0-4880-9a66-0774a22a6930 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:21.818104 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea7748-f3e0-4880-9a66-0774a22a6930 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:21.823903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79449d07-480e-433a-aab9-184b2d1e810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:21.824577 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79449d07-480e-433a-aab9-184b2d1e810c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:21.824860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79449d07-480e-433a-aab9-184b2d1e810c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:21.825138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79449d07-480e-433a-aab9-184b2d1e810c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:21.825925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79449d07-480e-433a-aab9-184b2d1e810c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:21.827540 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79449d07-480e-433a-aab9-184b2d1e810c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:21.839956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1265/2530] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:27:21.844145 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10da910-34d0-411c-aa2e-9e7a0863d7a5 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:21.855526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10da910-34d0-411c-aa2e-9e7a0863d7a5 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:21.861795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2930e-1cde-4f1d-a19c-e54224d3bb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:21.863746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2930e-1cde-4f1d-a19c-e54224d3bb9e admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:21.864044 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2930e-1cde-4f1d-a19c-e54224d3bb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:21.865911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2930e-1cde-4f1d-a19c-e54224d3bb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:21.866678 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2930e-1cde-4f1d-a19c-e54224d3bb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:21.869683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2930e-1cde-4f1d-a19c-e54224d3bb9e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:21.881662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1266/2531] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:21.886157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79449d07-480e-433a-aab9-184b2d1e810c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:21.897136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79449d07-480e-433a-aab9-184b2d1e810c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:21.902495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a8fd8-68e3-467c-a810-face975658f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:21.903392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a8fd8-68e3-467c-a810-face975658f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:21.903679 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a8fd8-68e3-467c-a810-face975658f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:21.903963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a8fd8-68e3-467c-a810-face975658f4 admin admin] PATH_INFO: `/v3/projects/4c50f0c24cfc48a580a5f9228d83bcc1/users/f29f2eddc01f4fb586b53398e14c5711/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:21.920004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a8fd8-68e3-467c-a810-face975658f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c50f0c24cfc48a580a5f9228d83bcc1, user_id=f29f2eddc01f4fb586b53398e14c5711, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:21.922766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a8fd8-68e3-467c-a810-face975658f4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:21.937401 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1266/2532] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:21 2022] PUT /identity/v3/projects/4c50f0c24cfc48a580a5f9228d83bcc1/users/f29f2eddc01f4fb586b53398e14c5711/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:21.950077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f328842-4d59-41f0-b1a9-e9bb62f2a703 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:21.950077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f328842-4d59-41f0-b1a9-e9bb62f2a703 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:21.950077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f328842-4d59-41f0-b1a9-e9bb62f2a703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:21.984403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-5f328842-4d59-41f0-b1a9-e9bb62f2a703 None None] MFA Rules not processed for user `f29f2eddc01f4fb586b53398e14c5711`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:21.985761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-5f328842-4d59-41f0-b1a9-e9bb62f2a703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:22.046209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a8fd8-68e3-467c-a810-face975658f4 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:22.046893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-bf7a8fd8-68e3-467c-a810-face975658f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:22.075719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1267/2533] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:22.082267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f328842-4d59-41f0-b1a9-e9bb62f2a703 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:22.119167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a8fd8-68e3-467c-a810-face975658f4 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:22.124003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9310101-def6-467a-afec-ae8e018aef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:22.124892 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9310101-def6-467a-afec-ae8e018aef4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.125174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9310101-def6-467a-afec-ae8e018aef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.125650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9310101-def6-467a-afec-ae8e018aef4b admin admin] PATH_INFO: `/v3/users/f8b3f83c8c504de990ba9f5d900e52af` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.126920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9310101-def6-467a-afec-ae8e018aef4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b3f83c8c504de990ba9f5d900e52af)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:22.128869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9310101-def6-467a-afec-ae8e018aef4b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:22.151622 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f328842-4d59-41f0-b1a9-e9bb62f2a703 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:22.156487 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5ae8-71e0-4426-8fba-b25083e55cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:22.157746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5ae8-71e0-4426-8fba-b25083e55cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.158402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5ae8-71e0-4426-8fba-b25083e55cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.158734 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5ae8-71e0-4426-8fba-b25083e55cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.159485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb5ae8-71e0-4426-8fba-b25083e55cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:22.161782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb5ae8-71e0-4426-8fba-b25083e55cd7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:22.189060 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a9310101-def6-467a-afec-ae8e018aef4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b3f83c8c504de990ba9f5d900e52af'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:22.189416 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a9310101-def6-467a-afec-ae8e018aef4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b3f83c8c504de990ba9f5d900e52af'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:22.190187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a9310101-def6-467a-afec-ae8e018aef4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b3f83c8c504de990ba9f5d900e52af'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:22.200709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1268/2534] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:22 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:22.202371 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5ae8-71e0-4426-8fba-b25083e55cd7 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:22.202865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a9310101-def6-467a-afec-ae8e018aef4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b3f83c8c504de990ba9f5d900e52af'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:22.204274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-03cb5ae8-71e0-4426-8fba-b25083e55cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:22.213425 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a9310101-def6-467a-afec-ae8e018aef4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b3f83c8c504de990ba9f5d900e52af'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:22.231622 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1267/2535] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:22 2022] DELETE /identity/v3/users/f8b3f83c8c504de990ba9f5d900e52af => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:22.236219 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebbf3c-a39d-4e11-9600-622de6a12ce1 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.236496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebbf3c-a39d-4e11-9600-622de6a12ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.236777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebbf3c-a39d-4e11-9600-622de6a12ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.257785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-cbebbf3c-a39d-4e11-9600-622de6a12ce1 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:22.259023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cbebbf3c-a39d-4e11-9600-622de6a12ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:22.259434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:22.265337 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:22.276427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5ae8-71e0-4426-8fba-b25083e55cd7 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:22.325584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1268/2536] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:22.335422 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc6690-8aab-437c-bf1d-527a0a1148ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:22.336124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebbf3c-a39d-4e11-9600-622de6a12ce1 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:22.336252 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc6690-8aab-437c-bf1d-527a0a1148ab admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.336494 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc6690-8aab-437c-bf1d-527a0a1148ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.336771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc6690-8aab-437c-bf1d-527a0a1148ab admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.337603 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc6690-8aab-437c-bf1d-527a0a1148ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:22.337842 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-cbebbf3c-a39d-4e11-9600-622de6a12ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:22.339756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc6690-8aab-437c-bf1d-527a0a1148ab admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:22.366479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1269/2537] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:22 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:22.371157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc6690-8aab-437c-bf1d-527a0a1148ab admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:22.381936 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc6690-8aab-437c-bf1d-527a0a1148ab admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:22.387630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92f3df-b65b-41ce-8f7b-3ff47a57718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:22.388627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92f3df-b65b-41ce-8f7b-3ff47a57718f admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.388900 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92f3df-b65b-41ce-8f7b-3ff47a57718f admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.389522 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92f3df-b65b-41ce-8f7b-3ff47a57718f admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.390682 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92f3df-b65b-41ce-8f7b-3ff47a57718f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:22.392753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92f3df-b65b-41ce-8f7b-3ff47a57718f admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:22.401101 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebbf3c-a39d-4e11-9600-622de6a12ce1 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:22.405259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1270/2538] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:22.405405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b52d2d-0d51-431b-bf28-67460c4ba6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:22.405937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b52d2d-0d51-431b-bf28-67460c4ba6ba service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.406222 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b52d2d-0d51-431b-bf28-67460c4ba6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.406501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b52d2d-0d51-431b-bf28-67460c4ba6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.409303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92f3df-b65b-41ce-8f7b-3ff47a57718f admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:22.417002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b52d2d-0d51-431b-bf28-67460c4ba6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:22.418496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b52d2d-0d51-431b-bf28-67460c4ba6ba service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:22.420536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92f3df-b65b-41ce-8f7b-3ff47a57718f admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:22.425923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50c9df-93b7-450e-886d-12fed16f4b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:22.426819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50c9df-93b7-450e-886d-12fed16f4b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.427104 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50c9df-93b7-450e-886d-12fed16f4b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.427394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50c9df-93b7-450e-886d-12fed16f4b18 admin admin] PATH_INFO: `/v3/projects/740e0f0a9ae2419195f05115503e55c7/users/7f0b48aeac88486284d0d65f0a459e1f/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.428524 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1269/2539] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:27:22.443124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50c9df-93b7-450e-886d-12fed16f4b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=740e0f0a9ae2419195f05115503e55c7, user_id=7f0b48aeac88486284d0d65f0a459e1f, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:22.445859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50c9df-93b7-450e-886d-12fed16f4b18 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:22.459852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1271/2540] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:22 2022] PUT /identity/v3/projects/740e0f0a9ae2419195f05115503e55c7/users/7f0b48aeac88486284d0d65f0a459e1f/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:22.463812 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b52d2d-0d51-431b-bf28-67460c4ba6ba service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:22.474326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b52d2d-0d51-431b-bf28-67460c4ba6ba service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:22.534166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beef3fa-dd85-4250-ac0c-77a4e4fc389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:22.534864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beef3fa-dd85-4250-ac0c-77a4e4fc389f admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.535140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beef3fa-dd85-4250-ac0c-77a4e4fc389f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.535534 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beef3fa-dd85-4250-ac0c-77a4e4fc389f admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.536335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beef3fa-dd85-4250-ac0c-77a4e4fc389f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:22.538283 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beef3fa-dd85-4250-ac0c-77a4e4fc389f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:22.549455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1270/2541] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:27:22.553947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50c9df-93b7-450e-886d-12fed16f4b18 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:22.566120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50c9df-93b7-450e-886d-12fed16f4b18 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:22.571257 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc578d5-9b46-4ba9-a7b6-5d5f10342586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:22.572241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc578d5-9b46-4ba9-a7b6-5d5f10342586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.572596 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc578d5-9b46-4ba9-a7b6-5d5f10342586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.572942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc578d5-9b46-4ba9-a7b6-5d5f10342586 admin admin] PATH_INFO: `/v3/projects/740e0f0a9ae2419195f05115503e55c7/users/7f0b48aeac88486284d0d65f0a459e1f/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.575134 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc578d5-9b46-4ba9-a7b6-5d5f10342586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=740e0f0a9ae2419195f05115503e55c7, user_id=7f0b48aeac88486284d0d65f0a459e1f, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:22.577912 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc578d5-9b46-4ba9-a7b6-5d5f10342586 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:22.599884 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1272/2542] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:22 2022] PUT /identity/v3/projects/740e0f0a9ae2419195f05115503e55c7/users/7f0b48aeac88486284d0d65f0a459e1f/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:22.610923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c686909-9636-414c-9e25-6b1ed75775ab None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.611210 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c686909-9636-414c-9e25-6b1ed75775ab None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.611499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c686909-9636-414c-9e25-6b1ed75775ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.640233 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-5c686909-9636-414c-9e25-6b1ed75775ab None None] MFA Rules not processed for user `7f0b48aeac88486284d0d65f0a459e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:22.641673 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5c686909-9636-414c-9e25-6b1ed75775ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:22.684666 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:22.721754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1271/2543] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:22.734466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc578d5-9b46-4ba9-a7b6-5d5f10342586 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:22.736501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6fc578d5-9b46-4ba9-a7b6-5d5f10342586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:22.737393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c686909-9636-414c-9e25-6b1ed75775ab None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:22.738907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5c686909-9636-414c-9e25-6b1ed75775ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:22.809799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc578d5-9b46-4ba9-a7b6-5d5f10342586 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:22.813793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c686909-9636-414c-9e25-6b1ed75775ab None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:22.814747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cd27e-2993-4c39-a8ce-2356648d4aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:22.815629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cd27e-2993-4c39-a8ce-2356648d4aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.815914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cd27e-2993-4c39-a8ce-2356648d4aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.816189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cd27e-2993-4c39-a8ce-2356648d4aab admin admin] PATH_INFO: `/v3/projects/d0d2ac10b1894b5c8eb63b19db6130d7` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.817404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cd27e-2993-4c39-a8ce-2356648d4aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d2ac10b1894b5c8eb63b19db6130d7)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:22.817522 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c5ea9-fc64-4c70-a4e6-5f8eb122e40e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:22.818109 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c5ea9-fc64-4c70-a4e6-5f8eb122e40e service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.818391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c5ea9-fc64-4c70-a4e6-5f8eb122e40e service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.818668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c5ea9-fc64-4c70-a4e6-5f8eb122e40e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.819389 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cd27e-2993-4c39-a8ce-2356648d4aab admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:22.828761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c5ea9-fc64-4c70-a4e6-5f8eb122e40e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:22.830327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c5ea9-fc64-4c70-a4e6-5f8eb122e40e service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:22.840631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1272/2544] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:22.864384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:22.876952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6b0cd27e-2993-4c39-a8ce-2356648d4aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d2ac10b1894b5c8eb63b19db6130d7', 'request_id': 'req-6b0cd27e-2993-4c39-a8ce-2356648d4aab'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:22.886510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6b0cd27e-2993-4c39-a8ce-2356648d4aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d2ac10b1894b5c8eb63b19db6130d7', 'request_id': 'req-6b0cd27e-2993-4c39-a8ce-2356648d4aab'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:22.887409 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480996e-3270-4276-97e8-4f5ed291e40d None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.887699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480996e-3270-4276-97e8-4f5ed291e40d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.887979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480996e-3270-4276-97e8-4f5ed291e40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.897779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6b0cd27e-2993-4c39-a8ce-2356648d4aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d2ac10b1894b5c8eb63b19db6130d7', 'request_id': 'req-6b0cd27e-2993-4c39-a8ce-2356648d4aab'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:22.907067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1480996e-3270-4276-97e8-4f5ed291e40d None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:22.908298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1480996e-3270-4276-97e8-4f5ed291e40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:22.911263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6b0cd27e-2993-4c39-a8ce-2356648d4aab admin admin] The token cache is being invalidate because project d0d2ac10b1894b5c8eb63b19db6130d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:22.911554 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6b0cd27e-2993-4c39-a8ce-2356648d4aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:22.912204 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-6b0cd27e-2993-4c39-a8ce-2356648d4aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:22.914779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1273/2545] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:22 2022] DELETE /identity/v3/projects/d0d2ac10b1894b5c8eb63b19db6130d7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:22.919420 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406060ea-508e-48c2-b15a-4aea51ab66b0 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:22.919797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406060ea-508e-48c2-b15a-4aea51ab66b0 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:22.920173 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406060ea-508e-48c2-b15a-4aea51ab66b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:22.939050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-406060ea-508e-48c2-b15a-4aea51ab66b0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:22.940270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-406060ea-508e-48c2-b15a-4aea51ab66b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:22.977612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1273/2546] 10.222.0.62 () {58 vars in 967 bytes} [Thu Jul 7 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:22.992980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480996e-3270-4276-97e8-4f5ed291e40d None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:22.994694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1480996e-3270-4276-97e8-4f5ed291e40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:23.012571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1274/2547] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:23.020646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf6d9f-2316-4ac2-9df7-e64593630442 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.020987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf6d9f-2316-4ac2-9df7-e64593630442 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.021298 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf6d9f-2316-4ac2-9df7-e64593630442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.041163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-46cf6d9f-2316-4ac2-9df7-e64593630442 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:23.042450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-46cf6d9f-2316-4ac2-9df7-e64593630442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:23.058133 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1275/2548] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:23.059575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf6d9f-2316-4ac2-9df7-e64593630442 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:23.070229 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf6d9f-2316-4ac2-9df7-e64593630442 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:23.075005 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4ddd5-9a03-4d41-8a74-925bac834386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:23.075677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4ddd5-9a03-4d41-8a74-925bac834386 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.075968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4ddd5-9a03-4d41-8a74-925bac834386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.076227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4ddd5-9a03-4d41-8a74-925bac834386 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.076992 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4ddd5-9a03-4d41-8a74-925bac834386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:23.077415 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4ddd5-9a03-4d41-8a74-925bac834386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:23.079239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4ddd5-9a03-4d41-8a74-925bac834386 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:23.096501 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1276/2549] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:27:23.096672 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480996e-3270-4276-97e8-4f5ed291e40d None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:23.097647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4ddd5-9a03-4d41-8a74-925bac834386 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:23.102065 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79ae8f-75b6-416c-95c5-5a8d142a8493 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:23.102736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79ae8f-75b6-416c-95c5-5a8d142a8493 service swift] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.103021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79ae8f-75b6-416c-95c5-5a8d142a8493 service swift] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.103428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79ae8f-75b6-416c-95c5-5a8d142a8493 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.108947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4ddd5-9a03-4d41-8a74-925bac834386 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:23.112701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79ae8f-75b6-416c-95c5-5a8d142a8493 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:23.114350 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79ae8f-75b6-416c-95c5-5a8d142a8493 service swift] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:23.115145 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bab0fc-c198-4fa5-8258-a1d8936b785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:23.116079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab0fc-c198-4fa5-8258-a1d8936b785d admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.116379 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab0fc-c198-4fa5-8258-a1d8936b785d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.116653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab0fc-c198-4fa5-8258-a1d8936b785d admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.117388 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab0fc-c198-4fa5-8258-a1d8936b785d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:23.120270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab0fc-c198-4fa5-8258-a1d8936b785d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:23.123113 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1274/2550] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:27:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:27:23.155169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1277/2551] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:23 2022] POST /identity/v3/projects => generated 405 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:23.159256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79ae8f-75b6-416c-95c5-5a8d142a8493 service swift] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:23.171932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79ae8f-75b6-416c-95c5-5a8d142a8493 service swift] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:23.183426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:23.257769 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa35313-3019-4f72-902a-042c945d0abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:23.258503 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa35313-3019-4f72-902a-042c945d0abb admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.258792 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa35313-3019-4f72-902a-042c945d0abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.259164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa35313-3019-4f72-902a-042c945d0abb admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.259750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa35313-3019-4f72-902a-042c945d0abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:23.261907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa35313-3019-4f72-902a-042c945d0abb admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:23.295355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1275/2552] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:23 2022] POST /identity/v3/users => generated 303 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:23.299854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bab0fc-c198-4fa5-8258-a1d8936b785d admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:23.314703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bab0fc-c198-4fa5-8258-a1d8936b785d admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:23.322461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9eb714-7dda-4736-afcc-016f2210e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:23.325524 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9eb714-7dda-4736-afcc-016f2210e91b admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.326022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9eb714-7dda-4736-afcc-016f2210e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.326511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9eb714-7dda-4736-afcc-016f2210e91b admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.327907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9eb714-7dda-4736-afcc-016f2210e91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:23.329821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9eb714-7dda-4736-afcc-016f2210e91b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:23.350907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1278/2553] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:23.354927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa35313-3019-4f72-902a-042c945d0abb admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:23.366071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa35313-3019-4f72-902a-042c945d0abb admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:23.371056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b69ff3-c9dd-4e05-8ed3-a50535847971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:23.371748 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b69ff3-c9dd-4e05-8ed3-a50535847971 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.372031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b69ff3-c9dd-4e05-8ed3-a50535847971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.372311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b69ff3-c9dd-4e05-8ed3-a50535847971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.373043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b69ff3-c9dd-4e05-8ed3-a50535847971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:23.374715 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b69ff3-c9dd-4e05-8ed3-a50535847971 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:23.392605 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1276/2554] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:23.393766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9eb714-7dda-4736-afcc-016f2210e91b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:23.407772 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9eb714-7dda-4736-afcc-016f2210e91b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:23.413396 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b4b3e-ce9e-45b5-aa98-bebbfa917acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:23.415529 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b4b3e-ce9e-45b5-aa98-bebbfa917acf admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.415970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b4b3e-ce9e-45b5-aa98-bebbfa917acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.416261 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b4b3e-ce9e-45b5-aa98-bebbfa917acf admin admin] PATH_INFO: `/v3/projects/6b930413b3bf488ebfb9d1533d7020b9/users/ee152608c65d44d2a96fc96c1da753ef/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.435614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b4b3e-ce9e-45b5-aa98-bebbfa917acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b930413b3bf488ebfb9d1533d7020b9, user_id=ee152608c65d44d2a96fc96c1da753ef, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:23.439316 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b4b3e-ce9e-45b5-aa98-bebbfa917acf admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:23.468328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1279/2555] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:23 2022] PUT /identity/v3/projects/6b930413b3bf488ebfb9d1533d7020b9/users/ee152608c65d44d2a96fc96c1da753ef/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:23.473756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01300a-df20-4429-ac10-823c66ae3f93 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.474059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01300a-df20-4429-ac10-823c66ae3f93 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.474346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01300a-df20-4429-ac10-823c66ae3f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.495904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-8c01300a-df20-4429-ac10-823c66ae3f93 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:23.498305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-8c01300a-df20-4429-ac10-823c66ae3f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:23.543957 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b4b3e-ce9e-45b5-aa98-bebbfa917acf admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:23.546018 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-615b4b3e-ce9e-45b5-aa98-bebbfa917acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:23.571289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1277/2556] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:23.581489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01300a-df20-4429-ac10-823c66ae3f93 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:23.583726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-8c01300a-df20-4429-ac10-823c66ae3f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:23.604441 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:23.621369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b4b3e-ce9e-45b5-aa98-bebbfa917acf admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:23.626623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:23.627510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.627795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.628073 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] PATH_INFO: `/v3/users/f29f2eddc01f4fb586b53398e14c5711` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.629351 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29f2eddc01f4fb586b53398e14c5711)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:23.631448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:23.649003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01300a-df20-4429-ac10-823c66ae3f93 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:23.653322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeace2-3b62-432a-a37a-35b20491f990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:23.653984 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeace2-3b62-432a-a37a-35b20491f990 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.654729 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeace2-3b62-432a-a37a-35b20491f990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.654729 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeace2-3b62-432a-a37a-35b20491f990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.665146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeace2-3b62-432a-a37a-35b20491f990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:23.666623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeace2-3b62-432a-a37a-35b20491f990 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:23.677809 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1278/2557] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:23.679545 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29f2eddc01f4fb586b53398e14c5711'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:23.680212 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29f2eddc01f4fb586b53398e14c5711'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:23.680826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29f2eddc01f4fb586b53398e14c5711'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:23.688192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29f2eddc01f4fb586b53398e14c5711'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:23.696966 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29f2eddc01f4fb586b53398e14c5711'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:23.727863 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1280/2558] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:23 2022] DELETE /identity/v3/users/f29f2eddc01f4fb586b53398e14c5711 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:23.735997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac3bc8-1133-4c97-b181-e05f90e03032 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.736287 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac3bc8-1133-4c97-b181-e05f90e03032 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.736569 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac3bc8-1133-4c97-b181-e05f90e03032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.760338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-ddac3bc8-1133-4c97-b181-e05f90e03032 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:23.761960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ddac3bc8-1133-4c97-b181-e05f90e03032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:23.805006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:23.839736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1279/2559] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:23.850385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:23.851863 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:23.918540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffd171-a8bd-45d6-a4ea-356dd5a42c7a admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:23.922536 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c47d76-4f4b-4a5b-b99b-2c8380bd838e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:23.923187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c47d76-4f4b-4a5b-b99b-2c8380bd838e service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:23.923473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c47d76-4f4b-4a5b-b99b-2c8380bd838e service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:23.923752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c47d76-4f4b-4a5b-b99b-2c8380bd838e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:23.934251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c47d76-4f4b-4a5b-b99b-2c8380bd838e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:23.935843 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c47d76-4f4b-4a5b-b99b-2c8380bd838e service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:23.946456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1281/2560] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:24.242394 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac3bc8-1133-4c97-b181-e05f90e03032 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:24.245202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ddac3bc8-1133-4c97-b181-e05f90e03032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:24.283308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac3bc8-1133-4c97-b181-e05f90e03032 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:24.289972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:24.290793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:24.291197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:24.291388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] PATH_INFO: `/v3/projects/4c50f0c24cfc48a580a5f9228d83bcc1` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:24.292547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c50f0c24cfc48a580a5f9228d83bcc1)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:24.294551 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:24.356948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c50f0c24cfc48a580a5f9228d83bcc1', 'request_id': 'req-db9bcd71-ba5b-4e6e-939d-e803d67da79e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:24.365658 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2ed2-8bb0-4983-afb2-3e6476711b34 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:24.366198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c50f0c24cfc48a580a5f9228d83bcc1', 'request_id': 'req-db9bcd71-ba5b-4e6e-939d-e803d67da79e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:24.366303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2ed2-8bb0-4983-afb2-3e6476711b34 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:24.366303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2ed2-8bb0-4983-afb2-3e6476711b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:24.373547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c50f0c24cfc48a580a5f9228d83bcc1', 'request_id': 'req-db9bcd71-ba5b-4e6e-939d-e803d67da79e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:24.385170 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] The token cache is being invalidate because project 4c50f0c24cfc48a580a5f9228d83bcc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:24.385669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:24.386503 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:24.389822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1280/2561] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:24 2022] DELETE /identity/v3/projects/4c50f0c24cfc48a580a5f9228d83bcc1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:24.395800 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:24.397204 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:24.401139 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-729b2ed2-8bb0-4983-afb2-3e6476711b34 None None] MFA Rules not processed for user `ee152608c65d44d2a96fc96c1da753ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:24.405657 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-729b2ed2-8bb0-4983-afb2-3e6476711b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:24.479406 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bcd71-ba5b-4e6e-939d-e803d67da79e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:24.485321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:24.489582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:24.489727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1282/2562] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:24.489831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:24.489831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] PATH_INFO: `/v3/users/7f0b48aeac88486284d0d65f0a459e1f` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:24.489831 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0b48aeac88486284d0d65f0a459e1f)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:24.490084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:24.490838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2ed2-8bb0-4983-afb2-3e6476711b34 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:24.492353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-729b2ed2-8bb0-4983-afb2-3e6476711b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:24.500810 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:24.509398 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2ed2-8bb0-4983-afb2-3e6476711b34 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:24.516609 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b027535-9a08-4bcb-8cd0-0ecff629ad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:24.517727 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b027535-9a08-4bcb-8cd0-0ecff629ad48 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:24.518213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b027535-9a08-4bcb-8cd0-0ecff629ad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:24.518619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b027535-9a08-4bcb-8cd0-0ecff629ad48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:24.520300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b027535-9a08-4bcb-8cd0-0ecff629ad48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:24.523258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b027535-9a08-4bcb-8cd0-0ecff629ad48 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:24.562821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1283/2563] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:24 2022] POST /identity/v3/projects => generated 405 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:24.563725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b027535-9a08-4bcb-8cd0-0ecff629ad48 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:24.564838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0b48aeac88486284d0d65f0a459e1f'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:24.565932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0b48aeac88486284d0d65f0a459e1f'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:24.566907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0b48aeac88486284d0d65f0a459e1f'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:24.579329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0b48aeac88486284d0d65f0a459e1f'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:24.583720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:24.593232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0b48aeac88486284d0d65f0a459e1f'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:24.625330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1281/2564] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:24 2022] DELETE /identity/v3/users/7f0b48aeac88486284d0d65f0a459e1f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:24.638033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b027535-9a08-4bcb-8cd0-0ecff629ad48 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:24.696802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca08e1-16a9-48be-be8b-7b6774b6657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:24.697535 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca08e1-16a9-48be-be8b-7b6774b6657a admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:24.697812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca08e1-16a9-48be-be8b-7b6774b6657a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:24.698112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca08e1-16a9-48be-be8b-7b6774b6657a admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:24.698824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca08e1-16a9-48be-be8b-7b6774b6657a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:24.700814 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca08e1-16a9-48be-be8b-7b6774b6657a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:24.724673 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1284/2565] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:24 2022] POST /identity/v3/users => generated 309 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:24.728402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:24.731649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:24.747149 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d43d4-780d-44f3-9a00-4bb8dd91f656 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:24.752072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a532755-2e5d-4747-8ccb-e8229340a69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:24.752889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a532755-2e5d-4747-8ccb-e8229340a69b admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:24.753419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a532755-2e5d-4747-8ccb-e8229340a69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:24.753772 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a532755-2e5d-4747-8ccb-e8229340a69b admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:24.754604 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a532755-2e5d-4747-8ccb-e8229340a69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:24.756336 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a532755-2e5d-4747-8ccb-e8229340a69b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:24.767797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1282/2566] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:27:24.772117 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca08e1-16a9-48be-be8b-7b6774b6657a admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:24.782788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca08e1-16a9-48be-be8b-7b6774b6657a admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:24.787413 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a449f94-ea18-48e8-b1af-b50a9afcb443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:24.788336 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a449f94-ea18-48e8-b1af-b50a9afcb443 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:24.788619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a449f94-ea18-48e8-b1af-b50a9afcb443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:24.788897 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a449f94-ea18-48e8-b1af-b50a9afcb443 admin admin] PATH_INFO: `/v3/projects/bee000e7237d401faf18442685ce3dfa/users/db15a42a0c5b4b569901ca5ac029e540/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:24.804693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a449f94-ea18-48e8-b1af-b50a9afcb443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee000e7237d401faf18442685ce3dfa, user_id=db15a42a0c5b4b569901ca5ac029e540, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:24.807728 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a449f94-ea18-48e8-b1af-b50a9afcb443 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:24.823145 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1285/2567] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:24 2022] PUT /identity/v3/projects/bee000e7237d401faf18442685ce3dfa/users/db15a42a0c5b4b569901ca5ac029e540/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:24.827245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a532755-2e5d-4747-8ccb-e8229340a69b admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:24.837715 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a532755-2e5d-4747-8ccb-e8229340a69b admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:24.894899 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d833d6-3333-4102-afd1-c436d56f8f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:24.895560 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d833d6-3333-4102-afd1-c436d56f8f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:24.895838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d833d6-3333-4102-afd1-c436d56f8f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:24.896111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d833d6-3333-4102-afd1-c436d56f8f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:24.896838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d833d6-3333-4102-afd1-c436d56f8f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:24.898555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d833d6-3333-4102-afd1-c436d56f8f95 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:24.909846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1283/2568] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:24.914230 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a449f94-ea18-48e8-b1af-b50a9afcb443 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:24.926646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a449f94-ea18-48e8-b1af-b50a9afcb443 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:24.932907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6d245-c2e0-4f80-86d8-65ccafb72ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:24.934105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6d245-c2e0-4f80-86d8-65ccafb72ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:24.934449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6d245-c2e0-4f80-86d8-65ccafb72ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:24.934922 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6d245-c2e0-4f80-86d8-65ccafb72ee6 admin admin] PATH_INFO: `/v3/projects/bee000e7237d401faf18442685ce3dfa/users/db15a42a0c5b4b569901ca5ac029e540/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:24.937425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6d245-c2e0-4f80-86d8-65ccafb72ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee000e7237d401faf18442685ce3dfa, user_id=db15a42a0c5b4b569901ca5ac029e540, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:24.940418 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6d245-c2e0-4f80-86d8-65ccafb72ee6 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:24.943754 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d833d6-3333-4102-afd1-c436d56f8f95 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:24.945543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e2d833d6-3333-4102-afd1-c436d56f8f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:24.956473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1286/2569] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:24 2022] PUT /identity/v3/projects/bee000e7237d401faf18442685ce3dfa/users/db15a42a0c5b4b569901ca5ac029e540/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:24.965341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d833d6-3333-4102-afd1-c436d56f8f95 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:25.030718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:25.031639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.031922 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.032308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139 admin admin] PATH_INFO: `/v3/projects/740e0f0a9ae2419195f05115503e55c7` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.033675 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=740e0f0a9ae2419195f05115503e55c7)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:25.035650 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:25.088823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '740e0f0a9ae2419195f05115503e55c7', 'request_id': 'req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:25.097774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '740e0f0a9ae2419195f05115503e55c7', 'request_id': 'req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:25.104781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '740e0f0a9ae2419195f05115503e55c7', 'request_id': 'req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:25.105918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:25.119514 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139 admin admin] The token cache is being invalidate because project 740e0f0a9ae2419195f05115503e55c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:25.119856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:25.120484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fd9102c0-440c-4da0-9cc0-bfcbc5a38139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:25.123388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1284/2570] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:24 2022] DELETE /identity/v3/projects/740e0f0a9ae2419195f05115503e55c7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:25.129269 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5558eb-762c-426c-9175-cb4d114014ec None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.129477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5558eb-762c-426c-9175-cb4d114014ec None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.129952 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5558eb-762c-426c-9175-cb4d114014ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.163069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-8f5558eb-762c-426c-9175-cb4d114014ec None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:25.164351 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8f5558eb-762c-426c-9175-cb4d114014ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:25.200040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:25.231238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1287/2571] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:25.242322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527829d-41c8-4b55-9697-971972c96cca None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.243136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527829d-41c8-4b55-9697-971972c96cca None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.243516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527829d-41c8-4b55-9697-971972c96cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.263505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-7527829d-41c8-4b55-9697-971972c96cca None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:25.264739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7527829d-41c8-4b55-9697-971972c96cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:25.274480 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1285/2572] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:25.279035 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5558eb-762c-426c-9175-cb4d114014ec None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:25.293465 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5558eb-762c-426c-9175-cb4d114014ec None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:25.300633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e03648-64af-4d55-b3c1-c891edec19cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:25.301435 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e03648-64af-4d55-b3c1-c891edec19cf admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.302195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e03648-64af-4d55-b3c1-c891edec19cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.302195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e03648-64af-4d55-b3c1-c891edec19cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.302933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e03648-64af-4d55-b3c1-c891edec19cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:25.303300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e03648-64af-4d55-b3c1-c891edec19cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:25.305255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e03648-64af-4d55-b3c1-c891edec19cf admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:25.321771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1288/2573] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:27:25.323921 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527829d-41c8-4b55-9697-971972c96cca None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:25.334800 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527829d-41c8-4b55-9697-971972c96cca None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:25.340226 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d99a7-2bcd-4a3b-8787-f3efa7d9ec77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:25.341576 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d99a7-2bcd-4a3b-8787-f3efa7d9ec77 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.341871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d99a7-2bcd-4a3b-8787-f3efa7d9ec77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.342642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d99a7-2bcd-4a3b-8787-f3efa7d9ec77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.343951 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d99a7-2bcd-4a3b-8787-f3efa7d9ec77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:25.346906 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d99a7-2bcd-4a3b-8787-f3efa7d9ec77 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:25.389098 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1286/2574] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:25 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:25.395769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e03648-64af-4d55-b3c1-c891edec19cf admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:25.415987 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e03648-64af-4d55-b3c1-c891edec19cf admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:25.481754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8ab7e-e36b-4561-bbf3-1c926969e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:25.482440 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8ab7e-e36b-4561-bbf3-1c926969e0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.482721 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8ab7e-e36b-4561-bbf3-1c926969e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.482995 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8ab7e-e36b-4561-bbf3-1c926969e0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.483692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8ab7e-e36b-4561-bbf3-1c926969e0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:25.486226 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8ab7e-e36b-4561-bbf3-1c926969e0c5 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:25.509340 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1289/2575] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:25 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:25.512982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d99a7-2bcd-4a3b-8787-f3efa7d9ec77 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:25.524203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d99a7-2bcd-4a3b-8787-f3efa7d9ec77 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:25.529326 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3ce24-64c0-40cb-bdb0-b4d4e93ca1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:25.530103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3ce24-64c0-40cb-bdb0-b4d4e93ca1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.530449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3ce24-64c0-40cb-bdb0-b4d4e93ca1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.530790 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3ce24-64c0-40cb-bdb0-b4d4e93ca1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.531661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3ce24-64c0-40cb-bdb0-b4d4e93ca1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:25.533567 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3ce24-64c0-40cb-bdb0-b4d4e93ca1e8 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:25.547392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1287/2576] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:25.551681 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8ab7e-e36b-4561-bbf3-1c926969e0c5 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:25.562795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8ab7e-e36b-4561-bbf3-1c926969e0c5 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:25.568712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18b243-c2e4-405b-a7b3-38b87aba2db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:25.569568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18b243-c2e4-405b-a7b3-38b87aba2db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.569851 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18b243-c2e4-405b-a7b3-38b87aba2db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.570135 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18b243-c2e4-405b-a7b3-38b87aba2db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.571052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18b243-c2e4-405b-a7b3-38b87aba2db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:25.572646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18b243-c2e4-405b-a7b3-38b87aba2db0 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:25.585251 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1290/2577] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:25.589136 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3ce24-64c0-40cb-bdb0-b4d4e93ca1e8 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:25.602263 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3ce24-64c0-40cb-bdb0-b4d4e93ca1e8 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:25.612176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41fd42-0e38-4294-a4b5-397158e6ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:25.613195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41fd42-0e38-4294-a4b5-397158e6ab1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.613567 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41fd42-0e38-4294-a4b5-397158e6ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.613936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41fd42-0e38-4294-a4b5-397158e6ab1c admin admin] PATH_INFO: `/v3/projects/c06047f47b2d49238e0d285d0be466c6/users/8224838b43ce4b7c9715699dd0df6c77/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.617376 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277fbaa-0e16-4893-b48e-d261c79db5eb None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.617934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277fbaa-0e16-4893-b48e-d261c79db5eb None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.618264 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277fbaa-0e16-4893-b48e-d261c79db5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.632520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41fd42-0e38-4294-a4b5-397158e6ab1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06047f47b2d49238e0d285d0be466c6, user_id=8224838b43ce4b7c9715699dd0df6c77, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:25.635243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41fd42-0e38-4294-a4b5-397158e6ab1c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:25.648473 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-e277fbaa-0e16-4893-b48e-d261c79db5eb None None] MFA Rules not processed for user `db15a42a0c5b4b569901ca5ac029e540`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:25.649782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-e277fbaa-0e16-4893-b48e-d261c79db5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:25.657609 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1288/2578] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:25 2022] PUT /identity/v3/projects/c06047f47b2d49238e0d285d0be466c6/users/8224838b43ce4b7c9715699dd0df6c77/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:25.665848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215c791-fc03-43dd-b3eb-881437631770 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.666140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215c791-fc03-43dd-b3eb-881437631770 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.666773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215c791-fc03-43dd-b3eb-881437631770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.699510 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e215c791-fc03-43dd-b3eb-881437631770 None None] MFA Rules not processed for user `8224838b43ce4b7c9715699dd0df6c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:25.701342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e215c791-fc03-43dd-b3eb-881437631770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:25.735624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1291/2579] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:25.781927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1289/2580] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:25.786512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277fbaa-0e16-4893-b48e-d261c79db5eb None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:25.823150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:25.854086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277fbaa-0e16-4893-b48e-d261c79db5eb None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:25.858761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea14ed-e29f-4f35-a4c0-99716de96b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:25.859434 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea14ed-e29f-4f35-a4c0-99716de96b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.859784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea14ed-e29f-4f35-a4c0-99716de96b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.860065 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea14ed-e29f-4f35-a4c0-99716de96b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.860779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea14ed-e29f-4f35-a4c0-99716de96b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:25.862784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea14ed-e29f-4f35-a4c0-99716de96b3b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:25.892991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1292/2581] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:25 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:25.894483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215c791-fc03-43dd-b3eb-881437631770 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:25.905822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215c791-fc03-43dd-b3eb-881437631770 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:25.972655 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb83b97-db0b-4f90-a61c-d96402fb5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:25.973453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb83b97-db0b-4f90-a61c-d96402fb5db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:25.973737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb83b97-db0b-4f90-a61c-d96402fb5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:25.974011 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb83b97-db0b-4f90-a61c-d96402fb5db3 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:25.975163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb83b97-db0b-4f90-a61c-d96402fb5db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:25.977145 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb83b97-db0b-4f90-a61c-d96402fb5db3 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:25.997977 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1290/2582] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:25 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:26.002377 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea14ed-e29f-4f35-a4c0-99716de96b3b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:26.012710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea14ed-e29f-4f35-a4c0-99716de96b3b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:26.017607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176fc8-a894-4afa-be3a-267400191f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:26.018277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176fc8-a894-4afa-be3a-267400191f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:26.018558 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176fc8-a894-4afa-be3a-267400191f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:26.018829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176fc8-a894-4afa-be3a-267400191f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:26.019562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176fc8-a894-4afa-be3a-267400191f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:26.021157 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176fc8-a894-4afa-be3a-267400191f15 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:26.033865 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1293/2583] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:26.037978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb83b97-db0b-4f90-a61c-d96402fb5db3 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:26.048453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb83b97-db0b-4f90-a61c-d96402fb5db3 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:26.053753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34006b2-1f65-4b5e-bb65-a1bb4386fb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:26.054647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34006b2-1f65-4b5e-bb65-a1bb4386fb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:26.054918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34006b2-1f65-4b5e-bb65-a1bb4386fb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:26.055186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34006b2-1f65-4b5e-bb65-a1bb4386fb48 admin admin] PATH_INFO: `/v3/projects/90876f3969894f56984bec10f782fa6c/users/6f467f44bf7b47e78fd298744819773d/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:26.058734 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:26.072526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34006b2-1f65-4b5e-bb65-a1bb4386fb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90876f3969894f56984bec10f782fa6c, user_id=6f467f44bf7b47e78fd298744819773d, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:26.075252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34006b2-1f65-4b5e-bb65-a1bb4386fb48 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:26.090331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1291/2584] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:26 2022] PUT /identity/v3/projects/90876f3969894f56984bec10f782fa6c/users/6f467f44bf7b47e78fd298744819773d/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:26.094554 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176fc8-a894-4afa-be3a-267400191f15 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:26.106241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176fc8-a894-4afa-be3a-267400191f15 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:26.174566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df340236-0198-42b4-8875-b6ade793950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:26.175249 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df340236-0198-42b4-8875-b6ade793950d admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:26.175532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df340236-0198-42b4-8875-b6ade793950d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:26.175809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df340236-0198-42b4-8875-b6ade793950d admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:26.176543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df340236-0198-42b4-8875-b6ade793950d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:26.178222 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df340236-0198-42b4-8875-b6ade793950d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:26.190327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1294/2585] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:26.194667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34006b2-1f65-4b5e-bb65-a1bb4386fb48 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:26.206308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34006b2-1f65-4b5e-bb65-a1bb4386fb48 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:26.211418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a4418-e518-4387-86ff-0a5ba31467e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:26.212391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4418-e518-4387-86ff-0a5ba31467e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:26.212682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4418-e518-4387-86ff-0a5ba31467e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:26.213067 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4418-e518-4387-86ff-0a5ba31467e9 admin admin] PATH_INFO: `/v3/projects/90876f3969894f56984bec10f782fa6c/users/6f467f44bf7b47e78fd298744819773d/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:26.215091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a4418-e518-4387-86ff-0a5ba31467e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90876f3969894f56984bec10f782fa6c, user_id=6f467f44bf7b47e78fd298744819773d, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:26.217920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a4418-e518-4387-86ff-0a5ba31467e9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:26.229456 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1292/2586] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:26 2022] PUT /identity/v3/projects/90876f3969894f56984bec10f782fa6c/users/6f467f44bf7b47e78fd298744819773d/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:26.241149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e06ab-29c7-4ec1-b508-0c3842ab6b8c None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:26.241581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e06ab-29c7-4ec1-b508-0c3842ab6b8c None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:26.241968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e06ab-29c7-4ec1-b508-0c3842ab6b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:26.282103 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a90e06ab-29c7-4ec1-b508-0c3842ab6b8c None None] MFA Rules not processed for user `6f467f44bf7b47e78fd298744819773d`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:26.283359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a90e06ab-29c7-4ec1-b508-0c3842ab6b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:26.370406 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1295/2587] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:26.383453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a4418-e518-4387-86ff-0a5ba31467e9 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:26.385733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c54a4418-e518-4387-86ff-0a5ba31467e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:26.454044 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a4418-e518-4387-86ff-0a5ba31467e9 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:26.458469 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386020b-b199-40d6-8e1c-d2575db06a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:26.459138 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386020b-b199-40d6-8e1c-d2575db06a6f service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:26.459422 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386020b-b199-40d6-8e1c-d2575db06a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:26.459699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386020b-b199-40d6-8e1c-d2575db06a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:26.469559 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386020b-b199-40d6-8e1c-d2575db06a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:26.471053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386020b-b199-40d6-8e1c-d2575db06a6f service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:26.482642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1293/2588] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:26.837990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e06ab-29c7-4ec1-b508-0c3842ab6b8c None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:26.839818 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a90e06ab-29c7-4ec1-b508-0c3842ab6b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:26.872701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386020b-b199-40d6-8e1c-d2575db06a6f service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:26.880881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:26.920855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e06ab-29c7-4ec1-b508-0c3842ab6b8c None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:26.925915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d788bc-577b-4bc1-bace-e2df5cfdbe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:26.926815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d788bc-577b-4bc1-bace-e2df5cfdbe4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:26.927112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d788bc-577b-4bc1-bace-e2df5cfdbe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:26.927389 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d788bc-577b-4bc1-bace-e2df5cfdbe4c admin admin] PATH_INFO: `/v3/users/ee152608c65d44d2a96fc96c1da753ef` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:26.928600 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d788bc-577b-4bc1-bace-e2df5cfdbe4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee152608c65d44d2a96fc96c1da753ef)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:26.930577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d788bc-577b-4bc1-bace-e2df5cfdbe4c admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:26.962009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386020b-b199-40d6-8e1c-d2575db06a6f service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:26.970975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:26.971918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:26.972202 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:26.972483 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] PATH_INFO: `/v3/users/8224838b43ce4b7c9715699dd0df6c77` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:26.975684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8224838b43ce4b7c9715699dd0df6c77)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:26.979199 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:26.993474 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-79d788bc-577b-4bc1-bace-e2df5cfdbe4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee152608c65d44d2a96fc96c1da753ef'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:26.994163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-79d788bc-577b-4bc1-bace-e2df5cfdbe4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee152608c65d44d2a96fc96c1da753ef'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:26.994764 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-79d788bc-577b-4bc1-bace-e2df5cfdbe4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee152608c65d44d2a96fc96c1da753ef'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.003258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-79d788bc-577b-4bc1-bace-e2df5cfdbe4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee152608c65d44d2a96fc96c1da753ef'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.015973 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-79d788bc-577b-4bc1-bace-e2df5cfdbe4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee152608c65d44d2a96fc96c1da753ef'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.038161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1296/2589] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:26 2022] DELETE /identity/v3/users/ee152608c65d44d2a96fc96c1da753ef => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:27.044946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8224838b43ce4b7c9715699dd0df6c77'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.045645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8224838b43ce4b7c9715699dd0df6c77'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.046264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8224838b43ce4b7c9715699dd0df6c77'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.053809 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8224838b43ce4b7c9715699dd0df6c77'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.063224 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8224838b43ce4b7c9715699dd0df6c77'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.076519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:27.088877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1294/2590] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:26 2022] DELETE /identity/v3/users/8224838b43ce4b7c9715699dd0df6c77 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:27.094228 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ed5f-8790-4580-b677-04b51bdc1a34 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:27.095358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ed5f-8790-4580-b677-04b51bdc1a34 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:27.095802 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ed5f-8790-4580-b677-04b51bdc1a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:27.121306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-90d2ed5f-8790-4580-b677-04b51bdc1a34 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:27.122541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-90d2ed5f-8790-4580-b677-04b51bdc1a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:27.191799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1297/2591] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:27.202327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:27.203364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:27.236688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2ed5f-8790-4580-b677-04b51bdc1a34 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:27.238437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-90d2ed5f-8790-4580-b677-04b51bdc1a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:27.255898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2ed5f-8790-4580-b677-04b51bdc1a34 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:27.268579 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:27.269504 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:27.270190 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:27.270472 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] PATH_INFO: `/v3/projects/6b930413b3bf488ebfb9d1533d7020b9` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:27.271222 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696abf3-d739-4e86-89da-9b98600e48c4 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:27.271671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b930413b3bf488ebfb9d1533d7020b9)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:27.273622 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:27.274877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb7b30-bf78-4843-bc65-3e17001bf119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:27.275543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb7b30-bf78-4843-bc65-3e17001bf119 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:27.275808 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb7b30-bf78-4843-bc65-3e17001bf119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:27.276088 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb7b30-bf78-4843-bc65-3e17001bf119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:27.285766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb7b30-bf78-4843-bc65-3e17001bf119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:27.287507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb7b30-bf78-4843-bc65-3e17001bf119 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:27.297778 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1295/2592] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:27.316503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:27.323502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b930413b3bf488ebfb9d1533d7020b9', 'request_id': 'req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.331298 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b930413b3bf488ebfb9d1533d7020b9', 'request_id': 'req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.340247 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b930413b3bf488ebfb9d1533d7020b9', 'request_id': 'req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.352202 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] The token cache is being invalidate because project 6b930413b3bf488ebfb9d1533d7020b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:27.352507 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.353174 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.354889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1298/2593] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:27 2022] DELETE /identity/v3/projects/6b930413b3bf488ebfb9d1533d7020b9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:27.358858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb7b30-bf78-4843-bc65-3e17001bf119 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:27.369192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb7b30-bf78-4843-bc65-3e17001bf119 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:27.434032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:27.434959 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:27.435241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:27.435521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] PATH_INFO: `/v3/users/db15a42a0c5b4b569901ca5ac029e540` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:27.436737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=db15a42a0c5b4b569901ca5ac029e540)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:27.439151 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:27.504501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db15a42a0c5b4b569901ca5ac029e540'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.505699 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db15a42a0c5b4b569901ca5ac029e540'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.506599 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db15a42a0c5b4b569901ca5ac029e540'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.518969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db15a42a0c5b4b569901ca5ac029e540'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.530454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db15a42a0c5b4b569901ca5ac029e540'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.552024 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1296/2594] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:27 2022] DELETE /identity/v3/users/db15a42a0c5b4b569901ca5ac029e540 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:27.638497 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:27.640130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:27.657198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d34c90-7698-49cc-ac9a-998dc94c0ab9 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:27.731742 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:27.732834 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:27.733123 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:27.733578 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] PATH_INFO: `/v3/projects/c06047f47b2d49238e0d285d0be466c6` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:27.734998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06047f47b2d49238e0d285d0be466c6)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:27.737086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:27.749775 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:27.751497 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:27.770651 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d055f-28e1-44bc-8572-65a0276d79eb admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:27.790519 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911233bd-75d8-407a-895a-ce896bf39faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:27.791584 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911233bd-75d8-407a-895a-ce896bf39faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:27.791942 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911233bd-75d8-407a-895a-ce896bf39faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:27.792285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911233bd-75d8-407a-895a-ce896bf39faa admin admin] PATH_INFO: `/v3/projects/bee000e7237d401faf18442685ce3dfa` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:27.793625 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911233bd-75d8-407a-895a-ce896bf39faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee000e7237d401faf18442685ce3dfa)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:27.795722 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911233bd-75d8-407a-895a-ce896bf39faa admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:27.795891 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06047f47b2d49238e0d285d0be466c6', 'request_id': 'req-66b561b2-c72c-457f-b6a8-6b04a844e78d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.801599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06047f47b2d49238e0d285d0be466c6', 'request_id': 'req-66b561b2-c72c-457f-b6a8-6b04a844e78d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.809258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:27.811392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06047f47b2d49238e0d285d0be466c6', 'request_id': 'req-66b561b2-c72c-457f-b6a8-6b04a844e78d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.823804 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] The token cache is being invalidate because project c06047f47b2d49238e0d285d0be466c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:27.824093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.824736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.826344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1299/2595] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:27 2022] DELETE /identity/v3/projects/c06047f47b2d49238e0d285d0be466c6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:27.830439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:27.832288 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:27.852604 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-911233bd-75d8-407a-895a-ce896bf39faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee000e7237d401faf18442685ce3dfa', 'request_id': 'req-911233bd-75d8-407a-895a-ce896bf39faa'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.860965 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-911233bd-75d8-407a-895a-ce896bf39faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee000e7237d401faf18442685ce3dfa', 'request_id': 'req-911233bd-75d8-407a-895a-ce896bf39faa'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.867123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-911233bd-75d8-407a-895a-ce896bf39faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee000e7237d401faf18442685ce3dfa', 'request_id': 'req-911233bd-75d8-407a-895a-ce896bf39faa'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.880258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-911233bd-75d8-407a-895a-ce896bf39faa admin admin] The token cache is being invalidate because project bee000e7237d401faf18442685ce3dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:27.880543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-911233bd-75d8-407a-895a-ce896bf39faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.881452 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-911233bd-75d8-407a-895a-ce896bf39faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:27.883089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1297/2596] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:27 2022] DELETE /identity/v3/projects/bee000e7237d401faf18442685ce3dfa => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:27.887925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3f5d5-e082-4c3d-84c0-82bd126c8621 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:27.888212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3f5d5-e082-4c3d-84c0-82bd126c8621 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:27.888495 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3f5d5-e082-4c3d-84c0-82bd126c8621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:27.907119 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e4b3f5d5-e082-4c3d-84c0-82bd126c8621 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:27.908115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b561b2-c72c-457f-b6a8-6b04a844e78d admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:27.908595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e4b3f5d5-e082-4c3d-84c0-82bd126c8621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:27.912137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:27.972525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:27.973484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:27.973731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:27.974011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] PATH_INFO: `/v3/users/6f467f44bf7b47e78fd298744819773d` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:27.974471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1298/2597] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:27.975272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f467f44bf7b47e78fd298744819773d)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:27.977228 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:27.982394 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d13b2-d3fc-4d14-a1fc-ec840d8e1df9 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:27.982664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d13b2-d3fc-4d14-a1fc-ec840d8e1df9 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:27.982953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d13b2-d3fc-4d14-a1fc-ec840d8e1df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.001277 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-6b0d13b2-d3fc-4d14-a1fc-ec840d8e1df9 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:28.002544 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6b0d13b2-d3fc-4d14-a1fc-ec840d8e1df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:28.013091 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1299/2598] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:28.017894 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d13b2-d3fc-4d14-a1fc-ec840d8e1df9 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.027780 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d13b2-d3fc-4d14-a1fc-ec840d8e1df9 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.031013 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f467f44bf7b47e78fd298744819773d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:28.031713 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f467f44bf7b47e78fd298744819773d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:28.032377 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f467f44bf7b47e78fd298744819773d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:28.032745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16260ac-814e-475c-aeea-b90490d37750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.033486 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16260ac-814e-475c-aeea-b90490d37750 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.033772 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16260ac-814e-475c-aeea-b90490d37750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.034054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16260ac-814e-475c-aeea-b90490d37750 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.034791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16260ac-814e-475c-aeea-b90490d37750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:28.035103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16260ac-814e-475c-aeea-b90490d37750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.036753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16260ac-814e-475c-aeea-b90490d37750 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.039792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f467f44bf7b47e78fd298744819773d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:28.047432 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f467f44bf7b47e78fd298744819773d'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:28.050130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1300/2599] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:27:28.054585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16260ac-814e-475c-aeea-b90490d37750 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.056291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e16260ac-814e-475c-aeea-b90490d37750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:28.066361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1300/2600] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:27 2022] DELETE /identity/v3/users/6f467f44bf7b47e78fd298744819773d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:28.071917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16260ac-814e-475c-aeea-b90490d37750 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.149120 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a648b7-fec3-4afb-ba73-4e99365c01cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.149924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a648b7-fec3-4afb-ba73-4e99365c01cf admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.150208 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a648b7-fec3-4afb-ba73-4e99365c01cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.150533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a648b7-fec3-4afb-ba73-4e99365c01cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.151232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a648b7-fec3-4afb-ba73-4e99365c01cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.153203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a648b7-fec3-4afb-ba73-4e99365c01cf admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.183054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1301/2601] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:28 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:28.189184 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.200571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfdd91-594b-4fa8-9457-129159f56367 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.290436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a16fd-54f6-4534-a406-c065adcf8dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.293028 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a16fd-54f6-4534-a406-c065adcf8dab admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.293394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a16fd-54f6-4534-a406-c065adcf8dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.293824 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a16fd-54f6-4534-a406-c065adcf8dab admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.294584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a16fd-54f6-4534-a406-c065adcf8dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.296755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a16fd-54f6-4534-a406-c065adcf8dab admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.320864 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1301/2602] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:28 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:28.325885 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a648b7-fec3-4afb-ba73-4e99365c01cf admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.334558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:28.339966 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a648b7-fec3-4afb-ba73-4e99365c01cf admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.348464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71288a87-3a9c-4a86-aa4b-db1cafd5f014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.349649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71288a87-3a9c-4a86-aa4b-db1cafd5f014 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.350440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71288a87-3a9c-4a86-aa4b-db1cafd5f014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.350819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71288a87-3a9c-4a86-aa4b-db1cafd5f014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.351707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71288a87-3a9c-4a86-aa4b-db1cafd5f014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.354023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71288a87-3a9c-4a86-aa4b-db1cafd5f014 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.369147 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1302/2603] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:28.373496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a16fd-54f6-4534-a406-c065adcf8dab admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.385077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a16fd-54f6-4534-a406-c065adcf8dab admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.394887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fb71a-b75c-433a-98e7-a226d7ac1665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.395604 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fb71a-b75c-433a-98e7-a226d7ac1665 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.395890 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fb71a-b75c-433a-98e7-a226d7ac1665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.396166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fb71a-b75c-433a-98e7-a226d7ac1665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.396948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fb71a-b75c-433a-98e7-a226d7ac1665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.397432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71288a87-3a9c-4a86-aa4b-db1cafd5f014 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.398668 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fb71a-b75c-433a-98e7-a226d7ac1665 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.399926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-71288a87-3a9c-4a86-aa4b-db1cafd5f014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:28.421639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71288a87-3a9c-4a86-aa4b-db1cafd5f014 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.426151 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1302/2604] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:28.428568 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fb71a-b75c-433a-98e7-a226d7ac1665 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.429353 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706901bf-3f39-47dd-a325-7027a80df4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.430342 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706901bf-3f39-47dd-a325-7027a80df4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.430690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706901bf-3f39-47dd-a325-7027a80df4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.431041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706901bf-3f39-47dd-a325-7027a80df4dc admin admin] PATH_INFO: `/v3/projects/90876f3969894f56984bec10f782fa6c` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.432643 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706901bf-3f39-47dd-a325-7027a80df4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=90876f3969894f56984bec10f782fa6c)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.434616 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706901bf-3f39-47dd-a325-7027a80df4dc admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.436381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:28.440507 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fb71a-b75c-433a-98e7-a226d7ac1665 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.447566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe5acd-dbe8-47b6-8157-f0b82959bfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.448621 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe5acd-dbe8-47b6-8157-f0b82959bfee admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.449180 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe5acd-dbe8-47b6-8157-f0b82959bfee admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.449629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe5acd-dbe8-47b6-8157-f0b82959bfee admin admin] PATH_INFO: `/v3/projects/10c181ac6f4444e89d5c2b309cc8756f/users/162c8c3937dc4a05bde3ed709fccdb53/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.465950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe5acd-dbe8-47b6-8157-f0b82959bfee admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c181ac6f4444e89d5c2b309cc8756f, user_id=162c8c3937dc4a05bde3ed709fccdb53, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.468651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe5acd-dbe8-47b6-8157-f0b82959bfee admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.483076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1303/2605] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:28 2022] PUT /identity/v3/projects/10c181ac6f4444e89d5c2b309cc8756f/users/162c8c3937dc4a05bde3ed709fccdb53/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:28.494859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53a8e3-d0f8-4213-9b5f-0cd75fe873e3 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.495068 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-706901bf-3f39-47dd-a325-7027a80df4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90876f3969894f56984bec10f782fa6c', 'request_id': 'req-706901bf-3f39-47dd-a325-7027a80df4dc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:28.495188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53a8e3-d0f8-4213-9b5f-0cd75fe873e3 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.495414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53a8e3-d0f8-4213-9b5f-0cd75fe873e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.503475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-706901bf-3f39-47dd-a325-7027a80df4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90876f3969894f56984bec10f782fa6c', 'request_id': 'req-706901bf-3f39-47dd-a325-7027a80df4dc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:28.509385 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-706901bf-3f39-47dd-a325-7027a80df4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90876f3969894f56984bec10f782fa6c', 'request_id': 'req-706901bf-3f39-47dd-a325-7027a80df4dc'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:28.520998 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-706901bf-3f39-47dd-a325-7027a80df4dc admin admin] The token cache is being invalidate because project 90876f3969894f56984bec10f782fa6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:28.521332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-706901bf-3f39-47dd-a325-7027a80df4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:28.522022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-706901bf-3f39-47dd-a325-7027a80df4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:28.523634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1303/2606] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:28 2022] DELETE /identity/v3/projects/90876f3969894f56984bec10f782fa6c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:28.525999 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ac53a8e3-d0f8-4213-9b5f-0cd75fe873e3 None None] MFA Rules not processed for user `162c8c3937dc4a05bde3ed709fccdb53`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:28.527327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ac53a8e3-d0f8-4213-9b5f-0cd75fe873e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:28.528437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db45062-2d00-4868-acf0-5cb79494d520 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.528731 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db45062-2d00-4868-acf0-5cb79494d520 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.529013 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db45062-2d00-4868-acf0-5cb79494d520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.546721 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0db45062-2d00-4868-acf0-5cb79494d520 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:28.548046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0db45062-2d00-4868-acf0-5cb79494d520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:28.591963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1304/2607] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:28.597082 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53a8e3-d0f8-4213-9b5f-0cd75fe873e3 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.598690 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ac53a8e3-d0f8-4213-9b5f-0cd75fe873e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:28.607602 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1304/2608] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:28.615823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9251caf-541c-429a-9284-d93b5cad90a6 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.616117 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9251caf-541c-429a-9284-d93b5cad90a6 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.616403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9251caf-541c-429a-9284-d93b5cad90a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.636099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-b9251caf-541c-429a-9284-d93b5cad90a6 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:28.637335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b9251caf-541c-429a-9284-d93b5cad90a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:28.645669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1305/2609] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:28.650069 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9251caf-541c-429a-9284-d93b5cad90a6 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.660044 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9251caf-541c-429a-9284-d93b5cad90a6 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.664827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341c782-0a65-4431-84a9-13a9627dd127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.665324 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53a8e3-d0f8-4213-9b5f-0cd75fe873e3 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.665518 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341c782-0a65-4431-84a9-13a9627dd127 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.665804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341c782-0a65-4431-84a9-13a9627dd127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.666086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341c782-0a65-4431-84a9-13a9627dd127 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.666821 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341c782-0a65-4431-84a9-13a9627dd127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:28.667132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341c782-0a65-4431-84a9-13a9627dd127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.668741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341c782-0a65-4431-84a9-13a9627dd127 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.670022 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754489c7-9efe-4d97-90b9-25f518cd5ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.670657 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754489c7-9efe-4d97-90b9-25f518cd5ead admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.670937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754489c7-9efe-4d97-90b9-25f518cd5ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.671233 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754489c7-9efe-4d97-90b9-25f518cd5ead admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.671982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754489c7-9efe-4d97-90b9-25f518cd5ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.673936 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754489c7-9efe-4d97-90b9-25f518cd5ead admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.681736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1306/2610] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:27:28.686381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341c782-0a65-4431-84a9-13a9627dd127 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.698152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341c782-0a65-4431-84a9-13a9627dd127 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.704706 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1305/2611] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:28 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:28.704859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb11ddf-1dc6-4cbd-b457-1b9df515d858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.704859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11ddf-1dc6-4cbd-b457-1b9df515d858 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.704859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11ddf-1dc6-4cbd-b457-1b9df515d858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.704859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11ddf-1dc6-4cbd-b457-1b9df515d858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.705498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb11ddf-1dc6-4cbd-b457-1b9df515d858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.705807 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754489c7-9efe-4d97-90b9-25f518cd5ead admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.707568 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb11ddf-1dc6-4cbd-b457-1b9df515d858 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.736233 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1307/2612] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:28 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:28.740241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb11ddf-1dc6-4cbd-b457-1b9df515d858 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.767755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:28.776619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754489c7-9efe-4d97-90b9-25f518cd5ead admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.780046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:28.807635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb11ddf-1dc6-4cbd-b457-1b9df515d858 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.813497 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab5069-b84f-43da-9445-bb5259aa87d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.814185 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab5069-b84f-43da-9445-bb5259aa87d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.814465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab5069-b84f-43da-9445-bb5259aa87d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.814740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab5069-b84f-43da-9445-bb5259aa87d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.815562 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab5069-b84f-43da-9445-bb5259aa87d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.817763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab5069-b84f-43da-9445-bb5259aa87d9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.841917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1308/2613] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:28 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:28.843527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab5069-b84f-43da-9445-bb5259aa87d9 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.843695 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758779fc-a9a7-45d2-9b45-5cc9db3877db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.844196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758779fc-a9a7-45d2-9b45-5cc9db3877db admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.844485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758779fc-a9a7-45d2-9b45-5cc9db3877db admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.844763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758779fc-a9a7-45d2-9b45-5cc9db3877db admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.845485 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758779fc-a9a7-45d2-9b45-5cc9db3877db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.847414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758779fc-a9a7-45d2-9b45-5cc9db3877db admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.855006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab5069-b84f-43da-9445-bb5259aa87d9 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.861479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848adde9-ec78-4c43-89f8-a4014c589401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.862240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848adde9-ec78-4c43-89f8-a4014c589401 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.862516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848adde9-ec78-4c43-89f8-a4014c589401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.862819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848adde9-ec78-4c43-89f8-a4014c589401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.863561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848adde9-ec78-4c43-89f8-a4014c589401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.865327 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848adde9-ec78-4c43-89f8-a4014c589401 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.871495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1306/2614] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:28 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:28.875557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758779fc-a9a7-45d2-9b45-5cc9db3877db admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.876425 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1309/2615] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:27:28.880282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848adde9-ec78-4c43-89f8-a4014c589401 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.886335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758779fc-a9a7-45d2-9b45-5cc9db3877db admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.890554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848adde9-ec78-4c43-89f8-a4014c589401 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.892383 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cae09b-a8b9-4407-98db-2625ccf3579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.893051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cae09b-a8b9-4407-98db-2625ccf3579d admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.893427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cae09b-a8b9-4407-98db-2625ccf3579d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.893729 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cae09b-a8b9-4407-98db-2625ccf3579d admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.894458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cae09b-a8b9-4407-98db-2625ccf3579d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.895851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf57ff-f94e-441e-9160-4c52d01a48ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.896142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cae09b-a8b9-4407-98db-2625ccf3579d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.896571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf57ff-f94e-441e-9160-4c52d01a48ce admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.896838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf57ff-f94e-441e-9160-4c52d01a48ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.897089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf57ff-f94e-441e-9160-4c52d01a48ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.897836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf57ff-f94e-441e-9160-4c52d01a48ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.899403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf57ff-f94e-441e-9160-4c52d01a48ce admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.910024 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1307/2616] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:27:28.910675 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1310/2617] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:28.911130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cae09b-a8b9-4407-98db-2625ccf3579d admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.914422 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf57ff-f94e-441e-9160-4c52d01a48ce admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.922104 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cae09b-a8b9-4407-98db-2625ccf3579d admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.924200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf57ff-f94e-441e-9160-4c52d01a48ce admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:28.927680 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6a76f-1eeb-461a-bdb0-11c8e7a53cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.928582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6a76f-1eeb-461a-bdb0-11c8e7a53cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.928874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6a76f-1eeb-461a-bdb0-11c8e7a53cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.929142 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6a76f-1eeb-461a-bdb0-11c8e7a53cfa admin admin] PATH_INFO: `/v3/projects/66b3bc17b0264596b6c3a9221a0784fe/users/0846bc67fdfb4a97b438240931b48617/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.929643 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23914d-223f-4fd9-ad15-873db2ae7c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:28.930614 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23914d-223f-4fd9-ad15-873db2ae7c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.930955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23914d-223f-4fd9-ad15-873db2ae7c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.931294 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23914d-223f-4fd9-ad15-873db2ae7c39 admin admin] PATH_INFO: `/v3/projects/86a85c1efe6445dfb5baaf296d174289/users/47e28a8b6cb749eaa51ec547b945dfd2/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:28.945380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6a76f-1eeb-461a-bdb0-11c8e7a53cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b3bc17b0264596b6c3a9221a0784fe, user_id=0846bc67fdfb4a97b438240931b48617, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.946135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23914d-223f-4fd9-ad15-873db2ae7c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a85c1efe6445dfb5baaf296d174289, user_id=47e28a8b6cb749eaa51ec547b945dfd2, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:28.948047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6a76f-1eeb-461a-bdb0-11c8e7a53cfa admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.948757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23914d-223f-4fd9-ad15-873db2ae7c39 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:28.962896 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1308/2618] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:28 2022] PUT /identity/v3/projects/66b3bc17b0264596b6c3a9221a0784fe/users/0846bc67fdfb4a97b438240931b48617/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:28.963658 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1311/2619] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:28 2022] PUT /identity/v3/projects/86a85c1efe6445dfb5baaf296d174289/users/47e28a8b6cb749eaa51ec547b945dfd2/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:28.967058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6a76f-1eeb-461a-bdb0-11c8e7a53cfa admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:28.976869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c23fa9-3c4d-4c80-beb9-e4662781ad21 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:28.977209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c23fa9-3c4d-4c80-beb9-e4662781ad21 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:28.977529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c23fa9-3c4d-4c80-beb9-e4662781ad21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:29.003511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-62c23fa9-3c4d-4c80-beb9-e4662781ad21 None None] MFA Rules not processed for user `47e28a8b6cb749eaa51ec547b945dfd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:29.004727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-62c23fa9-3c4d-4c80-beb9-e4662781ad21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:29.031217 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6a76f-1eeb-461a-bdb0-11c8e7a53cfa admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:29.072066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1312/2620] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:27:29.083608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c23fa9-3c4d-4c80-beb9-e4662781ad21 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:29.085066 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-62c23fa9-3c4d-4c80-beb9-e4662781ad21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:29.091415 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bea2f8-d47e-474f-9e77-cddebb76111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:29.092099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bea2f8-d47e-474f-9e77-cddebb76111d admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:29.092385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bea2f8-d47e-474f-9e77-cddebb76111d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:29.092650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bea2f8-d47e-474f-9e77-cddebb76111d admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:29.093516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bea2f8-d47e-474f-9e77-cddebb76111d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:29.095537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bea2f8-d47e-474f-9e77-cddebb76111d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:29.100918 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:29.109573 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1309/2621] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:27:29.111256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bea2f8-d47e-474f-9e77-cddebb76111d admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:29.121642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bea2f8-d47e-474f-9e77-cddebb76111d admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:29.127443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f562c1-0bc0-4325-a589-43cd27060301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:29.128344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f562c1-0bc0-4325-a589-43cd27060301 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:29.128631 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f562c1-0bc0-4325-a589-43cd27060301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:29.128914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f562c1-0bc0-4325-a589-43cd27060301 admin admin] PATH_INFO: `/v3/projects/66b3bc17b0264596b6c3a9221a0784fe/users/0846bc67fdfb4a97b438240931b48617/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:29.131076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f562c1-0bc0-4325-a589-43cd27060301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b3bc17b0264596b6c3a9221a0784fe, user_id=0846bc67fdfb4a97b438240931b48617, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:29.133812 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f562c1-0bc0-4325-a589-43cd27060301 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:29.145975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1310/2622] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:29 2022] PUT /identity/v3/projects/66b3bc17b0264596b6c3a9221a0784fe/users/0846bc67fdfb4a97b438240931b48617/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:29.152458 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c23fa9-3c4d-4c80-beb9-e4662781ad21 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:29.160484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10549e27-27bb-4bd0-8032-20d5f57bff91 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:29.161530 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10549e27-27bb-4bd0-8032-20d5f57bff91 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:29.161815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10549e27-27bb-4bd0-8032-20d5f57bff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:29.174012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:29.195570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-10549e27-27bb-4bd0-8032-20d5f57bff91 None None] MFA Rules not processed for user `0846bc67fdfb4a97b438240931b48617`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:29.196819 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-10549e27-27bb-4bd0-8032-20d5f57bff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:29.207591 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc5fab-8b5b-46b7-a140-d72afe1116bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:29.208229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc5fab-8b5b-46b7-a140-d72afe1116bc service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:29.208533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc5fab-8b5b-46b7-a140-d72afe1116bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:29.208806 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc5fab-8b5b-46b7-a140-d72afe1116bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:29.271462 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc5fab-8b5b-46b7-a140-d72afe1116bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:29.272379 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1311/2623] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:29.272992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc5fab-8b5b-46b7-a140-d72afe1116bc service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:29.286474 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1313/2624] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:29.287712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10549e27-27bb-4bd0-8032-20d5f57bff91 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:29.289497 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-10549e27-27bb-4bd0-8032-20d5f57bff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:29.302334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10549e27-27bb-4bd0-8032-20d5f57bff91 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:29.306110 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a33eda-087c-497c-a255-bdf64b81b0e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:29.306754 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a33eda-087c-497c-a255-bdf64b81b0e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:29.307027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a33eda-087c-497c-a255-bdf64b81b0e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:29.307661 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a33eda-087c-497c-a255-bdf64b81b0e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:29.318250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a33eda-087c-497c-a255-bdf64b81b0e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:29.319704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a33eda-087c-497c-a255-bdf64b81b0e2 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:29.329921 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1312/2625] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:29.784850 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc5fab-8b5b-46b7-a140-d72afe1116bc service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:29.858979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc5fab-8b5b-46b7-a140-d72afe1116bc service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:29.864652 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:29.865499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:29.865784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:29.866050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] PATH_INFO: `/v3/users/162c8c3937dc4a05bde3ed709fccdb53` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:29.867398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] RBAC: Authorizing `identity:delete_user(user_id=162c8c3937dc4a05bde3ed709fccdb53)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:29.870081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:29.920042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162c8c3937dc4a05bde3ed709fccdb53'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:29.920706 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162c8c3937dc4a05bde3ed709fccdb53'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:29.921338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162c8c3937dc4a05bde3ed709fccdb53'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:29.928188 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162c8c3937dc4a05bde3ed709fccdb53'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:29.937930 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162c8c3937dc4a05bde3ed709fccdb53'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:29.955835 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:29.963123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1314/2626] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:29 2022] DELETE /identity/v3/users/162c8c3937dc4a05bde3ed709fccdb53 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:29.967892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2cf77-6551-4f92-ae06-a894ba29bcd7 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:29.968419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2cf77-6551-4f92-ae06-a894ba29bcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:29.968513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2cf77-6551-4f92-ae06-a894ba29bcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:29.986008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-6ae2cf77-6551-4f92-ae06-a894ba29bcd7 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:29.987258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6ae2cf77-6551-4f92-ae06-a894ba29bcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:30.054097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1313/2627] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:30.066180 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:30.067888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:30.138902 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955abc26-7a5d-4ec4-9687-75f912f1924f admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:30.143092 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccad47-8287-4390-a944-dc7e3bad277c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:30.143741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccad47-8287-4390-a944-dc7e3bad277c service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:30.144025 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccad47-8287-4390-a944-dc7e3bad277c service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:30.144329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccad47-8287-4390-a944-dc7e3bad277c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:30.153923 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccad47-8287-4390-a944-dc7e3bad277c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:30.155364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccad47-8287-4390-a944-dc7e3bad277c service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:30.165177 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1315/2628] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:30.443728 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2cf77-6551-4f92-ae06-a894ba29bcd7 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:30.445570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6ae2cf77-6551-4f92-ae06-a894ba29bcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:30.459120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2cf77-6551-4f92-ae06-a894ba29bcd7 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:30.464714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:30.465646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:30.465926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:30.466201 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] PATH_INFO: `/v3/projects/10c181ac6f4444e89d5c2b309cc8756f` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:30.467516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c181ac6f4444e89d5c2b309cc8756f)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:30.469490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:30.517994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c181ac6f4444e89d5c2b309cc8756f', 'request_id': 'req-1f93048e-f8d6-4836-a80b-f517623d48af'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:30.521875 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:30.523920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c181ac6f4444e89d5c2b309cc8756f', 'request_id': 'req-1f93048e-f8d6-4836-a80b-f517623d48af'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:30.532451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c181ac6f4444e89d5c2b309cc8756f', 'request_id': 'req-1f93048e-f8d6-4836-a80b-f517623d48af'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:30.544375 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] The token cache is being invalidate because project 10c181ac6f4444e89d5c2b309cc8756f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:30.544775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:30.545436 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:30.546955 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1314/2629] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:30 2022] DELETE /identity/v3/projects/10c181ac6f4444e89d5c2b309cc8756f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:30.551168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccad47-8287-4390-a944-dc7e3bad277c service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:30.561707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccad47-8287-4390-a944-dc7e3bad277c service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:30.621186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acef5de-5b58-4654-91f9-bb81550bac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:30.622112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acef5de-5b58-4654-91f9-bb81550bac17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:30.622383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acef5de-5b58-4654-91f9-bb81550bac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:30.622639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acef5de-5b58-4654-91f9-bb81550bac17 admin admin] PATH_INFO: `/v3/users/0846bc67fdfb4a97b438240931b48617` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:30.623907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acef5de-5b58-4654-91f9-bb81550bac17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0846bc67fdfb4a97b438240931b48617)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:30.626234 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acef5de-5b58-4654-91f9-bb81550bac17 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:30.684132 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5acef5de-5b58-4654-91f9-bb81550bac17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0846bc67fdfb4a97b438240931b48617'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:30.685127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5acef5de-5b58-4654-91f9-bb81550bac17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0846bc67fdfb4a97b438240931b48617'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:30.687496 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5acef5de-5b58-4654-91f9-bb81550bac17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0846bc67fdfb4a97b438240931b48617'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:30.695279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5acef5de-5b58-4654-91f9-bb81550bac17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0846bc67fdfb4a97b438240931b48617'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:30.705941 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5acef5de-5b58-4654-91f9-bb81550bac17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0846bc67fdfb4a97b438240931b48617'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:30.726820 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1316/2630] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:30 2022] DELETE /identity/v3/users/0846bc67fdfb4a97b438240931b48617 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:31.017872 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:31.019463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:31.034594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93048e-f8d6-4836-a80b-f517623d48af admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:31.097854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:31.098723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:31.099005 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:31.099275 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7 admin admin] PATH_INFO: `/v3/projects/66b3bc17b0264596b6c3a9221a0784fe` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:31.100525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b3bc17b0264596b6c3a9221a0784fe)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:31.102477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:31.152646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b3bc17b0264596b6c3a9221a0784fe', 'request_id': 'req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:31.160210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b3bc17b0264596b6c3a9221a0784fe', 'request_id': 'req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:31.169726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b3bc17b0264596b6c3a9221a0784fe', 'request_id': 'req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:31.181296 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7 admin admin] The token cache is being invalidate because project 66b3bc17b0264596b6c3a9221a0784fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:31.181581 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:31.182571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-54fd75a9-0bb6-482b-9ca2-bcdf17fe42f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:31.184116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1315/2631] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:31 2022] DELETE /identity/v3/projects/66b3bc17b0264596b6c3a9221a0784fe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:31.190369 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9261cfd-a719-4dfe-bffd-ef1660fdd5c5 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:31.190843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9261cfd-a719-4dfe-bffd-ef1660fdd5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:31.190939 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9261cfd-a719-4dfe-bffd-ef1660fdd5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:31.210143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-d9261cfd-a719-4dfe-bffd-ef1660fdd5c5 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:31.211398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d9261cfd-a719-4dfe-bffd-ef1660fdd5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:31.224985 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:31.277437 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1317/2632] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:31.285506 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7a5d1-c193-4d5f-836a-4f33bcda9dab None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:31.285826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7a5d1-c193-4d5f-836a-4f33bcda9dab None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:31.286105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7a5d1-c193-4d5f-836a-4f33bcda9dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:31.305736 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-19a7a5d1-c193-4d5f-836a-4f33bcda9dab None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:31.306947 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-19a7a5d1-c193-4d5f-836a-4f33bcda9dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:31.315419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1316/2633] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:31.319938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9261cfd-a719-4dfe-bffd-ef1660fdd5c5 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:31.331547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9261cfd-a719-4dfe-bffd-ef1660fdd5c5 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:31.336245 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6ba51-f7ce-491a-9082-6b5620a8c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:31.336932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6ba51-f7ce-491a-9082-6b5620a8c608 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:31.337178 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6ba51-f7ce-491a-9082-6b5620a8c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:31.337502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6ba51-f7ce-491a-9082-6b5620a8c608 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:31.338364 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6ba51-f7ce-491a-9082-6b5620a8c608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:31.338663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6ba51-f7ce-491a-9082-6b5620a8c608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:31.340359 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6ba51-f7ce-491a-9082-6b5620a8c608 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:31.354018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1318/2634] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:27:31.360358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7a5d1-c193-4d5f-836a-4f33bcda9dab None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:31.375000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7a5d1-c193-4d5f-836a-4f33bcda9dab None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:31.381053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762462f-6bf3-4f6c-8a3a-d58c819b33ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:31.381756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762462f-6bf3-4f6c-8a3a-d58c819b33ed admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:31.382038 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762462f-6bf3-4f6c-8a3a-d58c819b33ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:31.382311 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762462f-6bf3-4f6c-8a3a-d58c819b33ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:31.383010 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762462f-6bf3-4f6c-8a3a-d58c819b33ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:31.384949 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762462f-6bf3-4f6c-8a3a-d58c819b33ed admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:31.413386 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1317/2635] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:31 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:31.418400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6ba51-f7ce-491a-9082-6b5620a8c608 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:31.434451 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6ba51-f7ce-491a-9082-6b5620a8c608 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:31.499501 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f2a3b-7457-4292-876e-0aa1a0dc6630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:31.499989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f2a3b-7457-4292-876e-0aa1a0dc6630 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:31.500398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f2a3b-7457-4292-876e-0aa1a0dc6630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:31.500676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f2a3b-7457-4292-876e-0aa1a0dc6630 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:31.501424 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f2a3b-7457-4292-876e-0aa1a0dc6630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:31.503382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f2a3b-7457-4292-876e-0aa1a0dc6630 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:31.528252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1319/2636] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:31 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:31.532641 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762462f-6bf3-4f6c-8a3a-d58c819b33ed admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:31.543737 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762462f-6bf3-4f6c-8a3a-d58c819b33ed admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:31.549041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e610a9-b351-4ced-bc76-966186f423f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:31.549735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e610a9-b351-4ced-bc76-966186f423f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:31.550018 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e610a9-b351-4ced-bc76-966186f423f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:31.550297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e610a9-b351-4ced-bc76-966186f423f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:31.551031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e610a9-b351-4ced-bc76-966186f423f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:31.552651 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e610a9-b351-4ced-bc76-966186f423f1 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:31.564953 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1318/2637] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:31.569661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f2a3b-7457-4292-876e-0aa1a0dc6630 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:31.580459 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f2a3b-7457-4292-876e-0aa1a0dc6630 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:31.586216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db75e3-b5af-4d90-83f7-44bea73a6156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:31.586877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db75e3-b5af-4d90-83f7-44bea73a6156 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:31.587159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db75e3-b5af-4d90-83f7-44bea73a6156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:31.587431 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db75e3-b5af-4d90-83f7-44bea73a6156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:31.588151 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db75e3-b5af-4d90-83f7-44bea73a6156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:31.589801 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db75e3-b5af-4d90-83f7-44bea73a6156 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:31.600634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1320/2638] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:31.605041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e610a9-b351-4ced-bc76-966186f423f1 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:31.616366 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e610a9-b351-4ced-bc76-966186f423f1 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:31.622759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4c5a1-db51-4c8e-be52-111272dcbbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:31.623662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c5a1-db51-4c8e-be52-111272dcbbce admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:31.623938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c5a1-db51-4c8e-be52-111272dcbbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:31.624210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c5a1-db51-4c8e-be52-111272dcbbce admin admin] PATH_INFO: `/v3/projects/e4418bdb908249a49decb1fdc5d478d1/users/b98b2e7d8aa6424f905af2574687f7e7/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:31.641462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4c5a1-db51-4c8e-be52-111272dcbbce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4418bdb908249a49decb1fdc5d478d1, user_id=b98b2e7d8aa6424f905af2574687f7e7, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:31.644150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4c5a1-db51-4c8e-be52-111272dcbbce admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:31.660031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1319/2639] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:31 2022] PUT /identity/v3/projects/e4418bdb908249a49decb1fdc5d478d1/users/b98b2e7d8aa6424f905af2574687f7e7/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:31.671611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0255981-9750-4fa3-b42e-64f38c3788c2 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:31.671955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0255981-9750-4fa3-b42e-64f38c3788c2 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:31.672218 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0255981-9750-4fa3-b42e-64f38c3788c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:31.702814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-f0255981-9750-4fa3-b42e-64f38c3788c2 None None] MFA Rules not processed for user `b98b2e7d8aa6424f905af2574687f7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:31.704182 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f0255981-9750-4fa3-b42e-64f38c3788c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:31.772957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1321/2640] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:31.778392 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4c5a1-db51-4c8e-be52-111272dcbbce admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:31.797243 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:31.854743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4c5a1-db51-4c8e-be52-111272dcbbce admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:31.860477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905feade-4336-466d-8776-3211fc253dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:31.861161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905feade-4336-466d-8776-3211fc253dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:31.861483 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905feade-4336-466d-8776-3211fc253dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:31.861760 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905feade-4336-466d-8776-3211fc253dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:31.862450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905feade-4336-466d-8776-3211fc253dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:31.864502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905feade-4336-466d-8776-3211fc253dc8 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:31.895400 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1320/2641] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:31 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:31.899886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0255981-9750-4fa3-b42e-64f38c3788c2 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:31.912033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0255981-9750-4fa3-b42e-64f38c3788c2 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:31.928120 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:31.986071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035113f-5734-4ec6-8313-a913c2581238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:31.986758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035113f-5734-4ec6-8313-a913c2581238 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:31.987042 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035113f-5734-4ec6-8313-a913c2581238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:31.987322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035113f-5734-4ec6-8313-a913c2581238 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:31.988036 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035113f-5734-4ec6-8313-a913c2581238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:31.990044 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035113f-5734-4ec6-8313-a913c2581238 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:32.013426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1322/2642] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:31 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:32.017664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905feade-4336-466d-8776-3211fc253dc8 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:32.028455 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905feade-4336-466d-8776-3211fc253dc8 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:32.033198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328612d-9c98-438a-8f1b-0c7a25994964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:32.033893 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328612d-9c98-438a-8f1b-0c7a25994964 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:32.034178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328612d-9c98-438a-8f1b-0c7a25994964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:32.034460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328612d-9c98-438a-8f1b-0c7a25994964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:32.035192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328612d-9c98-438a-8f1b-0c7a25994964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:32.036839 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328612d-9c98-438a-8f1b-0c7a25994964 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:32.047909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1321/2643] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:32.052864 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035113f-5734-4ec6-8313-a913c2581238 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:32.066442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035113f-5734-4ec6-8313-a913c2581238 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:32.072070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafbefb-6ffc-4473-ab3d-33ed6cfb6cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:32.072954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbefb-6ffc-4473-ab3d-33ed6cfb6cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:32.073270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbefb-6ffc-4473-ab3d-33ed6cfb6cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:32.073571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbefb-6ffc-4473-ab3d-33ed6cfb6cbf admin admin] PATH_INFO: `/v3/projects/231cf2e6e7814ff3b9ed64042a4719f2/users/05609e9bad9948c4948a9ea19eff0938/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:32.089356 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafbefb-6ffc-4473-ab3d-33ed6cfb6cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=231cf2e6e7814ff3b9ed64042a4719f2, user_id=05609e9bad9948c4948a9ea19eff0938, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:32.092001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafbefb-6ffc-4473-ab3d-33ed6cfb6cbf admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:32.107797 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1323/2644] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:32 2022] PUT /identity/v3/projects/231cf2e6e7814ff3b9ed64042a4719f2/users/05609e9bad9948c4948a9ea19eff0938/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:32.112066 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328612d-9c98-438a-8f1b-0c7a25994964 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:32.123011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328612d-9c98-438a-8f1b-0c7a25994964 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:32.185272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ad6da-d95d-4662-9fd6-1f74ca45dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:32.185977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad6da-d95d-4662-9fd6-1f74ca45dd5d admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:32.186260 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad6da-d95d-4662-9fd6-1f74ca45dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:32.186543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad6da-d95d-4662-9fd6-1f74ca45dd5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:32.187276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ad6da-d95d-4662-9fd6-1f74ca45dd5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:32.189290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ad6da-d95d-4662-9fd6-1f74ca45dd5d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:32.200097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1322/2645] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:32.204410 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafbefb-6ffc-4473-ab3d-33ed6cfb6cbf admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:32.215637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafbefb-6ffc-4473-ab3d-33ed6cfb6cbf admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:32.220972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b47089-5236-4961-9c8d-c0db2b663ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:32.221907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b47089-5236-4961-9c8d-c0db2b663ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:32.222194 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b47089-5236-4961-9c8d-c0db2b663ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:32.222472 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b47089-5236-4961-9c8d-c0db2b663ffe admin admin] PATH_INFO: `/v3/projects/231cf2e6e7814ff3b9ed64042a4719f2/users/05609e9bad9948c4948a9ea19eff0938/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:32.224560 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b47089-5236-4961-9c8d-c0db2b663ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=231cf2e6e7814ff3b9ed64042a4719f2, user_id=05609e9bad9948c4948a9ea19eff0938, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:32.227257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b47089-5236-4961-9c8d-c0db2b663ffe admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:32.238664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1324/2646] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:32 2022] PUT /identity/v3/projects/231cf2e6e7814ff3b9ed64042a4719f2/users/05609e9bad9948c4948a9ea19eff0938/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:32.249460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1027e-b445-4ba1-8bc5-dc6267be8d34 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:32.249753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1027e-b445-4ba1-8bc5-dc6267be8d34 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:32.250175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1027e-b445-4ba1-8bc5-dc6267be8d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:32.278132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a1e1027e-b445-4ba1-8bc5-dc6267be8d34 None None] MFA Rules not processed for user `05609e9bad9948c4948a9ea19eff0938`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:32.279424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a1e1027e-b445-4ba1-8bc5-dc6267be8d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:32.366836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1323/2647] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:32.379956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b47089-5236-4961-9c8d-c0db2b663ffe admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:32.381997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-55b47089-5236-4961-9c8d-c0db2b663ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:32.443331 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b47089-5236-4961-9c8d-c0db2b663ffe admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:32.447994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb05624-a6dc-427d-aa56-b696022ccc6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:32.448719 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05624-a6dc-427d-aa56-b696022ccc6d service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:32.448992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05624-a6dc-427d-aa56-b696022ccc6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:32.449265 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05624-a6dc-427d-aa56-b696022ccc6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:32.459530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb05624-a6dc-427d-aa56-b696022ccc6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:32.460978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb05624-a6dc-427d-aa56-b696022ccc6d service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:32.470778 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1325/2648] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:32.499002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1027e-b445-4ba1-8bc5-dc6267be8d34 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:32.504895 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:32.563748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1027e-b445-4ba1-8bc5-dc6267be8d34 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:32.568659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:32.569590 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:32.569871 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:32.570147 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] PATH_INFO: `/v3/users/b98b2e7d8aa6424f905af2574687f7e7` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:32.571475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98b2e7d8aa6424f905af2574687f7e7)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:32.573461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:32.631372 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98b2e7d8aa6424f905af2574687f7e7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:32.632248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98b2e7d8aa6424f905af2574687f7e7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:32.632982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98b2e7d8aa6424f905af2574687f7e7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:32.641625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98b2e7d8aa6424f905af2574687f7e7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:32.653420 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98b2e7d8aa6424f905af2574687f7e7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:32.673256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1324/2649] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:32 2022] DELETE /identity/v3/users/b98b2e7d8aa6424f905af2574687f7e7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:32.678133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f0a52-9b57-41dd-a275-b2e7809a7e86 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:32.678442 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f0a52-9b57-41dd-a275-b2e7809a7e86 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:32.678720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f0a52-9b57-41dd-a275-b2e7809a7e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:32.700366 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-255f0a52-9b57-41dd-a275-b2e7809a7e86 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:32.702185 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-255f0a52-9b57-41dd-a275-b2e7809a7e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:32.769883 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1326/2650] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:32.779859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:32.781388 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:32.840878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ecdbc-a298-431f-9d79-62902b69ce4c admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:32.845590 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b58ae-e45d-4537-afbd-0a765f61da46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:32.846275 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b58ae-e45d-4537-afbd-0a765f61da46 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:32.846557 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b58ae-e45d-4537-afbd-0a765f61da46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:32.846797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b58ae-e45d-4537-afbd-0a765f61da46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:32.858339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b58ae-e45d-4537-afbd-0a765f61da46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:32.860588 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b58ae-e45d-4537-afbd-0a765f61da46 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:32.874735 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1325/2651] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:33.176043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f0a52-9b57-41dd-a275-b2e7809a7e86 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:33.177870 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-255f0a52-9b57-41dd-a275-b2e7809a7e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:33.194050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f0a52-9b57-41dd-a275-b2e7809a7e86 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:33.200498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:33.201440 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:33.201733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:33.202009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] PATH_INFO: `/v3/projects/e4418bdb908249a49decb1fdc5d478d1` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:33.203479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4418bdb908249a49decb1fdc5d478d1)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:33.205468 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:33.214291 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:33.260634 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4418bdb908249a49decb1fdc5d478d1', 'request_id': 'req-36a375b2-9c5f-4f74-addf-e3e380256140'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.269765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4418bdb908249a49decb1fdc5d478d1', 'request_id': 'req-36a375b2-9c5f-4f74-addf-e3e380256140'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.275913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4418bdb908249a49decb1fdc5d478d1', 'request_id': 'req-36a375b2-9c5f-4f74-addf-e3e380256140'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.288551 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] The token cache is being invalidate because project e4418bdb908249a49decb1fdc5d478d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:33.288838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.289551 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.291176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1327/2652] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:33 2022] DELETE /identity/v3/projects/e4418bdb908249a49decb1fdc5d478d1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:33.295448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b58ae-e45d-4537-afbd-0a765f61da46 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:33.305958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b58ae-e45d-4537-afbd-0a765f61da46 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:33.331250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:33.373175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0310a8c-13f2-45cb-a76e-d265387ab93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:33.373980 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0310a8c-13f2-45cb-a76e-d265387ab93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:33.374372 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0310a8c-13f2-45cb-a76e-d265387ab93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:33.374643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0310a8c-13f2-45cb-a76e-d265387ab93a admin admin] PATH_INFO: `/v3/users/05609e9bad9948c4948a9ea19eff0938` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:33.375883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0310a8c-13f2-45cb-a76e-d265387ab93a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05609e9bad9948c4948a9ea19eff0938)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:33.377860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0310a8c-13f2-45cb-a76e-d265387ab93a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:33.432493 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d0310a8c-13f2-45cb-a76e-d265387ab93a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05609e9bad9948c4948a9ea19eff0938'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.433140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d0310a8c-13f2-45cb-a76e-d265387ab93a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05609e9bad9948c4948a9ea19eff0938'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.433761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d0310a8c-13f2-45cb-a76e-d265387ab93a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05609e9bad9948c4948a9ea19eff0938'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.440408 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d0310a8c-13f2-45cb-a76e-d265387ab93a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05609e9bad9948c4948a9ea19eff0938'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.449149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d0310a8c-13f2-45cb-a76e-d265387ab93a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05609e9bad9948c4948a9ea19eff0938'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.467148 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1326/2653] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:33 2022] DELETE /identity/v3/users/05609e9bad9948c4948a9ea19eff0938 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:33.753393 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:33.755004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:33.768747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a375b2-9c5f-4f74-addf-e3e380256140 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:33.838379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751295ed-fb0b-4ee2-a6af-52237c9b411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:33.838844 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751295ed-fb0b-4ee2-a6af-52237c9b411b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:33.839059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751295ed-fb0b-4ee2-a6af-52237c9b411b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:33.839464 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751295ed-fb0b-4ee2-a6af-52237c9b411b admin admin] PATH_INFO: `/v3/projects/231cf2e6e7814ff3b9ed64042a4719f2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:33.841304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751295ed-fb0b-4ee2-a6af-52237c9b411b admin admin] RBAC: Authorizing `identity:delete_project(project_id=231cf2e6e7814ff3b9ed64042a4719f2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:33.843937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751295ed-fb0b-4ee2-a6af-52237c9b411b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:33.891270 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-751295ed-fb0b-4ee2-a6af-52237c9b411b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231cf2e6e7814ff3b9ed64042a4719f2', 'request_id': 'req-751295ed-fb0b-4ee2-a6af-52237c9b411b'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.899428 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-751295ed-fb0b-4ee2-a6af-52237c9b411b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231cf2e6e7814ff3b9ed64042a4719f2', 'request_id': 'req-751295ed-fb0b-4ee2-a6af-52237c9b411b'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.906840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-751295ed-fb0b-4ee2-a6af-52237c9b411b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231cf2e6e7814ff3b9ed64042a4719f2', 'request_id': 'req-751295ed-fb0b-4ee2-a6af-52237c9b411b'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.918680 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-751295ed-fb0b-4ee2-a6af-52237c9b411b admin admin] The token cache is being invalidate because project 231cf2e6e7814ff3b9ed64042a4719f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:33.919002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-751295ed-fb0b-4ee2-a6af-52237c9b411b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.919718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-751295ed-fb0b-4ee2-a6af-52237c9b411b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:33.921504 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1328/2654] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:33 2022] DELETE /identity/v3/projects/231cf2e6e7814ff3b9ed64042a4719f2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:33.926614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5d474-f147-41ac-a8fb-fe8f0eb7bec0 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:33.926938 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5d474-f147-41ac-a8fb-fe8f0eb7bec0 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:33.927211 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5d474-f147-41ac-a8fb-fe8f0eb7bec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:33.947541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-6be5d474-f147-41ac-a8fb-fe8f0eb7bec0 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:33.948765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6be5d474-f147-41ac-a8fb-fe8f0eb7bec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:34.018914 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1327/2655] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:34.026871 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f5f4b-8b07-40d3-bf56-550468ad3f45 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:34.027157 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f5f4b-8b07-40d3-bf56-550468ad3f45 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:34.027426 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f5f4b-8b07-40d3-bf56-550468ad3f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:34.046272 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0d1f5f4b-8b07-40d3-bf56-550468ad3f45 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:34.047574 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0d1f5f4b-8b07-40d3-bf56-550468ad3f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:34.055568 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1329/2656] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:34.061756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5d474-f147-41ac-a8fb-fe8f0eb7bec0 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:34.072384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5d474-f147-41ac-a8fb-fe8f0eb7bec0 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:34.077758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580b7ff-e1e3-47b5-8548-704d5f0d71b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:34.078664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580b7ff-e1e3-47b5-8548-704d5f0d71b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:34.078977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580b7ff-e1e3-47b5-8548-704d5f0d71b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:34.079213 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580b7ff-e1e3-47b5-8548-704d5f0d71b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:34.079989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580b7ff-e1e3-47b5-8548-704d5f0d71b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:34.080327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580b7ff-e1e3-47b5-8548-704d5f0d71b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:34.081980 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580b7ff-e1e3-47b5-8548-704d5f0d71b3 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:34.094769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1328/2657] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:27:34.099384 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f5f4b-8b07-40d3-bf56-550468ad3f45 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:34.109583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f5f4b-8b07-40d3-bf56-550468ad3f45 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:34.114325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1850a-0396-4e6b-bf9d-60b507e77557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:34.118994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1850a-0396-4e6b-bf9d-60b507e77557 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:34.118994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1850a-0396-4e6b-bf9d-60b507e77557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:34.118994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1850a-0396-4e6b-bf9d-60b507e77557 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:34.118994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1850a-0396-4e6b-bf9d-60b507e77557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:34.118994 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1850a-0396-4e6b-bf9d-60b507e77557 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:34.134009 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:34.153305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1330/2658] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:34 2022] POST /identity/v3/projects => generated 359 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:34.155559 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580b7ff-e1e3-47b5-8548-704d5f0d71b3 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:34.166053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580b7ff-e1e3-47b5-8548-704d5f0d71b3 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:34.201771 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:34.233774 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9e63e-1483-49d4-9993-a481249c9de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:34.234542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9e63e-1483-49d4-9993-a481249c9de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:34.234825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9e63e-1483-49d4-9993-a481249c9de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:34.235115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9e63e-1483-49d4-9993-a481249c9de9 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:34.235801 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9e63e-1483-49d4-9993-a481249c9de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:34.237783 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9e63e-1483-49d4-9993-a481249c9de9 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:34.259093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1329/2659] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:34 2022] POST /identity/v3/users => generated 280 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:34.264172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1850a-0396-4e6b-bf9d-60b507e77557 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:34.275068 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1850a-0396-4e6b-bf9d-60b507e77557 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:34.279718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b74ec-5856-4310-8487-0f281f5ebc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:34.280400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b74ec-5856-4310-8487-0f281f5ebc1c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:34.280669 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b74ec-5856-4310-8487-0f281f5ebc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:34.280936 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b74ec-5856-4310-8487-0f281f5ebc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:34.281753 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b74ec-5856-4310-8487-0f281f5ebc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:34.284879 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b74ec-5856-4310-8487-0f281f5ebc1c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:34.306819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1331/2660] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:27:34.308463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9e63e-1483-49d4-9993-a481249c9de9 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:34.320197 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9e63e-1483-49d4-9993-a481249c9de9 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:34.325627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d43e3-749e-4f13-8609-2cb65d57306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:34.326317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d43e3-749e-4f13-8609-2cb65d57306c admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:34.326594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d43e3-749e-4f13-8609-2cb65d57306c admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:34.326870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d43e3-749e-4f13-8609-2cb65d57306c admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:34.327633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d43e3-749e-4f13-8609-2cb65d57306c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:34.329594 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d43e3-749e-4f13-8609-2cb65d57306c admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:34.342479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1330/2661] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:34.349814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b74ec-5856-4310-8487-0f281f5ebc1c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:34.361932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b74ec-5856-4310-8487-0f281f5ebc1c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:34.366549 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b424c-0444-4649-bdab-9776b4060a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:34.367626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b424c-0444-4649-bdab-9776b4060a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:34.367743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b424c-0444-4649-bdab-9776b4060a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:34.367972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b424c-0444-4649-bdab-9776b4060a1b admin admin] PATH_INFO: `/v3/projects/7865885232bb4af6a870f68c82f19a0b/users/bbd7a5fd03b1494eaf1fedcc5bca67e9/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:34.383054 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b424c-0444-4649-bdab-9776b4060a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7865885232bb4af6a870f68c82f19a0b, user_id=bbd7a5fd03b1494eaf1fedcc5bca67e9, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:34.385721 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b424c-0444-4649-bdab-9776b4060a1b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:34.401075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1332/2662] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:34 2022] PUT /identity/v3/projects/7865885232bb4af6a870f68c82f19a0b/users/bbd7a5fd03b1494eaf1fedcc5bca67e9/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:34.412461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdafbfc-c868-4a8c-8ebf-a2200f96190d None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:34.412752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdafbfc-c868-4a8c-8ebf-a2200f96190d None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:34.413037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdafbfc-c868-4a8c-8ebf-a2200f96190d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:34.444050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-3bdafbfc-c868-4a8c-8ebf-a2200f96190d None None] MFA Rules not processed for user `bbd7a5fd03b1494eaf1fedcc5bca67e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:34.445328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3bdafbfc-c868-4a8c-8ebf-a2200f96190d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:34.516381 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1331/2663] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:34 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:34.549449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b424c-0444-4649-bdab-9776b4060a1b admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:34.551314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-182b424c-0444-4649-bdab-9776b4060a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:34.615578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b424c-0444-4649-bdab-9776b4060a1b admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:34.620420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce10aa-49df-4f9c-aec0-6371e150c6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:34.621180 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce10aa-49df-4f9c-aec0-6371e150c6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:34.621510 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce10aa-49df-4f9c-aec0-6371e150c6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:34.621786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce10aa-49df-4f9c-aec0-6371e150c6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:34.630922 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce10aa-49df-4f9c-aec0-6371e150c6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:34.632388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce10aa-49df-4f9c-aec0-6371e150c6a1 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:34.641318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1333/2664] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:34 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:34.655451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdafbfc-c868-4a8c-8ebf-a2200f96190d None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:34.719870 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdafbfc-c868-4a8c-8ebf-a2200f96190d None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:34.725120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:34.726083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:34.726367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:34.726648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] PATH_INFO: `/v3/users/bbd7a5fd03b1494eaf1fedcc5bca67e9` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:34.727927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd7a5fd03b1494eaf1fedcc5bca67e9)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:34.730007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:34.779831 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:34.782815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd7a5fd03b1494eaf1fedcc5bca67e9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:34.783907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd7a5fd03b1494eaf1fedcc5bca67e9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:34.784633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd7a5fd03b1494eaf1fedcc5bca67e9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:34.794532 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd7a5fd03b1494eaf1fedcc5bca67e9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:34.802535 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd7a5fd03b1494eaf1fedcc5bca67e9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:34.823238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1332/2665] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:34 2022] DELETE /identity/v3/users/bbd7a5fd03b1494eaf1fedcc5bca67e9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:34.828006 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cbd75-f4c9-447c-80f4-92c441ef872d None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:34.828388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cbd75-f4c9-447c-80f4-92c441ef872d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:34.828665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cbd75-f4c9-447c-80f4-92c441ef872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:34.846197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a78cbd75-f4c9-447c-80f4-92c441ef872d None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:34.847421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a78cbd75-f4c9-447c-80f4-92c441ef872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:34.918756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1334/2666] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:34.930614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:34.933045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:34.999219 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e33b97-8d7f-4e91-9527-1ab0c0fc787d admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:35.003205 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b7589-61f0-419c-8a03-b669e67262d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:35.003888 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b7589-61f0-419c-8a03-b669e67262d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:35.004171 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b7589-61f0-419c-8a03-b669e67262d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:35.004451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b7589-61f0-419c-8a03-b669e67262d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:35.014499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b7589-61f0-419c-8a03-b669e67262d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:35.016019 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b7589-61f0-419c-8a03-b669e67262d7 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:35.026360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1333/2667] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:35.310082 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cbd75-f4c9-447c-80f4-92c441ef872d None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:35.311583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a78cbd75-f4c9-447c-80f4-92c441ef872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:35.325341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cbd75-f4c9-447c-80f4-92c441ef872d None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:35.330865 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dcf9a-e924-46ae-9704-843069ef09cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:35.331761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dcf9a-e924-46ae-9704-843069ef09cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:35.332039 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dcf9a-e924-46ae-9704-843069ef09cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:35.332312 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dcf9a-e924-46ae-9704-843069ef09cf admin admin] PATH_INFO: `/v3/projects/7865885232bb4af6a870f68c82f19a0b` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:35.333853 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dcf9a-e924-46ae-9704-843069ef09cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7865885232bb4af6a870f68c82f19a0b)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:35.335710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dcf9a-e924-46ae-9704-843069ef09cf admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:35.386780 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-403dcf9a-e924-46ae-9704-843069ef09cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7865885232bb4af6a870f68c82f19a0b', 'request_id': 'req-403dcf9a-e924-46ae-9704-843069ef09cf'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:35.396379 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-403dcf9a-e924-46ae-9704-843069ef09cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7865885232bb4af6a870f68c82f19a0b', 'request_id': 'req-403dcf9a-e924-46ae-9704-843069ef09cf'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:35.399131 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:35.409090 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-403dcf9a-e924-46ae-9704-843069ef09cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7865885232bb4af6a870f68c82f19a0b', 'request_id': 'req-403dcf9a-e924-46ae-9704-843069ef09cf'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:35.423159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-403dcf9a-e924-46ae-9704-843069ef09cf admin admin] The token cache is being invalidate because project 7865885232bb4af6a870f68c82f19a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:35.423391 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-403dcf9a-e924-46ae-9704-843069ef09cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:35.424012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-403dcf9a-e924-46ae-9704-843069ef09cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:35.425613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1335/2668] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:35 2022] DELETE /identity/v3/projects/7865885232bb4af6a870f68c82f19a0b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:35.430648 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6d1b5-b0a1-4a39-8499-39bff560c6af None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:35.431183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6d1b5-b0a1-4a39-8499-39bff560c6af None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:35.431183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6d1b5-b0a1-4a39-8499-39bff560c6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:35.450136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c0b6d1b5-b0a1-4a39-8499-39bff560c6af None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:35.451369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c0b6d1b5-b0a1-4a39-8499-39bff560c6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:35.512023 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1334/2669] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:35.519968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd2da8-6a3f-427f-9655-d0fb6e4bbcbb None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:35.520258 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd2da8-6a3f-427f-9655-d0fb6e4bbcbb None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:35.520543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd2da8-6a3f-427f-9655-d0fb6e4bbcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:35.539433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a7bd2da8-6a3f-427f-9655-d0fb6e4bbcbb None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:35.540675 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a7bd2da8-6a3f-427f-9655-d0fb6e4bbcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:35.549728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1336/2670] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:35.555100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6d1b5-b0a1-4a39-8499-39bff560c6af None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:35.571732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6d1b5-b0a1-4a39-8499-39bff560c6af None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:35.581046 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e9c62-2a82-4bc8-bd71-b52d6c4c715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:35.581801 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e9c62-2a82-4bc8-bd71-b52d6c4c715d admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:35.582087 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e9c62-2a82-4bc8-bd71-b52d6c4c715d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:35.582365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e9c62-2a82-4bc8-bd71-b52d6c4c715d admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:35.583143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e9c62-2a82-4bc8-bd71-b52d6c4c715d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:35.583439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e9c62-2a82-4bc8-bd71-b52d6c4c715d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:35.585087 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e9c62-2a82-4bc8-bd71-b52d6c4c715d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:35.599117 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1335/2671] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 07:27:35.604563 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd2da8-6a3f-427f-9655-d0fb6e4bbcbb None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:35.616676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd2da8-6a3f-427f-9655-d0fb6e4bbcbb None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:35.622547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47667-003f-48eb-a88a-70781986fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:35.623217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47667-003f-48eb-a88a-70781986fab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:35.623494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47667-003f-48eb-a88a-70781986fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:35.623762 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47667-003f-48eb-a88a-70781986fab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:35.624454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d47667-003f-48eb-a88a-70781986fab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:35.626742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d47667-003f-48eb-a88a-70781986fab2 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:35.656075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1337/2672] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:35 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:35.660614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e9c62-2a82-4bc8-bd71-b52d6c4c715d admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:35.671720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e9c62-2a82-4bc8-bd71-b52d6c4c715d admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:35.722056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:35.734266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb68fb-0720-4fbd-92c9-508a48a51270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:35.735072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb68fb-0720-4fbd-92c9-508a48a51270 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:35.735488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb68fb-0720-4fbd-92c9-508a48a51270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:35.735773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb68fb-0720-4fbd-92c9-508a48a51270 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:35.736487 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb68fb-0720-4fbd-92c9-508a48a51270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:35.738463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb68fb-0720-4fbd-92c9-508a48a51270 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:35.760566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1336/2673] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:35 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:35.764760 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47667-003f-48eb-a88a-70781986fab2 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:35.775665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47667-003f-48eb-a88a-70781986fab2 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:35.779834 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629159cb-2cdb-4342-be60-79a53a583685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:35.780507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629159cb-2cdb-4342-be60-79a53a583685 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:35.780785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629159cb-2cdb-4342-be60-79a53a583685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:35.781059 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629159cb-2cdb-4342-be60-79a53a583685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:35.781869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629159cb-2cdb-4342-be60-79a53a583685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:35.783479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629159cb-2cdb-4342-be60-79a53a583685 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:35.794129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1338/2674] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:27:35.798385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb68fb-0720-4fbd-92c9-508a48a51270 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:35.811360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb68fb-0720-4fbd-92c9-508a48a51270 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:35.819361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef489df-ed1d-4d27-adef-b91e7c0ba418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:35.820055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef489df-ed1d-4d27-adef-b91e7c0ba418 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:35.820339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef489df-ed1d-4d27-adef-b91e7c0ba418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:35.820618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef489df-ed1d-4d27-adef-b91e7c0ba418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:35.821402 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef489df-ed1d-4d27-adef-b91e7c0ba418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:35.823087 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef489df-ed1d-4d27-adef-b91e7c0ba418 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:35.834454 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1337/2675] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:35.838804 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629159cb-2cdb-4342-be60-79a53a583685 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:35.850696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629159cb-2cdb-4342-be60-79a53a583685 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:35.857657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7092ee-e432-4a04-b532-ca290742993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:35.858902 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7092ee-e432-4a04-b532-ca290742993f admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:35.859271 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7092ee-e432-4a04-b532-ca290742993f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:35.859599 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7092ee-e432-4a04-b532-ca290742993f admin admin] PATH_INFO: `/v3/projects/3889dbc7ed614ac5a24001d5dc3e1ca0/users/8fff63abecf84deeac39f8b1f1d4cd20/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:35.880593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7092ee-e432-4a04-b532-ca290742993f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3889dbc7ed614ac5a24001d5dc3e1ca0, user_id=8fff63abecf84deeac39f8b1f1d4cd20, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:35.883322 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7092ee-e432-4a04-b532-ca290742993f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:35.898433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1339/2676] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:35 2022] PUT /identity/v3/projects/3889dbc7ed614ac5a24001d5dc3e1ca0/users/8fff63abecf84deeac39f8b1f1d4cd20/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:35.909093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a25a4-a057-4cde-8dca-f8d30dcd723f None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:35.909424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a25a4-a057-4cde-8dca-f8d30dcd723f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:35.909765 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a25a4-a057-4cde-8dca-f8d30dcd723f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:35.940361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-9f5a25a4-a057-4cde-8dca-f8d30dcd723f None None] MFA Rules not processed for user `8fff63abecf84deeac39f8b1f1d4cd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:35.941683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9f5a25a4-a057-4cde-8dca-f8d30dcd723f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:36.014933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1338/2677] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:36.019627 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7092ee-e432-4a04-b532-ca290742993f admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:36.087025 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7092ee-e432-4a04-b532-ca290742993f admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:36.092741 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fce2f9-fdc4-4486-8aa8-f6c31a84c5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:36.093444 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fce2f9-fdc4-4486-8aa8-f6c31a84c5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:36.093726 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fce2f9-fdc4-4486-8aa8-f6c31a84c5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:36.094000 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fce2f9-fdc4-4486-8aa8-f6c31a84c5d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:36.094750 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fce2f9-fdc4-4486-8aa8-f6c31a84c5d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:36.096664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fce2f9-fdc4-4486-8aa8-f6c31a84c5d3 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:36.124100 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1340/2678] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:36 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:36.128417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a25a4-a057-4cde-8dca-f8d30dcd723f None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:36.139510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a25a4-a057-4cde-8dca-f8d30dcd723f None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:36.196320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936400d-6472-4ff9-84e7-433e0ffc2fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:36.197003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936400d-6472-4ff9-84e7-433e0ffc2fad admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:36.197387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936400d-6472-4ff9-84e7-433e0ffc2fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:36.197667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936400d-6472-4ff9-84e7-433e0ffc2fad admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:36.198359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936400d-6472-4ff9-84e7-433e0ffc2fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:36.200282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936400d-6472-4ff9-84e7-433e0ffc2fad admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:36.223959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1339/2679] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:36 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:36.228126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fce2f9-fdc4-4486-8aa8-f6c31a84c5d3 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:36.239160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fce2f9-fdc4-4486-8aa8-f6c31a84c5d3 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:36.245743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5540a-1fa4-4eab-82f2-c6b1668b1a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:36.246565 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5540a-1fa4-4eab-82f2-c6b1668b1a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:36.246849 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5540a-1fa4-4eab-82f2-c6b1668b1a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:36.247126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5540a-1fa4-4eab-82f2-c6b1668b1a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:36.247856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5540a-1fa4-4eab-82f2-c6b1668b1a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:36.249508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5540a-1fa4-4eab-82f2-c6b1668b1a27 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:36.261603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1341/2680] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:36.266255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936400d-6472-4ff9-84e7-433e0ffc2fad admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:36.277100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936400d-6472-4ff9-84e7-433e0ffc2fad admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:36.282848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d17f7-cc9b-4535-acd6-ef0a68c3ed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:36.283764 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d17f7-cc9b-4535-acd6-ef0a68c3ed41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:36.284055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d17f7-cc9b-4535-acd6-ef0a68c3ed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:36.284338 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d17f7-cc9b-4535-acd6-ef0a68c3ed41 admin admin] PATH_INFO: `/v3/projects/2daef6b93f324527af46d2efbfd93383/users/c678c49e8eea4060aa4dbb54641f224e/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:36.300460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d17f7-cc9b-4535-acd6-ef0a68c3ed41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2daef6b93f324527af46d2efbfd93383, user_id=c678c49e8eea4060aa4dbb54641f224e, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:36.303254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d17f7-cc9b-4535-acd6-ef0a68c3ed41 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:36.321977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1340/2681] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:36 2022] PUT /identity/v3/projects/2daef6b93f324527af46d2efbfd93383/users/c678c49e8eea4060aa4dbb54641f224e/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:36.327292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5540a-1fa4-4eab-82f2-c6b1668b1a27 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:36.344250 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5540a-1fa4-4eab-82f2-c6b1668b1a27 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:36.408803 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:36.416470 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921ee24-9b18-40e0-aa94-cf072ec5eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:36.417168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921ee24-9b18-40e0-aa94-cf072ec5eb09 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:36.417513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921ee24-9b18-40e0-aa94-cf072ec5eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:36.417963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921ee24-9b18-40e0-aa94-cf072ec5eb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:36.419189 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921ee24-9b18-40e0-aa94-cf072ec5eb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:36.422051 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921ee24-9b18-40e0-aa94-cf072ec5eb09 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:36.438070 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1342/2682] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:36.439690 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d17f7-cc9b-4535-acd6-ef0a68c3ed41 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:36.450119 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d17f7-cc9b-4535-acd6-ef0a68c3ed41 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:36.454774 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da118f-fde1-4426-8d55-00f39d5ec99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:36.455708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da118f-fde1-4426-8d55-00f39d5ec99f admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:36.455978 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da118f-fde1-4426-8d55-00f39d5ec99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:36.456255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da118f-fde1-4426-8d55-00f39d5ec99f admin admin] PATH_INFO: `/v3/projects/2daef6b93f324527af46d2efbfd93383/users/c678c49e8eea4060aa4dbb54641f224e/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:36.458257 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da118f-fde1-4426-8d55-00f39d5ec99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2daef6b93f324527af46d2efbfd93383, user_id=c678c49e8eea4060aa4dbb54641f224e, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:36.460918 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da118f-fde1-4426-8d55-00f39d5ec99f admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:36.477255 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1341/2683] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:36 2022] PUT /identity/v3/projects/2daef6b93f324527af46d2efbfd93383/users/c678c49e8eea4060aa4dbb54641f224e/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:36.548407 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebf52a-37e7-4bd7-ba79-89da7b77d822 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:36.548723 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebf52a-37e7-4bd7-ba79-89da7b77d822 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:36.548960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebf52a-37e7-4bd7-ba79-89da7b77d822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:36.578061 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-53ebf52a-37e7-4bd7-ba79-89da7b77d822 None None] MFA Rules not processed for user `c678c49e8eea4060aa4dbb54641f224e`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:36.579396 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-53ebf52a-37e7-4bd7-ba79-89da7b77d822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:36.656335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1343/2684] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:36.668155 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da118f-fde1-4426-8d55-00f39d5ec99f admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:36.671294 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-82da118f-fde1-4426-8d55-00f39d5ec99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:36.690933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:36.741161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da118f-fde1-4426-8d55-00f39d5ec99f admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:36.745195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d5f92-891a-446c-8dd8-86b5b3da11ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:36.745950 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d5f92-891a-446c-8dd8-86b5b3da11ab service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:36.746282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d5f92-891a-446c-8dd8-86b5b3da11ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:36.746585 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d5f92-891a-446c-8dd8-86b5b3da11ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:36.789321 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebf52a-37e7-4bd7-ba79-89da7b77d822 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:36.790913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-53ebf52a-37e7-4bd7-ba79-89da7b77d822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:36.815031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d5f92-891a-446c-8dd8-86b5b3da11ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:36.816542 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d5f92-891a-446c-8dd8-86b5b3da11ab service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:36.825901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1342/2685] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:36.856961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebf52a-37e7-4bd7-ba79-89da7b77d822 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:36.861755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:36.862685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:36.863211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:36.863211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] PATH_INFO: `/v3/users/47e28a8b6cb749eaa51ec547b945dfd2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:36.864667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e28a8b6cb749eaa51ec547b945dfd2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:36.866766 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:36.918248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e28a8b6cb749eaa51ec547b945dfd2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:36.918954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e28a8b6cb749eaa51ec547b945dfd2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:36.919611 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e28a8b6cb749eaa51ec547b945dfd2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:36.927062 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e28a8b6cb749eaa51ec547b945dfd2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:36.935602 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e28a8b6cb749eaa51ec547b945dfd2'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:36.949668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:36.955582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1344/2686] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:36 2022] DELETE /identity/v3/users/47e28a8b6cb749eaa51ec547b945dfd2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:36.960360 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a744c-6230-44ba-b2a7-b0fa6a020c36 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:36.960650 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a744c-6230-44ba-b2a7-b0fa6a020c36 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:36.960923 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a744c-6230-44ba-b2a7-b0fa6a020c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:36.979179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-0a1a744c-6230-44ba-b2a7-b0fa6a020c36 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:36.980477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0a1a744c-6230-44ba-b2a7-b0fa6a020c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:37.044887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1343/2687] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:37.055521 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:37.057647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:37.132418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551f8b4-3f13-4793-999c-c4790280f830 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:37.132418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35d776-543a-4a50-986c-2c2ae92272b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:37.133143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35d776-543a-4a50-986c-2c2ae92272b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:37.133589 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35d776-543a-4a50-986c-2c2ae92272b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:37.134010 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35d776-543a-4a50-986c-2c2ae92272b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:37.144857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35d776-543a-4a50-986c-2c2ae92272b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:37.146243 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35d776-543a-4a50-986c-2c2ae92272b7 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:37.156179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1345/2688] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:37.444039 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a744c-6230-44ba-b2a7-b0fa6a020c36 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:37.445577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0a1a744c-6230-44ba-b2a7-b0fa6a020c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:37.459817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a744c-6230-44ba-b2a7-b0fa6a020c36 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:37.466513 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aad64-a06f-43b9-bb87-b035f94ce9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:37.467457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aad64-a06f-43b9-bb87-b035f94ce9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:37.467666 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aad64-a06f-43b9-bb87-b035f94ce9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:37.467937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aad64-a06f-43b9-bb87-b035f94ce9b8 admin admin] PATH_INFO: `/v3/projects/86a85c1efe6445dfb5baaf296d174289` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:37.470122 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aad64-a06f-43b9-bb87-b035f94ce9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a85c1efe6445dfb5baaf296d174289)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:37.472055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aad64-a06f-43b9-bb87-b035f94ce9b8 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:37.521779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-421aad64-a06f-43b9-bb87-b035f94ce9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a85c1efe6445dfb5baaf296d174289', 'request_id': 'req-421aad64-a06f-43b9-bb87-b035f94ce9b8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:37.527476 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-421aad64-a06f-43b9-bb87-b035f94ce9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a85c1efe6445dfb5baaf296d174289', 'request_id': 'req-421aad64-a06f-43b9-bb87-b035f94ce9b8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:37.530100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:37.536115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-421aad64-a06f-43b9-bb87-b035f94ce9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a85c1efe6445dfb5baaf296d174289', 'request_id': 'req-421aad64-a06f-43b9-bb87-b035f94ce9b8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:37.548792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-421aad64-a06f-43b9-bb87-b035f94ce9b8 admin admin] The token cache is being invalidate because project 86a85c1efe6445dfb5baaf296d174289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:37.549086 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-421aad64-a06f-43b9-bb87-b035f94ce9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:37.549750 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-421aad64-a06f-43b9-bb87-b035f94ce9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:37.551346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1344/2689] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:37 2022] DELETE /identity/v3/projects/86a85c1efe6445dfb5baaf296d174289 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:37.556606 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c4870-f0e1-4a77-81df-b5de34b29a66 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:37.557461 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c4870-f0e1-4a77-81df-b5de34b29a66 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:37.557580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c4870-f0e1-4a77-81df-b5de34b29a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:37.576608 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-5a9c4870-f0e1-4a77-81df-b5de34b29a66 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:37.577849 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5a9c4870-f0e1-4a77-81df-b5de34b29a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:37.638780 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1346/2690] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:37.647854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3901d2-35d9-43a7-8e6d-df0415a5a968 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:37.648149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3901d2-35d9-43a7-8e6d-df0415a5a968 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:37.648431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3901d2-35d9-43a7-8e6d-df0415a5a968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:37.667720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-4c3901d2-35d9-43a7-8e6d-df0415a5a968 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:37.668945 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-4c3901d2-35d9-43a7-8e6d-df0415a5a968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:37.677300 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1345/2691] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:37.681670 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c4870-f0e1-4a77-81df-b5de34b29a66 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:37.692212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c4870-f0e1-4a77-81df-b5de34b29a66 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:37.697463 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dd30b-ce8c-4314-b5e2-540517c16414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:37.698137 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dd30b-ce8c-4314-b5e2-540517c16414 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:37.698422 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dd30b-ce8c-4314-b5e2-540517c16414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:37.698692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dd30b-ce8c-4314-b5e2-540517c16414 admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:37.699455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dd30b-ce8c-4314-b5e2-540517c16414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:37.699799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dd30b-ce8c-4314-b5e2-540517c16414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:37.701450 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dd30b-ce8c-4314-b5e2-540517c16414 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:37.715724 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1347/2692] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:27:37.721710 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3901d2-35d9-43a7-8e6d-df0415a5a968 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:37.732799 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3901d2-35d9-43a7-8e6d-df0415a5a968 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:37.738503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a14fea-139a-40a4-9492-20b4cc340c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:37.739301 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14fea-139a-40a4-9492-20b4cc340c76 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:37.739688 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14fea-139a-40a4-9492-20b4cc340c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:37.740059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14fea-139a-40a4-9492-20b4cc340c76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:37.740848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14fea-139a-40a4-9492-20b4cc340c76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:37.743820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14fea-139a-40a4-9492-20b4cc340c76 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:37.773960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1346/2693] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:37 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:37.778405 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dd30b-ce8c-4314-b5e2-540517c16414 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:37.792261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dd30b-ce8c-4314-b5e2-540517c16414 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:37.855913 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7a8cb-674b-414b-99f8-d27fd9f7ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:37.856622 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7a8cb-674b-414b-99f8-d27fd9f7ef67 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:37.856907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7a8cb-674b-414b-99f8-d27fd9f7ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:37.857187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7a8cb-674b-414b-99f8-d27fd9f7ef67 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:37.857938 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7a8cb-674b-414b-99f8-d27fd9f7ef67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:37.859952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7a8cb-674b-414b-99f8-d27fd9f7ef67 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:37.883241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1348/2694] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:37 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:37.887976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a14fea-139a-40a4-9492-20b4cc340c76 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:37.900289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a14fea-139a-40a4-9492-20b4cc340c76 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:37.905619 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422c70f-f600-493d-bbef-e74f167d4b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:37.906305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422c70f-f600-493d-bbef-e74f167d4b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:37.906588 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422c70f-f600-493d-bbef-e74f167d4b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:37.906903 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422c70f-f600-493d-bbef-e74f167d4b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:37.907663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422c70f-f600-493d-bbef-e74f167d4b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:37.909332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422c70f-f600-493d-bbef-e74f167d4b87 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:37.921188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1347/2695] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:37.925667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7a8cb-674b-414b-99f8-d27fd9f7ef67 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:37.936889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7a8cb-674b-414b-99f8-d27fd9f7ef67 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:37.941969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666710f-041c-40cf-b552-4dd541db4618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:37.942640 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666710f-041c-40cf-b552-4dd541db4618 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:37.942952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666710f-041c-40cf-b552-4dd541db4618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:37.943225 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666710f-041c-40cf-b552-4dd541db4618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:37.943972 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666710f-041c-40cf-b552-4dd541db4618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:37.945975 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666710f-041c-40cf-b552-4dd541db4618 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:37.956502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1349/2696] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:37.960866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422c70f-f600-493d-bbef-e74f167d4b87 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:37.971268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422c70f-f600-493d-bbef-e74f167d4b87 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:37.976682 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aa44a-3178-4771-821b-c46c0fbe40f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:37.977635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aa44a-3178-4771-821b-c46c0fbe40f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:37.977907 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aa44a-3178-4771-821b-c46c0fbe40f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:37.978192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aa44a-3178-4771-821b-c46c0fbe40f2 admin admin] PATH_INFO: `/v3/projects/9d7a05c5fea247999b9506642b1b13d8/users/61bd36c3ce394e37885870555a7c3ab5/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:37.993352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292aa44a-3178-4771-821b-c46c0fbe40f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7a05c5fea247999b9506642b1b13d8, user_id=61bd36c3ce394e37885870555a7c3ab5, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:37.995989 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292aa44a-3178-4771-821b-c46c0fbe40f2 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:38.019956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1348/2697] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:37 2022] PUT /identity/v3/projects/9d7a05c5fea247999b9506642b1b13d8/users/61bd36c3ce394e37885870555a7c3ab5/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:38.035223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59780a23-3ad9-4d49-9570-d64545cc7e7c None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:38.035739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59780a23-3ad9-4d49-9570-d64545cc7e7c None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:38.036212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59780a23-3ad9-4d49-9570-d64545cc7e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:38.055856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:38.072427 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-59780a23-3ad9-4d49-9570-d64545cc7e7c None None] MFA Rules not processed for user `61bd36c3ce394e37885870555a7c3ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:38.073695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-59780a23-3ad9-4d49-9570-d64545cc7e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:38.142683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1350/2698] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:38.154856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aa44a-3178-4771-821b-c46c0fbe40f2 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:38.156679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-292aa44a-3178-4771-821b-c46c0fbe40f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:38.222115 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aa44a-3178-4771-821b-c46c0fbe40f2 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:38.226416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d23720-1602-4a97-bd4e-949e91014b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:38.227079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d23720-1602-4a97-bd4e-949e91014b88 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:38.227518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d23720-1602-4a97-bd4e-949e91014b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:38.227805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d23720-1602-4a97-bd4e-949e91014b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:38.236939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d23720-1602-4a97-bd4e-949e91014b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:38.238447 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d23720-1602-4a97-bd4e-949e91014b88 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:38.249457 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1349/2699] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:39.387121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59780a23-3ad9-4d49-9570-d64545cc7e7c None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:39.388756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-59780a23-3ad9-4d49-9570-d64545cc7e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:39.462781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59780a23-3ad9-4d49-9570-d64545cc7e7c None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:39.467788 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:39.468683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:39.468966 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:39.469264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] PATH_INFO: `/v3/users/8fff63abecf84deeac39f8b1f1d4cd20` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:39.470506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fff63abecf84deeac39f8b1f1d4cd20)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:39.472547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:39.527043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fff63abecf84deeac39f8b1f1d4cd20'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:39.528061 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fff63abecf84deeac39f8b1f1d4cd20'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:39.528676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fff63abecf84deeac39f8b1f1d4cd20'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:39.536230 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fff63abecf84deeac39f8b1f1d4cd20'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:39.544552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fff63abecf84deeac39f8b1f1d4cd20'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:39.566948 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1351/2700] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:39 2022] DELETE /identity/v3/users/8fff63abecf84deeac39f8b1f1d4cd20 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:39.571642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd70c2f-496e-4579-8355-1bfaef2b700b None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:39.572177 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd70c2f-496e-4579-8355-1bfaef2b700b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:39.572262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd70c2f-496e-4579-8355-1bfaef2b700b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:39.590341 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-7cd70c2f-496e-4579-8355-1bfaef2b700b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:39.591570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7cd70c2f-496e-4579-8355-1bfaef2b700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:39.662809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1350/2701] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:39.676606 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:39.678086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:39.697874 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:39.743388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03c9e-13f2-4d26-8f9b-5e6e478a4b51 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:39.747572 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe656a-5067-4ff3-a888-8ee2b3ceea60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:39.748229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe656a-5067-4ff3-a888-8ee2b3ceea60 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:39.749613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe656a-5067-4ff3-a888-8ee2b3ceea60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:39.749613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe656a-5067-4ff3-a888-8ee2b3ceea60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:39.759982 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe656a-5067-4ff3-a888-8ee2b3ceea60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:39.761503 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe656a-5067-4ff3-a888-8ee2b3ceea60 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:39.772318 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1352/2702] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:40.086232 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd70c2f-496e-4579-8355-1bfaef2b700b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:40.087829 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-7cd70c2f-496e-4579-8355-1bfaef2b700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:40.109248 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd70c2f-496e-4579-8355-1bfaef2b700b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:40.114463 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:40.115286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:40.115539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:40.115817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] PATH_INFO: `/v3/projects/3889dbc7ed614ac5a24001d5dc3e1ca0` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:40.117291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3889dbc7ed614ac5a24001d5dc3e1ca0)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:40.119526 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:40.151475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:40.185779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3889dbc7ed614ac5a24001d5dc3e1ca0', 'request_id': 'req-5031b887-f586-41f6-a630-69efc803850a'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.193479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3889dbc7ed614ac5a24001d5dc3e1ca0', 'request_id': 'req-5031b887-f586-41f6-a630-69efc803850a'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.212031 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3889dbc7ed614ac5a24001d5dc3e1ca0', 'request_id': 'req-5031b887-f586-41f6-a630-69efc803850a'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.228083 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] The token cache is being invalidate because project 3889dbc7ed614ac5a24001d5dc3e1ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:40.228378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.229260 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.231062 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1351/2703] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:40 2022] DELETE /identity/v3/projects/3889dbc7ed614ac5a24001d5dc3e1ca0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:27:40.238411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe656a-5067-4ff3-a888-8ee2b3ceea60 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:40.250166 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe656a-5067-4ff3-a888-8ee2b3ceea60 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:40.313400 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441baee-d034-47ff-a057-8b62e946ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:40.314310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441baee-d034-47ff-a057-8b62e946ac85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:40.314595 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441baee-d034-47ff-a057-8b62e946ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:40.314920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441baee-d034-47ff-a057-8b62e946ac85 admin admin] PATH_INFO: `/v3/users/c678c49e8eea4060aa4dbb54641f224e` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:40.318261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441baee-d034-47ff-a057-8b62e946ac85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c678c49e8eea4060aa4dbb54641f224e)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:40.318261 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441baee-d034-47ff-a057-8b62e946ac85 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:40.370508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0441baee-d034-47ff-a057-8b62e946ac85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c678c49e8eea4060aa4dbb54641f224e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.371193 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0441baee-d034-47ff-a057-8b62e946ac85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c678c49e8eea4060aa4dbb54641f224e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.371869 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0441baee-d034-47ff-a057-8b62e946ac85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c678c49e8eea4060aa4dbb54641f224e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.379873 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0441baee-d034-47ff-a057-8b62e946ac85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c678c49e8eea4060aa4dbb54641f224e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.387970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-0441baee-d034-47ff-a057-8b62e946ac85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c678c49e8eea4060aa4dbb54641f224e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.407631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1353/2704] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:27:40 2022] DELETE /identity/v3/users/c678c49e8eea4060aa4dbb54641f224e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:40.719182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:40.720709 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:40.739759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b887-f586-41f6-a630-69efc803850a admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:40.807579 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3911505-4c11-4798-a33f-626f70746b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:40.808460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3911505-4c11-4798-a33f-626f70746b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:40.808744 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3911505-4c11-4798-a33f-626f70746b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:40.809007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3911505-4c11-4798-a33f-626f70746b98 admin admin] PATH_INFO: `/v3/projects/2daef6b93f324527af46d2efbfd93383` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:40.810317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3911505-4c11-4798-a33f-626f70746b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2daef6b93f324527af46d2efbfd93383)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:40.812258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3911505-4c11-4798-a33f-626f70746b98 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:40.862820 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e3911505-4c11-4798-a33f-626f70746b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2daef6b93f324527af46d2efbfd93383', 'request_id': 'req-e3911505-4c11-4798-a33f-626f70746b98'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.868726 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e3911505-4c11-4798-a33f-626f70746b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2daef6b93f324527af46d2efbfd93383', 'request_id': 'req-e3911505-4c11-4798-a33f-626f70746b98'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.877458 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e3911505-4c11-4798-a33f-626f70746b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2daef6b93f324527af46d2efbfd93383', 'request_id': 'req-e3911505-4c11-4798-a33f-626f70746b98'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.889316 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e3911505-4c11-4798-a33f-626f70746b98 admin admin] The token cache is being invalidate because project 2daef6b93f324527af46d2efbfd93383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:27:40.889517 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e3911505-4c11-4798-a33f-626f70746b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.890169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e3911505-4c11-4798-a33f-626f70746b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:27:40.891719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1352/2705] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:27:40 2022] DELETE /identity/v3/projects/2daef6b93f324527af46d2efbfd93383 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:40.897023 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b1094-57a6-4cee-86ba-b92e376259ca None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:40.897479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b1094-57a6-4cee-86ba-b92e376259ca None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:40.897888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b1094-57a6-4cee-86ba-b92e376259ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:40.917111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-116b1094-57a6-4cee-86ba-b92e376259ca None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:40.918470 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-116b1094-57a6-4cee-86ba-b92e376259ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:40.955355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:40.992151 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1354/2706] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:41.000451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019aaf6-f9e2-4b12-a994-8ddee0a2ca7b None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:41.000883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019aaf6-f9e2-4b12-a994-8ddee0a2ca7b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:41.001306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019aaf6-f9e2-4b12-a994-8ddee0a2ca7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:41.021575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-f019aaf6-f9e2-4b12-a994-8ddee0a2ca7b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:41.022809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f019aaf6-f9e2-4b12-a994-8ddee0a2ca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:41.032703 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1353/2707] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:41.037635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b1094-57a6-4cee-86ba-b92e376259ca None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:41.047937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b1094-57a6-4cee-86ba-b92e376259ca None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:41.053578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446d79f-5d82-401c-960e-b144a639593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:41.054273 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446d79f-5d82-401c-960e-b144a639593d admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:41.054554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446d79f-5d82-401c-960e-b144a639593d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:41.054825 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446d79f-5d82-401c-960e-b144a639593d admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:41.055552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446d79f-5d82-401c-960e-b144a639593d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:27:41.055854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446d79f-5d82-401c-960e-b144a639593d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:41.057861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446d79f-5d82-401c-960e-b144a639593d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:41.070597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1355/2708] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:27:41.075298 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019aaf6-f9e2-4b12-a994-8ddee0a2ca7b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:41.085004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019aaf6-f9e2-4b12-a994-8ddee0a2ca7b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:41.090030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f99e6e-2530-4845-b751-80ce5fd28322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:41.090961 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f99e6e-2530-4845-b751-80ce5fd28322 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:41.090961 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f99e6e-2530-4845-b751-80ce5fd28322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:41.091276 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f99e6e-2530-4845-b751-80ce5fd28322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:41.091927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f99e6e-2530-4845-b751-80ce5fd28322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:41.093943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f99e6e-2530-4845-b751-80ce5fd28322 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:41.121865 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1354/2709] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:27:41 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:27:41.126241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446d79f-5d82-401c-960e-b144a639593d admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:41.136676 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446d79f-5d82-401c-960e-b144a639593d admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:41.198347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a0e64-afaa-431e-bfb1-81eeeaf62913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:41.199021 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a0e64-afaa-431e-bfb1-81eeeaf62913 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:41.199304 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a0e64-afaa-431e-bfb1-81eeeaf62913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:41.199587 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a0e64-afaa-431e-bfb1-81eeeaf62913 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:41.200305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a0e64-afaa-431e-bfb1-81eeeaf62913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:41.202332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a0e64-afaa-431e-bfb1-81eeeaf62913 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:41.224891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1356/2710] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:27:41 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:27:41.229200 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f99e6e-2530-4845-b751-80ce5fd28322 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:41.240295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f99e6e-2530-4845-b751-80ce5fd28322 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:41.245633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c456277-e874-49d0-9cb4-d9049ac78740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:41.246512 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c456277-e874-49d0-9cb4-d9049ac78740 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:41.246789 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c456277-e874-49d0-9cb4-d9049ac78740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:41.247051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c456277-e874-49d0-9cb4-d9049ac78740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:41.248151 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c456277-e874-49d0-9cb4-d9049ac78740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:41.249866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c456277-e874-49d0-9cb4-d9049ac78740 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:41.262479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1355/2711] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:41.266856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a0e64-afaa-431e-bfb1-81eeeaf62913 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:41.278037 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a0e64-afaa-431e-bfb1-81eeeaf62913 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:41.282891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed731fd-e94a-43c7-85ff-d363e2df4fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:41.283493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed731fd-e94a-43c7-85ff-d363e2df4fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:41.283770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed731fd-e94a-43c7-85ff-d363e2df4fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:41.284040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed731fd-e94a-43c7-85ff-d363e2df4fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:41.284886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed731fd-e94a-43c7-85ff-d363e2df4fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:41.286543 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed731fd-e94a-43c7-85ff-d363e2df4fe6 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:41.303387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1357/2712] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:27:41.304446 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c456277-e874-49d0-9cb4-d9049ac78740 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:41.318728 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c456277-e874-49d0-9cb4-d9049ac78740 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:41.319815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:41.326181 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513993ec-3c2b-4bda-9f7b-c84cf2451b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:41.327682 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513993ec-3c2b-4bda-9f7b-c84cf2451b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:41.328149 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513993ec-3c2b-4bda-9f7b-c84cf2451b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:41.328456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513993ec-3c2b-4bda-9f7b-c84cf2451b8a admin admin] PATH_INFO: `/v3/projects/322cc6f4005b49f1889dcc6dca8043f2/users/ba90d232c52145288745a765f6131023/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:41.349863 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513993ec-3c2b-4bda-9f7b-c84cf2451b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=322cc6f4005b49f1889dcc6dca8043f2, user_id=ba90d232c52145288745a765f6131023, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:41.352564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513993ec-3c2b-4bda-9f7b-c84cf2451b8a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:41.379335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c2d95-8ae6-4dca-b32c-fcb0fc4a9d76 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:41.379459 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c2d95-8ae6-4dca-b32c-fcb0fc4a9d76 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:41.379795 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c2d95-8ae6-4dca-b32c-fcb0fc4a9d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:41.381118 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1356/2713] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:27:41 2022] PUT /identity/v3/projects/322cc6f4005b49f1889dcc6dca8043f2/users/ba90d232c52145288745a765f6131023/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:27:41.404716 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e29c2d95-8ae6-4dca-b32c-fcb0fc4a9d76 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:41.406040 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e29c2d95-8ae6-4dca-b32c-fcb0fc4a9d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:41.469133 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1358/2714] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:41.479085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513993ec-3c2b-4bda-9f7b-c84cf2451b8a admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:41.480889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-513993ec-3c2b-4bda-9f7b-c84cf2451b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:41.552479 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513993ec-3c2b-4bda-9f7b-c84cf2451b8a admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:41.557537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9c63e-8682-4ea7-b9e3-35a073c32fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:41.558217 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9c63e-8682-4ea7-b9e3-35a073c32fbb service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:41.558502 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9c63e-8682-4ea7-b9e3-35a073c32fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:41.558773 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9c63e-8682-4ea7-b9e3-35a073c32fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:41.568869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9c63e-8682-4ea7-b9e3-35a073c32fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:41.570480 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9c63e-8682-4ea7-b9e3-35a073c32fbb service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:41.581477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1357/2715] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:42.267020 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a4f87-8500-462d-8b30-24bd465744e3 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:42.267308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a4f87-8500-462d-8b30-24bd465744e3 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:42.267585 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a4f87-8500-462d-8b30-24bd465744e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:42.293560 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-5c1a4f87-8500-462d-8b30-24bd465744e3 None None] MFA Rules not processed for user `ba90d232c52145288745a765f6131023`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:42.294859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5c1a4f87-8500-462d-8b30-24bd465744e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:42.334478 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:42.372906 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1359/2716] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:42.384233 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9c63e-8682-4ea7-b9e3-35a073c32fbb service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:27:42.385816 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-16c9c63e-8682-4ea7-b9e3-35a073c32fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:42.448997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9c63e-8682-4ea7-b9e3-35a073c32fbb service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:27:42.452767 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb433ed-3f85-4701-83f2-1fb0e922b2cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:27:42.453489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb433ed-3f85-4701-83f2-1fb0e922b2cf service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:42.453777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb433ed-3f85-4701-83f2-1fb0e922b2cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:42.454055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb433ed-3f85-4701-83f2-1fb0e922b2cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:42.463384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb433ed-3f85-4701-83f2-1fb0e922b2cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:27:42.464841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb433ed-3f85-4701-83f2-1fb0e922b2cf service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:27:42.475516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1358/2717] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:27:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:27:43.882018 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678773d-3378-416e-ac9f-9c98509cc392 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:27:43.882740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678773d-3378-416e-ac9f-9c98509cc392 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:27:43.882740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678773d-3378-416e-ac9f-9c98509cc392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:27:43.901701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-0678773d-3378-416e-ac9f-9c98509cc392 None None] MFA Rules not processed for user `ba90d232c52145288745a765f6131023`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:27:43.902992 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0678773d-3378-416e-ac9f-9c98509cc392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:27:43.910310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1360/2718] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:27:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:27:52.472443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=61,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:53.896031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=15 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:11.201203 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb433ed-3f85-4701-83f2-1fb0e922b2cf service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:11.211656 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb433ed-3f85-4701-83f2-1fb0e922b2cf service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:11.216358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9959ff-6db5-485f-9297-a81b370d454f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:11.217007 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9959ff-6db5-485f-9297-a81b370d454f service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:11.217320 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9959ff-6db5-485f-9297-a81b370d454f service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:11.217612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9959ff-6db5-485f-9297-a81b370d454f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:11.219682 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ea9959ff-6db5-485f-9297-a81b370d454f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:11.232172 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9959ff-6db5-485f-9297-a81b370d454f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:11.233672 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9959ff-6db5-485f-9297-a81b370d454f service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:11.243638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1359/2719] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:28:14.369465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678773d-3378-416e-ac9f-9c98509cc392 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:14.370963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0678773d-3378-416e-ac9f-9c98509cc392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:14.390949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678773d-3378-416e-ac9f-9c98509cc392 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:14.396443 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9861568-0ede-4dd8-b3cf-3598a7543b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:14.397399 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861568-0ede-4dd8-b3cf-3598a7543b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:14.397688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861568-0ede-4dd8-b3cf-3598a7543b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:14.397969 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861568-0ede-4dd8-b3cf-3598a7543b4f admin admin] PATH_INFO: `/v3/users/d6db138644b14a20a43b3b1b3fa63314` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:14.399415 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9861568-0ede-4dd8-b3cf-3598a7543b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6db138644b14a20a43b3b1b3fa63314)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:14.401370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9861568-0ede-4dd8-b3cf-3598a7543b4f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:14.453785 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c9861568-0ede-4dd8-b3cf-3598a7543b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6db138644b14a20a43b3b1b3fa63314'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:14.454435 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c9861568-0ede-4dd8-b3cf-3598a7543b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6db138644b14a20a43b3b1b3fa63314'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:14.455079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c9861568-0ede-4dd8-b3cf-3598a7543b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6db138644b14a20a43b3b1b3fa63314'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:14.462500 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c9861568-0ede-4dd8-b3cf-3598a7543b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6db138644b14a20a43b3b1b3fa63314'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:14.471041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-c9861568-0ede-4dd8-b3cf-3598a7543b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6db138644b14a20a43b3b1b3fa63314'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:14.489852 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1361/2720] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:28:14 2022] DELETE /identity/v3/users/d6db138644b14a20a43b3b1b3fa63314 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:28:14.671253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9959ff-6db5-485f-9297-a81b370d454f service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:14.690955 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9959ff-6db5-485f-9297-a81b370d454f service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:14.759814 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:14.760751 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:14.761036 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:14.761350 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c admin admin] PATH_INFO: `/v3/projects/7e48122318d446438ef9974475c3f6ca` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:14.762624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e48122318d446438ef9974475c3f6ca)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:14.764620 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:14.812033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e48122318d446438ef9974475c3f6ca', 'request_id': 'req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:14.817540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e48122318d446438ef9974475c3f6ca', 'request_id': 'req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:14.827229 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e48122318d446438ef9974475c3f6ca', 'request_id': 'req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:14.838645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c admin admin] The token cache is being invalidate because project 7e48122318d446438ef9974475c3f6ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:28:14.838935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:14.839583 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-bfb82e11-5ce5-4ed0-b9e6-7743879c8e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:14.841151 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1360/2721] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:28:14 2022] DELETE /identity/v3/projects/7e48122318d446438ef9974475c3f6ca => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:28:14.846316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4c889-fa8c-452b-bdf6-9dd0877e90d6 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:14.846607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4c889-fa8c-452b-bdf6-9dd0877e90d6 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:14.846891 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4c889-fa8c-452b-bdf6-9dd0877e90d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:14.867509 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-38c4c889-fa8c-452b-bdf6-9dd0877e90d6 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:28:14.868713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-38c4c889-fa8c-452b-bdf6-9dd0877e90d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:14.942055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1362/2722] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:28:14.950114 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9449b22-578e-445a-a2bc-1fe875c6ca22 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:14.950499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9449b22-578e-445a-a2bc-1fe875c6ca22 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:14.950818 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9449b22-578e-445a-a2bc-1fe875c6ca22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:14.970982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-a9449b22-578e-445a-a2bc-1fe875c6ca22 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:28:14.972163 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a9449b22-578e-445a-a2bc-1fe875c6ca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:14.983391 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1361/2723] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:28:14.988319 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4c889-fa8c-452b-bdf6-9dd0877e90d6 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:14.999979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4c889-fa8c-452b-bdf6-9dd0877e90d6 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:15.005377 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c131ac1-5a05-4a05-8569-8fe0bc5ea14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:15.006115 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c131ac1-5a05-4a05-8569-8fe0bc5ea14a admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.006386 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c131ac1-5a05-4a05-8569-8fe0bc5ea14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.006896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c131ac1-5a05-4a05-8569-8fe0bc5ea14a admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.007809 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c131ac1-5a05-4a05-8569-8fe0bc5ea14a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:28:15.008128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c131ac1-5a05-4a05-8569-8fe0bc5ea14a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:15.009897 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c131ac1-5a05-4a05-8569-8fe0bc5ea14a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:15.025014 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1363/2724] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:28:15.029769 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9449b22-578e-445a-a2bc-1fe875c6ca22 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:15.040460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9449b22-578e-445a-a2bc-1fe875c6ca22 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:15.046427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9be9a-35cc-4b52-91ca-90976ac74302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:15.047111 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9be9a-35cc-4b52-91ca-90976ac74302 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.047397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9be9a-35cc-4b52-91ca-90976ac74302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.047755 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9be9a-35cc-4b52-91ca-90976ac74302 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.048404 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9be9a-35cc-4b52-91ca-90976ac74302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:15.050393 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9be9a-35cc-4b52-91ca-90976ac74302 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:15.079451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1362/2725] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:28:15 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:28:15.084041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c131ac1-5a05-4a05-8569-8fe0bc5ea14a admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:15.096093 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c131ac1-5a05-4a05-8569-8fe0bc5ea14a admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:15.158001 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a617a4-7c3d-435d-ba09-a977ac1adc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:15.158685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a617a4-7c3d-435d-ba09-a977ac1adc96 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.158964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a617a4-7c3d-435d-ba09-a977ac1adc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.159225 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a617a4-7c3d-435d-ba09-a977ac1adc96 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.159955 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a617a4-7c3d-435d-ba09-a977ac1adc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:15.161953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a617a4-7c3d-435d-ba09-a977ac1adc96 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:15.168983 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:15.188433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1364/2726] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:28:15 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:28:15.198378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9be9a-35cc-4b52-91ca-90976ac74302 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:15.209715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9be9a-35cc-4b52-91ca-90976ac74302 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:15.214748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48853e16-1bec-41d0-93b0-78d8670234ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:15.215419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48853e16-1bec-41d0-93b0-78d8670234ca admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.215702 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48853e16-1bec-41d0-93b0-78d8670234ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.215977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48853e16-1bec-41d0-93b0-78d8670234ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.216708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48853e16-1bec-41d0-93b0-78d8670234ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:15.218359 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48853e16-1bec-41d0-93b0-78d8670234ca admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:15.230547 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1363/2727] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:28:15.234545 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a617a4-7c3d-435d-ba09-a977ac1adc96 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:15.244752 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a617a4-7c3d-435d-ba09-a977ac1adc96 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:15.250325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951d65d-a5bc-4e0a-b234-3a06989f6dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:15.251135 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951d65d-a5bc-4e0a-b234-3a06989f6dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.251417 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951d65d-a5bc-4e0a-b234-3a06989f6dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.251690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951d65d-a5bc-4e0a-b234-3a06989f6dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.252424 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951d65d-a5bc-4e0a-b234-3a06989f6dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:15.254053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951d65d-a5bc-4e0a-b234-3a06989f6dc7 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:15.264517 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1365/2728] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:28:15.268758 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48853e16-1bec-41d0-93b0-78d8670234ca admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:15.279186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48853e16-1bec-41d0-93b0-78d8670234ca admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:15.283913 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d971cb-9364-4002-a037-38ffbf190ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:15.285063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d971cb-9364-4002-a037-38ffbf190ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.285516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d971cb-9364-4002-a037-38ffbf190ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.285793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d971cb-9364-4002-a037-38ffbf190ff0 admin admin] PATH_INFO: `/v3/projects/0514639fecb54485ac07bd78f4ac183e/users/4d1bfb2ee1db4bb7b3adf42602ac81d7/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.301608 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d971cb-9364-4002-a037-38ffbf190ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0514639fecb54485ac07bd78f4ac183e, user_id=4d1bfb2ee1db4bb7b3adf42602ac81d7, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:15.304426 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d971cb-9364-4002-a037-38ffbf190ff0 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:15.320076 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1364/2729] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:28:15 2022] PUT /identity/v3/projects/0514639fecb54485ac07bd78f4ac183e/users/4d1bfb2ee1db4bb7b3adf42602ac81d7/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:28:15.331552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2c9c7-0769-4d11-b516-69a6354466b3 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.331840 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2c9c7-0769-4d11-b516-69a6354466b3 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.332118 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2c9c7-0769-4d11-b516-69a6354466b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.363922 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-63d2c9c7-0769-4d11-b516-69a6354466b3 None None] MFA Rules not processed for user `4d1bfb2ee1db4bb7b3adf42602ac81d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:28:15.365256 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-63d2c9c7-0769-4d11-b516-69a6354466b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:15.446374 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1366/2730] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:28:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:28:15.451515 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d971cb-9364-4002-a037-38ffbf190ff0 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:15.467129 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:15.537937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d971cb-9364-4002-a037-38ffbf190ff0 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:15.543543 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b893e53-d39a-4d4b-ab6b-0a795fd6aa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:15.544209 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b893e53-d39a-4d4b-ab6b-0a795fd6aa19 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.544488 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b893e53-d39a-4d4b-ab6b-0a795fd6aa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.544761 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b893e53-d39a-4d4b-ab6b-0a795fd6aa19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.545483 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b893e53-d39a-4d4b-ab6b-0a795fd6aa19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:15.547403 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b893e53-d39a-4d4b-ab6b-0a795fd6aa19 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:15.578752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1365/2731] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:28:15 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:28:15.580129 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2c9c7-0769-4d11-b516-69a6354466b3 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:15.591820 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2c9c7-0769-4d11-b516-69a6354466b3 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:15.657089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf68b1f-a882-478b-afbc-af81ed6ca84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:15.657908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf68b1f-a882-478b-afbc-af81ed6ca84e admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.658190 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf68b1f-a882-478b-afbc-af81ed6ca84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.658466 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf68b1f-a882-478b-afbc-af81ed6ca84e admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.659170 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf68b1f-a882-478b-afbc-af81ed6ca84e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:15.661112 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf68b1f-a882-478b-afbc-af81ed6ca84e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:15.684552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1367/2732] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:28:15 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:28:15.688766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b893e53-d39a-4d4b-ab6b-0a795fd6aa19 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:15.701054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b893e53-d39a-4d4b-ab6b-0a795fd6aa19 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:15.707466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d93a-d307-49ce-ad5a-9b9a6e48b35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:15.708166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d93a-d307-49ce-ad5a-9b9a6e48b35a admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.708462 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d93a-d307-49ce-ad5a-9b9a6e48b35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.708746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d93a-d307-49ce-ad5a-9b9a6e48b35a admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.709518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8d93a-d307-49ce-ad5a-9b9a6e48b35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:15.711167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8d93a-d307-49ce-ad5a-9b9a6e48b35a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:15.723025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1366/2733] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:28:15.727737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf68b1f-a882-478b-afbc-af81ed6ca84e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:15.738814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf68b1f-a882-478b-afbc-af81ed6ca84e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:15.744815 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabe5a0-849d-4ee8-bfa8-1b7a7e83a62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:15.745756 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabe5a0-849d-4ee8-bfa8-1b7a7e83a62b admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.746055 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabe5a0-849d-4ee8-bfa8-1b7a7e83a62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.746355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabe5a0-849d-4ee8-bfa8-1b7a7e83a62b admin admin] PATH_INFO: `/v3/projects/b427e5dbf96049d482ad3639d478ab67/users/8c241704b6774d31950ebfe976f4c259/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.766121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabe5a0-849d-4ee8-bfa8-1b7a7e83a62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b427e5dbf96049d482ad3639d478ab67, user_id=8c241704b6774d31950ebfe976f4c259, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:15.768848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabe5a0-849d-4ee8-bfa8-1b7a7e83a62b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:15.784707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1368/2734] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:28:15 2022] PUT /identity/v3/projects/b427e5dbf96049d482ad3639d478ab67/users/8c241704b6774d31950ebfe976f4c259/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:28:15.788986 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d93a-d307-49ce-ad5a-9b9a6e48b35a admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:15.799258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d93a-d307-49ce-ad5a-9b9a6e48b35a admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:15.868663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55091f8e-8431-4f0b-9e88-de637cfaab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:15.869428 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55091f8e-8431-4f0b-9e88-de637cfaab07 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.869715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55091f8e-8431-4f0b-9e88-de637cfaab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.869993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55091f8e-8431-4f0b-9e88-de637cfaab07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.870774 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55091f8e-8431-4f0b-9e88-de637cfaab07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:15.872387 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55091f8e-8431-4f0b-9e88-de637cfaab07 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:15.887741 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1367/2735] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:28:15.888823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabe5a0-849d-4ee8-bfa8-1b7a7e83a62b admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:15.899963 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabe5a0-849d-4ee8-bfa8-1b7a7e83a62b admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:15.904739 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3765e-ce87-4ade-ab90-e5ceb6eaf8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:15.905664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3765e-ce87-4ade-ab90-e5ceb6eaf8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.905949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3765e-ce87-4ade-ab90-e5ceb6eaf8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.906228 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3765e-ce87-4ade-ab90-e5ceb6eaf8b0 admin admin] PATH_INFO: `/v3/projects/b427e5dbf96049d482ad3639d478ab67/users/8c241704b6774d31950ebfe976f4c259/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.908251 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3765e-ce87-4ade-ab90-e5ceb6eaf8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b427e5dbf96049d482ad3639d478ab67, user_id=8c241704b6774d31950ebfe976f4c259, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:15.910962 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3765e-ce87-4ade-ab90-e5ceb6eaf8b0 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:15.921525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1369/2736] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:28:15 2022] PUT /identity/v3/projects/b427e5dbf96049d482ad3639d478ab67/users/8c241704b6774d31950ebfe976f4c259/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:28:15.933059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba202-ef21-42f9-a087-3d85cdc182dd None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:15.933378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba202-ef21-42f9-a087-3d85cdc182dd None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:15.933749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba202-ef21-42f9-a087-3d85cdc182dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:15.964537 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-ebaba202-ef21-42f9-a087-3d85cdc182dd None None] MFA Rules not processed for user `8c241704b6774d31950ebfe976f4c259`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:28:15.965815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ebaba202-ef21-42f9-a087-3d85cdc182dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:16.038364 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1368/2737] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:28:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:28:16.050507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3765e-ce87-4ade-ab90-e5ceb6eaf8b0 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:16.052497 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e4d3765e-ce87-4ade-ab90-e5ceb6eaf8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:16.077025 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:16.115449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3765e-ce87-4ade-ab90-e5ceb6eaf8b0 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:16.119666 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12b35b-309c-4a3c-91ea-22cb806ac573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:16.120334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12b35b-309c-4a3c-91ea-22cb806ac573 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:16.120613 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12b35b-309c-4a3c-91ea-22cb806ac573 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:16.120888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12b35b-309c-4a3c-91ea-22cb806ac573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:16.131591 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12b35b-309c-4a3c-91ea-22cb806ac573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:16.133260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12b35b-309c-4a3c-91ea-22cb806ac573 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:16.143599 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1370/2738] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:28:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:28:16.230004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaba202-ef21-42f9-a087-3d85cdc182dd None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:16.231693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ebaba202-ef21-42f9-a087-3d85cdc182dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:16.247533 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaba202-ef21-42f9-a087-3d85cdc182dd None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:16.252187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111206e-8083-4594-8e17-b0dcf5f4e281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:16.253012 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111206e-8083-4594-8e17-b0dcf5f4e281 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:16.253348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111206e-8083-4594-8e17-b0dcf5f4e281 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:16.253647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111206e-8083-4594-8e17-b0dcf5f4e281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:16.259934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:16.327317 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111206e-8083-4594-8e17-b0dcf5f4e281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:16.329021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111206e-8083-4594-8e17-b0dcf5f4e281 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:16.340757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1369/2739] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:28:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:28:16.920757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12b35b-309c-4a3c-91ea-22cb806ac573 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:16.922529 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7a12b35b-309c-4a3c-91ea-22cb806ac573 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:16.990593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12b35b-309c-4a3c-91ea-22cb806ac573 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:16.995489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:16.996378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:16.996661 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:16.996970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] PATH_INFO: `/v3/users/61bd36c3ce394e37885870555a7c3ab5` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:16.998197 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61bd36c3ce394e37885870555a7c3ab5)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:17.000162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:17.052648 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61bd36c3ce394e37885870555a7c3ab5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:17.053307 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61bd36c3ce394e37885870555a7c3ab5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:17.053911 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61bd36c3ce394e37885870555a7c3ab5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:17.061022 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61bd36c3ce394e37885870555a7c3ab5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:17.069417 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61bd36c3ce394e37885870555a7c3ab5'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:17.086962 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1371/2740] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:28:16 2022] DELETE /identity/v3/users/61bd36c3ce394e37885870555a7c3ab5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:28:17.091546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c2ae6-ed1f-408c-ac21-99756711a06a None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:17.092041 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c2ae6-ed1f-408c-ac21-99756711a06a None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:17.092170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c2ae6-ed1f-408c-ac21-99756711a06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:17.109611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-5f4c2ae6-ed1f-408c-ac21-99756711a06a None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:28:17.110933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-5f4c2ae6-ed1f-408c-ac21-99756711a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:17.177575 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1370/2741] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:28:17.187857 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:17.189439 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:17.236647 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:17.251498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef0fcb-76b3-4fa7-abe2-4b0fe9803181 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:17.255421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02429b33-e434-40c8-909d-1951c416dbfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:17.256075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02429b33-e434-40c8-909d-1951c416dbfa service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:17.256355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02429b33-e434-40c8-909d-1951c416dbfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:17.256630 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02429b33-e434-40c8-909d-1951c416dbfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:17.266203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02429b33-e434-40c8-909d-1951c416dbfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:17.268146 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02429b33-e434-40c8-909d-1951c416dbfa service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:17.278272 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1372/2742] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:28:17.558186 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c2ae6-ed1f-408c-ac21-99756711a06a None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:17.559778 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-5f4c2ae6-ed1f-408c-ac21-99756711a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:17.574150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c2ae6-ed1f-408c-ac21-99756711a06a None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:17.580624 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:17.582368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:17.582663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:17.582925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4 admin admin] PATH_INFO: `/v3/projects/9d7a05c5fea247999b9506642b1b13d8` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:17.584563 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7a05c5fea247999b9506642b1b13d8)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:17.586811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:17.639944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7a05c5fea247999b9506642b1b13d8', 'request_id': 'req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:17.646143 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7a05c5fea247999b9506642b1b13d8', 'request_id': 'req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:17.654969 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7a05c5fea247999b9506642b1b13d8', 'request_id': 'req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:17.666452 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4 admin admin] The token cache is being invalidate because project 9d7a05c5fea247999b9506642b1b13d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:28:17.666745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:17.667411 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2457bc06-ba4d-4e3e-9ea3-ef35240144d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:17.668983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1371/2743] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:28:17 2022] DELETE /identity/v3/projects/9d7a05c5fea247999b9506642b1b13d8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:28:17.675152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127bfa-35a3-40ed-a437-c970db5af774 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:17.675675 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127bfa-35a3-40ed-a437-c970db5af774 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:17.676180 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127bfa-35a3-40ed-a437-c970db5af774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:17.698827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-52127bfa-35a3-40ed-a437-c970db5af774 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:28:17.700116 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-52127bfa-35a3-40ed-a437-c970db5af774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:17.764340 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1373/2744] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:28:17.833664 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7b1d-aa40-4c28-bf78-2da36940f8f7 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:17.834021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7b1d-aa40-4c28-bf78-2da36940f8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:17.834414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7b1d-aa40-4c28-bf78-2da36940f8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:17.857553 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-5b3d7b1d-aa40-4c28-bf78-2da36940f8f7 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:28:17.858975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-5b3d7b1d-aa40-4c28-bf78-2da36940f8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:17.868516 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1372/2745] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:28:17.874002 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52127bfa-35a3-40ed-a437-c970db5af774 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:17.887455 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52127bfa-35a3-40ed-a437-c970db5af774 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:17.893142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6868669-6ec6-47d0-baaa-bb474f1507ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:17.893959 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6868669-6ec6-47d0-baaa-bb474f1507ed admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:17.894272 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6868669-6ec6-47d0-baaa-bb474f1507ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:17.894583 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6868669-6ec6-47d0-baaa-bb474f1507ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:17.895617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6868669-6ec6-47d0-baaa-bb474f1507ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:28:17.896030 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6868669-6ec6-47d0-baaa-bb474f1507ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:17.899216 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6868669-6ec6-47d0-baaa-bb474f1507ed admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:17.920937 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1374/2746] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:28:17.925616 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d7b1d-aa40-4c28-bf78-2da36940f8f7 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:17.935804 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d7b1d-aa40-4c28-bf78-2da36940f8f7 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:17.940885 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85126ab-76e8-4d3a-b9b0-5910fce4ba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:17.941593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85126ab-76e8-4d3a-b9b0-5910fce4ba97 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:17.941877 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85126ab-76e8-4d3a-b9b0-5910fce4ba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:17.942158 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85126ab-76e8-4d3a-b9b0-5910fce4ba97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:17.942873 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85126ab-76e8-4d3a-b9b0-5910fce4ba97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:17.944805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85126ab-76e8-4d3a-b9b0-5910fce4ba97 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:17.971133 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1373/2747] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:28:17 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:28:17.975557 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6868669-6ec6-47d0-baaa-bb474f1507ed admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:17.985758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6868669-6ec6-47d0-baaa-bb474f1507ed admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:18.047184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c701c7-39fc-4d12-981a-b316ee2674a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:18.047859 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c701c7-39fc-4d12-981a-b316ee2674a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:18.048139 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c701c7-39fc-4d12-981a-b316ee2674a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:18.048413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c701c7-39fc-4d12-981a-b316ee2674a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:18.049099 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c701c7-39fc-4d12-981a-b316ee2674a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:18.051081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c701c7-39fc-4d12-981a-b316ee2674a8 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:18.074196 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1375/2748] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:28:17 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:28:18.080293 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85126ab-76e8-4d3a-b9b0-5910fce4ba97 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:18.088508 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:18.095933 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85126ab-76e8-4d3a-b9b0-5910fce4ba97 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:18.103846 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d93e-10a1-4c3e-a7b5-38edceb0c3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:18.104778 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d93e-10a1-4c3e-a7b5-38edceb0c3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:18.105064 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d93e-10a1-4c3e-a7b5-38edceb0c3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:18.105361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d93e-10a1-4c3e-a7b5-38edceb0c3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:18.106353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666d93e-10a1-4c3e-a7b5-38edceb0c3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:18.108998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666d93e-10a1-4c3e-a7b5-38edceb0c3e8 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:18.122451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1374/2749] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:28:18.126906 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c701c7-39fc-4d12-981a-b316ee2674a8 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:18.140201 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c701c7-39fc-4d12-981a-b316ee2674a8 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:18.148050 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af748d-ae66-442d-9049-c3394cf374e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:18.148958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af748d-ae66-442d-9049-c3394cf374e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:18.149263 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af748d-ae66-442d-9049-c3394cf374e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:18.149553 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af748d-ae66-442d-9049-c3394cf374e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:18.150316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af748d-ae66-442d-9049-c3394cf374e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:18.152195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af748d-ae66-442d-9049-c3394cf374e1 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:18.163192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1376/2750] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:28:18.167629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d93e-10a1-4c3e-a7b5-38edceb0c3e8 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:18.178663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d93e-10a1-4c3e-a7b5-38edceb0c3e8 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:18.184685 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98904a4-5c6d-4136-b209-4e850c6e98bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:18.185635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98904a4-5c6d-4136-b209-4e850c6e98bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:18.185917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98904a4-5c6d-4136-b209-4e850c6e98bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:18.186198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98904a4-5c6d-4136-b209-4e850c6e98bb admin admin] PATH_INFO: `/v3/projects/aafd6d9a6d134f538a61498790991c0c/users/63d931e360f94cf78880ec2f2970a066/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:18.202945 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98904a4-5c6d-4136-b209-4e850c6e98bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aafd6d9a6d134f538a61498790991c0c, user_id=63d931e360f94cf78880ec2f2970a066, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:18.205693 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98904a4-5c6d-4136-b209-4e850c6e98bb admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:18.221053 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1375/2751] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:28:18 2022] PUT /identity/v3/projects/aafd6d9a6d134f538a61498790991c0c/users/63d931e360f94cf78880ec2f2970a066/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:28:18.226398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ded12-2809-4f26-9b66-13763cb5978f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:18.226649 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ded12-2809-4f26-9b66-13763cb5978f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:18.226925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ded12-2809-4f26-9b66-13763cb5978f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:18.246352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e02ded12-2809-4f26-9b66-13763cb5978f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:28:18.247997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e02ded12-2809-4f26-9b66-13763cb5978f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:18.297682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:18.315712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1377/2752] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:28:18.327040 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98904a4-5c6d-4136-b209-4e850c6e98bb admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:18.329635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d98904a4-5c6d-4136-b209-4e850c6e98bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:18.413016 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98904a4-5c6d-4136-b209-4e850c6e98bb admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:18.417592 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a45bc0-773c-4fc8-aea4-9e0524d18a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:18.418274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a45bc0-773c-4fc8-aea4-9e0524d18a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:18.418566 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a45bc0-773c-4fc8-aea4-9e0524d18a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:18.418849 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a45bc0-773c-4fc8-aea4-9e0524d18a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:18.429459 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a45bc0-773c-4fc8-aea4-9e0524d18a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:18.431025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a45bc0-773c-4fc8-aea4-9e0524d18a2f service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:18.442064 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1376/2753] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:28:20.077554 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ded12-2809-4f26-9b66-13763cb5978f None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:20.088494 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ded12-2809-4f26-9b66-13763cb5978f None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:20.092686 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3f655-34d7-441c-b74f-b039d17418cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:20.093606 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3f655-34d7-441c-b74f-b039d17418cd service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:20.093889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3f655-34d7-441c-b74f-b039d17418cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:20.094192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3f655-34d7-441c-b74f-b039d17418cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:20.096100 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-9fc3f655-34d7-441c-b74f-b039d17418cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:20.159688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3f655-34d7-441c-b74f-b039d17418cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:20.161898 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3f655-34d7-441c-b74f-b039d17418cd service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:20.172997 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1378/2754] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:28:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:28:23.565209 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50672b0-bc2b-4800-bf4b-8370db829203 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:23.565813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50672b0-bc2b-4800-bf4b-8370db829203 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:23.566000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50672b0-bc2b-4800-bf4b-8370db829203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:23.601431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-f50672b0-bc2b-4800-bf4b-8370db829203 None None] MFA Rules not processed for user `63d931e360f94cf78880ec2f2970a066`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:28:23.602677 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f50672b0-bc2b-4800-bf4b-8370db829203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:23.678976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1377/2755] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:28:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:28:23.680180 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3f655-34d7-441c-b74f-b039d17418cd service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:23.693240 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3f655-34d7-441c-b74f-b039d17418cd service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:23.698527 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e1112-e6ad-41ec-8eca-1250a8d50779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:23.699429 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e1112-e6ad-41ec-8eca-1250a8d50779 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:23.699787 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e1112-e6ad-41ec-8eca-1250a8d50779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:23.700102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e1112-e6ad-41ec-8eca-1250a8d50779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:23.700783 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e1112-e6ad-41ec-8eca-1250a8d50779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:23.702980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e1112-e6ad-41ec-8eca-1250a8d50779 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:23.738738 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1379/2756] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:28:23 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:28:23.743287 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50672b0-bc2b-4800-bf4b-8370db829203 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:23.758407 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50672b0-bc2b-4800-bf4b-8370db829203 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:23.825049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942786f-691e-4aff-bfa6-5bcedf2c9da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:23.825927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942786f-691e-4aff-bfa6-5bcedf2c9da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:23.826178 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942786f-691e-4aff-bfa6-5bcedf2c9da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:23.826511 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942786f-691e-4aff-bfa6-5bcedf2c9da4 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:23.827282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942786f-691e-4aff-bfa6-5bcedf2c9da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:23.829394 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942786f-691e-4aff-bfa6-5bcedf2c9da4 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:23.836339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:23.851098 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1378/2757] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:28:23 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:28:23.855736 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e1112-e6ad-41ec-8eca-1250a8d50779 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:23.878238 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e1112-e6ad-41ec-8eca-1250a8d50779 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:23.883657 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c18df-a7fe-4f49-a221-606a236c3d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:23.884542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c18df-a7fe-4f49-a221-606a236c3d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:23.885033 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c18df-a7fe-4f49-a221-606a236c3d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:23.885555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c18df-a7fe-4f49-a221-606a236c3d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:23.886662 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c18df-a7fe-4f49-a221-606a236c3d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:23.888690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c18df-a7fe-4f49-a221-606a236c3d19 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:23.901345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1380/2758] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:28:23.905623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942786f-691e-4aff-bfa6-5bcedf2c9da4 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:23.921747 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c18df-a7fe-4f49-a221-606a236c3d19 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:23.922879 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942786f-691e-4aff-bfa6-5bcedf2c9da4 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:23.925414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-578c18df-a7fe-4f49-a221-606a236c3d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:23.933095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff1425-d112-42d4-90b4-150b27a7e57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:23.934577 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff1425-d112-42d4-90b4-150b27a7e57e admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:23.934924 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff1425-d112-42d4-90b4-150b27a7e57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:23.935265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff1425-d112-42d4-90b4-150b27a7e57e admin admin] PATH_INFO: `/v3/projects/b871f9f08b4d4b65b462c28e0d4df924/users/5f339204d14e4043aeb4d4811ceab07c/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:23.953731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff1425-d112-42d4-90b4-150b27a7e57e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b871f9f08b4d4b65b462c28e0d4df924, user_id=5f339204d14e4043aeb4d4811ceab07c, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:23.956757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff1425-d112-42d4-90b4-150b27a7e57e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:23.977314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1379/2759] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:28:23 2022] PUT /identity/v3/projects/b871f9f08b4d4b65b462c28e0d4df924/users/5f339204d14e4043aeb4d4811ceab07c/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:28:23.981662 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff1425-d112-42d4-90b4-150b27a7e57e admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:24.034558 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c18df-a7fe-4f49-a221-606a236c3d19 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:24.064191 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff1425-d112-42d4-90b4-150b27a7e57e admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:24.071580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf629c2-32d0-41f1-844a-f28dd226a7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:24.073102 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf629c2-32d0-41f1-844a-f28dd226a7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:24.073868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf629c2-32d0-41f1-844a-f28dd226a7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:24.074564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf629c2-32d0-41f1-844a-f28dd226a7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:24.076196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf629c2-32d0-41f1-844a-f28dd226a7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:24.078830 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf629c2-32d0-41f1-844a-f28dd226a7e7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:24.095528 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1380/2760] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 07:28:24.096939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf629c2-32d0-41f1-844a-f28dd226a7e7 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:24.098571 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:24.110182 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf629c2-32d0-41f1-844a-f28dd226a7e7 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:24.115627 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40416527-a9c4-46fd-ac15-0f1c90d82198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:24.116985 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40416527-a9c4-46fd-ac15-0f1c90d82198 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:24.117311 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40416527-a9c4-46fd-ac15-0f1c90d82198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:24.117598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40416527-a9c4-46fd-ac15-0f1c90d82198 admin admin] PATH_INFO: `/v3/projects/b871f9f08b4d4b65b462c28e0d4df924/users/5f339204d14e4043aeb4d4811ceab07c/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:24.119841 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27bac2-3524-4341-add4-3f465b9ead52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:24.120002 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40416527-a9c4-46fd-ac15-0f1c90d82198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b871f9f08b4d4b65b462c28e0d4df924, user_id=5f339204d14e4043aeb4d4811ceab07c, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:24.120843 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27bac2-3524-4341-add4-3f465b9ead52 service placement] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:24.122029 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27bac2-3524-4341-add4-3f465b9ead52 service placement] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:24.122499 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27bac2-3524-4341-add4-3f465b9ead52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:24.122725 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40416527-a9c4-46fd-ac15-0f1c90d82198 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:24.124943 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-df27bac2-3524-4341-add4-3f465b9ead52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:24.134825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1381/2761] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:28:24 2022] PUT /identity/v3/projects/b871f9f08b4d4b65b462c28e0d4df924/users/5f339204d14e4043aeb4d4811ceab07c/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:28:24.150361 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27bac2-3524-4341-add4-3f465b9ead52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:24.152158 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27bac2-3524-4341-add4-3f465b9ead52 service placement] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:24.169317 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1381/2762] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:28:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:28:27.151928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40416527-a9c4-46fd-ac15-0f1c90d82198 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:27.154637 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-40416527-a9c4-46fd-ac15-0f1c90d82198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:27.244877 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40416527-a9c4-46fd-ac15-0f1c90d82198 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:27.260347 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dc2d6-4419-4364-86fa-f7ebdd1bcb55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:27.262409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dc2d6-4419-4364-86fa-f7ebdd1bcb55 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:27.269715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dc2d6-4419-4364-86fa-f7ebdd1bcb55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:27.270259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dc2d6-4419-4364-86fa-f7ebdd1bcb55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:27.280930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6f4dc2d6-4419-4364-86fa-f7ebdd1bcb55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:27.413193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dc2d6-4419-4364-86fa-f7ebdd1bcb55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:27.418104 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dc2d6-4419-4364-86fa-f7ebdd1bcb55 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:27.428622 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:27.463593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1382/2763] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:28:30.928759 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c644a5-5a00-4e6d-a330-80a5d69fb594 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:30.929701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c644a5-5a00-4e6d-a330-80a5d69fb594 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:30.930179 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c644a5-5a00-4e6d-a330-80a5d69fb594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:30.974516 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-f1c644a5-5a00-4e6d-a330-80a5d69fb594 None None] MFA Rules not processed for user `5f339204d14e4043aeb4d4811ceab07c`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:28:30.975974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f1c644a5-5a00-4e6d-a330-80a5d69fb594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:31.091783 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1382/2764] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:28:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 07:28:31.103998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dc2d6-4419-4364-86fa-f7ebdd1bcb55 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:31.105701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-6f4dc2d6-4419-4364-86fa-f7ebdd1bcb55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:31.201792 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dc2d6-4419-4364-86fa-f7ebdd1bcb55 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:31.208272 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8c74e-4db7-49d6-a3ca-29027c28aa7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:31.208555 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8c74e-4db7-49d6-a3ca-29027c28aa7c service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:31.208838 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8c74e-4db7-49d6-a3ca-29027c28aa7c service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:31.209113 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8c74e-4db7-49d6-a3ca-29027c28aa7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:31.287800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8c74e-4db7-49d6-a3ca-29027c28aa7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:31.289975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8c74e-4db7-49d6-a3ca-29027c28aa7c service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:31.302169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1383/2765] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:28:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:28:36.696901 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c644a5-5a00-4e6d-a330-80a5d69fb594 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:36.699195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f1c644a5-5a00-4e6d-a330-80a5d69fb594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:36.725742 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c644a5-5a00-4e6d-a330-80a5d69fb594 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:36.731015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:36.732637 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:36.733429 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:36.733429 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] PATH_INFO: `/v3/users/e1f0d73f1807487ca3eb016660b29f47` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:36.734893 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f0d73f1807487ca3eb016660b29f47)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:36.736745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:36.801910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f0d73f1807487ca3eb016660b29f47'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:36.802701 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f0d73f1807487ca3eb016660b29f47'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:36.803668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f0d73f1807487ca3eb016660b29f47'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:36.813325 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f0d73f1807487ca3eb016660b29f47'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:36.822830 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f0d73f1807487ca3eb016660b29f47'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:36.853301 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1383/2766] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:28:36 2022] DELETE /identity/v3/users/e1f0d73f1807487ca3eb016660b29f47 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:28:37.069275 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8c74e-4db7-49d6-a3ca-29027c28aa7c service nova] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:37.085863 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8c74e-4db7-49d6-a3ca-29027c28aa7c service nova] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:37.159096 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:37.159998 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:37.160280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:37.160564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] PATH_INFO: `/v3/projects/9ee25b35791243e698a41375cca91cea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:37.161916 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee25b35791243e698a41375cca91cea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:37.164079 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:37.204412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:37.213549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee25b35791243e698a41375cca91cea', 'request_id': 'req-0f92a2f0-b7d4-46f5-938f-e72c4633c192'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.219411 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee25b35791243e698a41375cca91cea', 'request_id': 'req-0f92a2f0-b7d4-46f5-938f-e72c4633c192'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.227614 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee25b35791243e698a41375cca91cea', 'request_id': 'req-0f92a2f0-b7d4-46f5-938f-e72c4633c192'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.238884 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] The token cache is being invalidate because project 9ee25b35791243e698a41375cca91cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:28:37.239140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.239795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.241416 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1384/2767] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:28:37 2022] DELETE /identity/v3/projects/9ee25b35791243e698a41375cca91cea => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:28:37.245618 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:37.247561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:37.263674 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57b3c9-a1f9-4f03-b87d-85d7451df028 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:37.309048 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:37.330019 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee5cbf-e937-4e6d-9b22-584acfde1926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:37.330973 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5cbf-e937-4e6d-9b22-584acfde1926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:37.331279 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5cbf-e937-4e6d-9b22-584acfde1926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:37.331559 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5cbf-e937-4e6d-9b22-584acfde1926 admin admin] PATH_INFO: `/v3/users/390ddc7f829045d78947949d6863b3ad` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:37.332768 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee5cbf-e937-4e6d-9b22-584acfde1926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=390ddc7f829045d78947949d6863b3ad)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:37.334777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee5cbf-e937-4e6d-9b22-584acfde1926 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:37.386728 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-53ee5cbf-e937-4e6d-9b22-584acfde1926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390ddc7f829045d78947949d6863b3ad'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.387682 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-53ee5cbf-e937-4e6d-9b22-584acfde1926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390ddc7f829045d78947949d6863b3ad'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.388316 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-53ee5cbf-e937-4e6d-9b22-584acfde1926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390ddc7f829045d78947949d6863b3ad'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.397597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-53ee5cbf-e937-4e6d-9b22-584acfde1926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390ddc7f829045d78947949d6863b3ad'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.407274 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-53ee5cbf-e937-4e6d-9b22-584acfde1926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390ddc7f829045d78947949d6863b3ad'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.427086 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1384/2768] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:28:37 2022] DELETE /identity/v3/users/390ddc7f829045d78947949d6863b3ad => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:28:37.630629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:28:37.632931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:28:37.647238 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92a2f0-b7d4-46f5-938f-e72c4633c192 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:28:37.712570 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:28:37.713518 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:28:37.713801 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:28:37.714078 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] PATH_INFO: `/v3/projects/a0a7dd0cca974394af1e32d2977a5a8d` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:28:37.715343 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a7dd0cca974394af1e32d2977a5a8d)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:28:37.717314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:28:37.775670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a7dd0cca974394af1e32d2977a5a8d', 'request_id': 'req-1866be86-68ce-4470-9e51-3be9047673a7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.781253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a7dd0cca974394af1e32d2977a5a8d', 'request_id': 'req-1866be86-68ce-4470-9e51-3be9047673a7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.789874 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a7dd0cca974394af1e32d2977a5a8d', 'request_id': 'req-1866be86-68ce-4470-9e51-3be9047673a7'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.801339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] The token cache is being invalidate because project a0a7dd0cca974394af1e32d2977a5a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:28:37.801625 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.802244 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:28:37.803826 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1385/2769] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:28:37 2022] DELETE /identity/v3/projects/a0a7dd0cca974394af1e32d2977a5a8d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:28:47.423185 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:47.798419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:05.565746 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4c95-01ca-4c91-9b35-abca92d160b0 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:05.566290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4c95-01ca-4c91-9b35-abca92d160b0 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:05.566290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4c95-01ca-4c91-9b35-abca92d160b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:05.586924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-b6ad4c95-01ca-4c91-9b35-abca92d160b0 None None] MFA Rules not processed for user `ba90d232c52145288745a765f6131023`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:05.588170 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b6ad4c95-01ca-4c91-9b35-abca92d160b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:05.653345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1385/2770] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:05.902318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:05.904011 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:05.966105 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866be86-68ce-4470-9e51-3be9047673a7 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:05.970017 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca82c6-aa28-4b10-90b0-09c31ee9ecdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:05.970793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca82c6-aa28-4b10-90b0-09c31ee9ecdc service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:05.971004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca82c6-aa28-4b10-90b0-09c31ee9ecdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:05.971271 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca82c6-aa28-4b10-90b0-09c31ee9ecdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:05.973247 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a0ca82c6-aa28-4b10-90b0-09c31ee9ecdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:05.983759 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca82c6-aa28-4b10-90b0-09c31ee9ecdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:05.985195 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca82c6-aa28-4b10-90b0-09c31ee9ecdc service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:05.996732 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1386/2771] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:29:06.355424 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4c95-01ca-4c91-9b35-abca92d160b0 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:06.357298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-b6ad4c95-01ca-4c91-9b35-abca92d160b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:06.443941 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4c95-01ca-4c91-9b35-abca92d160b0 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:06.457979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:06.459058 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:06.459402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:06.459683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] PATH_INFO: `/v3/users/4d1bfb2ee1db4bb7b3adf42602ac81d7` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:06.460956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1bfb2ee1db4bb7b3adf42602ac81d7)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:06.462956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:06.512940 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1bfb2ee1db4bb7b3adf42602ac81d7'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:06.513616 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1bfb2ee1db4bb7b3adf42602ac81d7'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:06.514217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1bfb2ee1db4bb7b3adf42602ac81d7'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:06.521774 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1bfb2ee1db4bb7b3adf42602ac81d7'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:06.530949 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1bfb2ee1db4bb7b3adf42602ac81d7'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:06.551046 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1386/2772] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:29:06 2022] DELETE /identity/v3/users/4d1bfb2ee1db4bb7b3adf42602ac81d7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:06.556540 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ce0ee-8421-4e53-93fa-52aaedd69e56 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:06.556831 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ce0ee-8421-4e53-93fa-52aaedd69e56 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:06.557112 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ce0ee-8421-4e53-93fa-52aaedd69e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:06.577939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-995ce0ee-8421-4e53-93fa-52aaedd69e56 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:06.579295 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-995ce0ee-8421-4e53-93fa-52aaedd69e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:06.640800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1387/2773] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:06.650789 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:06.652298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:06.683928 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:06.717798 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be619-bf21-45d3-b622-6f73a8d68275 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:06.722292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c6e26-7bfc-4ee8-8627-d4c2406fa6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:06.722957 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c6e26-7bfc-4ee8-8627-d4c2406fa6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:06.723241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c6e26-7bfc-4ee8-8627-d4c2406fa6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:06.723515 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c6e26-7bfc-4ee8-8627-d4c2406fa6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:06.736394 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c6e26-7bfc-4ee8-8627-d4c2406fa6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:06.737896 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c6e26-7bfc-4ee8-8627-d4c2406fa6b4 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:06.749370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1387/2774] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 07:29:07.044959 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ce0ee-8421-4e53-93fa-52aaedd69e56 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:07.046787 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-995ce0ee-8421-4e53-93fa-52aaedd69e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:07.060687 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ce0ee-8421-4e53-93fa-52aaedd69e56 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:07.065720 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8eb75-48f0-4b29-a848-dbde87bf0394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:07.066721 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8eb75-48f0-4b29-a848-dbde87bf0394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:07.067915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8eb75-48f0-4b29-a848-dbde87bf0394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:07.068242 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8eb75-48f0-4b29-a848-dbde87bf0394 admin admin] PATH_INFO: `/v3/projects/0514639fecb54485ac07bd78f4ac183e` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:07.069836 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8eb75-48f0-4b29-a848-dbde87bf0394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0514639fecb54485ac07bd78f4ac183e)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:07.072696 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8eb75-48f0-4b29-a848-dbde87bf0394 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:07.121524 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e9c8eb75-48f0-4b29-a848-dbde87bf0394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0514639fecb54485ac07bd78f4ac183e', 'request_id': 'req-e9c8eb75-48f0-4b29-a848-dbde87bf0394'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.126892 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e9c8eb75-48f0-4b29-a848-dbde87bf0394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0514639fecb54485ac07bd78f4ac183e', 'request_id': 'req-e9c8eb75-48f0-4b29-a848-dbde87bf0394'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.134380 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e9c8eb75-48f0-4b29-a848-dbde87bf0394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0514639fecb54485ac07bd78f4ac183e', 'request_id': 'req-e9c8eb75-48f0-4b29-a848-dbde87bf0394'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.148047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e9c8eb75-48f0-4b29-a848-dbde87bf0394 admin admin] The token cache is being invalidate because project 0514639fecb54485ac07bd78f4ac183e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:29:07.148334 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e9c8eb75-48f0-4b29-a848-dbde87bf0394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.148962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-e9c8eb75-48f0-4b29-a848-dbde87bf0394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.150567 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1388/2775] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:29:07 2022] DELETE /identity/v3/projects/0514639fecb54485ac07bd78f4ac183e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:29:07.154616 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c6e26-7bfc-4ee8-8627-d4c2406fa6b4 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:07.164786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c6e26-7bfc-4ee8-8627-d4c2406fa6b4 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:07.222169 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:07.223047 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:07.223332 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:07.223612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] PATH_INFO: `/v3/users/8c241704b6774d31950ebfe976f4c259` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:07.224799 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c241704b6774d31950ebfe976f4c259)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:07.226838 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:07.279438 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c241704b6774d31950ebfe976f4c259'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.280205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c241704b6774d31950ebfe976f4c259'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.280693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c241704b6774d31950ebfe976f4c259'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.287794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c241704b6774d31950ebfe976f4c259'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.296630 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c241704b6774d31950ebfe976f4c259'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.317498 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1388/2776] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:29:07 2022] DELETE /identity/v3/users/8c241704b6774d31950ebfe976f4c259 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:07.393245 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c1fca-95da-4af4-8c18-4bd6e9fd0c80 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:07.393601 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c1fca-95da-4af4-8c18-4bd6e9fd0c80 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:07.394600 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c1fca-95da-4af4-8c18-4bd6e9fd0c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:07.418009 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-000c1fca-95da-4af4-8c18-4bd6e9fd0c80 None None] MFA Rules not processed for user `63d931e360f94cf78880ec2f2970a066`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:07.419241 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-000c1fca-95da-4af4-8c18-4bd6e9fd0c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:07.440967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:07.515647 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1389/2777] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:07.771990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:07.773612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:07.838280 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:07.861163 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3161c-22af-42d0-9fe1-1a8f9d9d4575 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:07.866693 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183dea9-4695-4d98-9fcb-21d7f5f50273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:07.868290 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183dea9-4695-4d98-9fcb-21d7f5f50273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:07.868664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183dea9-4695-4d98-9fcb-21d7f5f50273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:07.868956 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183dea9-4695-4d98-9fcb-21d7f5f50273 admin admin] PATH_INFO: `/v3/projects/b427e5dbf96049d482ad3639d478ab67` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:07.870276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183dea9-4695-4d98-9fcb-21d7f5f50273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b427e5dbf96049d482ad3639d478ab67)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:07.872330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183dea9-4695-4d98-9fcb-21d7f5f50273 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:07.935822 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5183dea9-4695-4d98-9fcb-21d7f5f50273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b427e5dbf96049d482ad3639d478ab67', 'request_id': 'req-5183dea9-4695-4d98-9fcb-21d7f5f50273'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.950346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5183dea9-4695-4d98-9fcb-21d7f5f50273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b427e5dbf96049d482ad3639d478ab67', 'request_id': 'req-5183dea9-4695-4d98-9fcb-21d7f5f50273'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.959884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5183dea9-4695-4d98-9fcb-21d7f5f50273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b427e5dbf96049d482ad3639d478ab67', 'request_id': 'req-5183dea9-4695-4d98-9fcb-21d7f5f50273'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.975285 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5183dea9-4695-4d98-9fcb-21d7f5f50273 admin admin] The token cache is being invalidate because project b427e5dbf96049d482ad3639d478ab67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:29:07.975687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5183dea9-4695-4d98-9fcb-21d7f5f50273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.976420 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-5183dea9-4695-4d98-9fcb-21d7f5f50273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:07.981528 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1389/2778] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:29:07 2022] DELETE /identity/v3/projects/b427e5dbf96049d482ad3639d478ab67 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:07.983499 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cfca6-3ab6-4c8b-a2f4-c258547ac127 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:07.983667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cfca6-3ab6-4c8b-a2f4-c258547ac127 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:07.983926 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cfca6-3ab6-4c8b-a2f4-c258547ac127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.003352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-2a0cfca6-3ab6-4c8b-a2f4-c258547ac127 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:08.004580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2a0cfca6-3ab6-4c8b-a2f4-c258547ac127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:08.077209 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1390/2779] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:08.085916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cbf01-152a-4b3f-a061-bff07de2142f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:08.086225 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cbf01-152a-4b3f-a061-bff07de2142f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:08.086485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cbf01-152a-4b3f-a061-bff07de2142f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.107117 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-d00cbf01-152a-4b3f-a061-bff07de2142f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:08.108712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d00cbf01-152a-4b3f-a061-bff07de2142f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:08.119663 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1390/2780] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:08.123898 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cfca6-3ab6-4c8b-a2f4-c258547ac127 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:08.135109 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cfca6-3ab6-4c8b-a2f4-c258547ac127 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:08.142960 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23da0d6-0043-40ef-bb33-5bf81b767de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:08.144298 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23da0d6-0043-40ef-bb33-5bf81b767de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:08.144679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23da0d6-0043-40ef-bb33-5bf81b767de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:08.145075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23da0d6-0043-40ef-bb33-5bf81b767de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.146683 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23da0d6-0043-40ef-bb33-5bf81b767de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:29:08.147097 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23da0d6-0043-40ef-bb33-5bf81b767de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:08.149480 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23da0d6-0043-40ef-bb33-5bf81b767de5 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:08.164607 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1391/2781] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:29:08.168958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cbf01-152a-4b3f-a061-bff07de2142f None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:08.181702 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cbf01-152a-4b3f-a061-bff07de2142f None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:08.187907 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677195d-f8a7-4af8-b164-4d9e2a1cc95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:08.188751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677195d-f8a7-4af8-b164-4d9e2a1cc95a admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:08.189031 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677195d-f8a7-4af8-b164-4d9e2a1cc95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:08.189341 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677195d-f8a7-4af8-b164-4d9e2a1cc95a admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.190081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677195d-f8a7-4af8-b164-4d9e2a1cc95a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:08.192180 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677195d-f8a7-4af8-b164-4d9e2a1cc95a admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:08.230263 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1391/2782] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:29:08 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:29:08.231698 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23da0d6-0043-40ef-bb33-5bf81b767de5 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:08.243085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23da0d6-0043-40ef-bb33-5bf81b767de5 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:08.307848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bcf7c-e6f4-430d-a248-0420b44db9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:08.308331 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bcf7c-e6f4-430d-a248-0420b44db9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:08.308620 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bcf7c-e6f4-430d-a248-0420b44db9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:08.308905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bcf7c-e6f4-430d-a248-0420b44db9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.310439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bcf7c-e6f4-430d-a248-0420b44db9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:08.312175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bcf7c-e6f4-430d-a248-0420b44db9c9 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:08.340282 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1392/2783] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:29:08 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:29:08.345752 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677195d-f8a7-4af8-b164-4d9e2a1cc95a admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:08.358626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677195d-f8a7-4af8-b164-4d9e2a1cc95a admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:08.365816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2badf7e-e110-4173-aa12-e8bae25e0ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:08.366698 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2badf7e-e110-4173-aa12-e8bae25e0ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:08.366837 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2badf7e-e110-4173-aa12-e8bae25e0ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:08.367125 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2badf7e-e110-4173-aa12-e8bae25e0ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.367967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2badf7e-e110-4173-aa12-e8bae25e0ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:08.374398 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2badf7e-e110-4173-aa12-e8bae25e0ca6 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:08.387573 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1392/2784] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:29:08.389793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bcf7c-e6f4-430d-a248-0420b44db9c9 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:08.401094 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bcf7c-e6f4-430d-a248-0420b44db9c9 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:08.411298 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572ae3a-ad45-4551-a792-988ced05531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:08.412161 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572ae3a-ad45-4551-a792-988ced05531d admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:08.412424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572ae3a-ad45-4551-a792-988ced05531d admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:08.412646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572ae3a-ad45-4551-a792-988ced05531d admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.413414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572ae3a-ad45-4551-a792-988ced05531d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:08.415084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572ae3a-ad45-4551-a792-988ced05531d admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:08.426760 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1393/2785] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:29:08.431354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2badf7e-e110-4173-aa12-e8bae25e0ca6 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:08.445130 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2badf7e-e110-4173-aa12-e8bae25e0ca6 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:08.450827 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21313f63-6649-48d8-98cf-ef77380ec2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:08.451740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21313f63-6649-48d8-98cf-ef77380ec2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:08.452187 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21313f63-6649-48d8-98cf-ef77380ec2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:08.452308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21313f63-6649-48d8-98cf-ef77380ec2c7 admin admin] PATH_INFO: `/v3/projects/4756c499b336409db919c113ec43ad77/users/673dec9b313b40a190c55f7dbea0635c/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.473487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21313f63-6649-48d8-98cf-ef77380ec2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4756c499b336409db919c113ec43ad77, user_id=673dec9b313b40a190c55f7dbea0635c, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:08.476195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21313f63-6649-48d8-98cf-ef77380ec2c7 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:08.501183 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1393/2786] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:29:08 2022] PUT /identity/v3/projects/4756c499b336409db919c113ec43ad77/users/673dec9b313b40a190c55f7dbea0635c/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:29:08.512150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a209a8-8445-4d5b-a404-252e09f240a1 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:08.512464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a209a8-8445-4d5b-a404-252e09f240a1 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:08.512746 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a209a8-8445-4d5b-a404-252e09f240a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.541984 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-42a209a8-8445-4d5b-a404-252e09f240a1 None None] MFA Rules not processed for user `673dec9b313b40a190c55f7dbea0635c`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:08.543461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-42a209a8-8445-4d5b-a404-252e09f240a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:08.581187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:08.627121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1394/2787] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:08.631789 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21313f63-6649-48d8-98cf-ef77380ec2c7 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:08.716761 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21313f63-6649-48d8-98cf-ef77380ec2c7 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:08.722121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa84bfa-fc6d-44ca-80a5-468a37ca4c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:08.722927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa84bfa-fc6d-44ca-80a5-468a37ca4c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:08.723305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa84bfa-fc6d-44ca-80a5-468a37ca4c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:08.723685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa84bfa-fc6d-44ca-80a5-468a37ca4c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.725454 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa84bfa-fc6d-44ca-80a5-468a37ca4c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:08.727807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa84bfa-fc6d-44ca-80a5-468a37ca4c72 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:08.763487 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:08.774886 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1394/2788] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:29:08 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:29:08.778547 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a209a8-8445-4d5b-a404-252e09f240a1 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:08.795382 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a209a8-8445-4d5b-a404-252e09f240a1 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:08.865712 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d89cf-0a32-4bcf-bbd1-19898ea448e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:08.866564 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d89cf-0a32-4bcf-bbd1-19898ea448e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:08.866943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d89cf-0a32-4bcf-bbd1-19898ea448e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:08.867316 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d89cf-0a32-4bcf-bbd1-19898ea448e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.868339 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d89cf-0a32-4bcf-bbd1-19898ea448e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:08.870715 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d89cf-0a32-4bcf-bbd1-19898ea448e7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:08.900235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1395/2789] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:29:08 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:29:08.903903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa84bfa-fc6d-44ca-80a5-468a37ca4c72 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:08.916432 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa84bfa-fc6d-44ca-80a5-468a37ca4c72 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:08.924439 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf436f6-161a-41e6-a379-57afeed8a29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:08.925612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf436f6-161a-41e6-a379-57afeed8a29c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:08.925903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf436f6-161a-41e6-a379-57afeed8a29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:08.926184 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf436f6-161a-41e6-a379-57afeed8a29c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.927215 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf436f6-161a-41e6-a379-57afeed8a29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:08.928856 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf436f6-161a-41e6-a379-57afeed8a29c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:08.943357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1395/2790] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:29:08.948140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d89cf-0a32-4bcf-bbd1-19898ea448e7 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:08.959471 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d89cf-0a32-4bcf-bbd1-19898ea448e7 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:08.964052 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe89c2a-272c-4a33-8bb5-b4f18c8a6a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:08.965141 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe89c2a-272c-4a33-8bb5-b4f18c8a6a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:08.965598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe89c2a-272c-4a33-8bb5-b4f18c8a6a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:08.965935 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe89c2a-272c-4a33-8bb5-b4f18c8a6a28 admin admin] PATH_INFO: `/v3/projects/75fa32a7c50242a2a05096d05dac26b9/users/136d08c02fa44c5c97cbf7b7504dffff/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:08.983327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe89c2a-272c-4a33-8bb5-b4f18c8a6a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75fa32a7c50242a2a05096d05dac26b9, user_id=136d08c02fa44c5c97cbf7b7504dffff, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:08.986250 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe89c2a-272c-4a33-8bb5-b4f18c8a6a28 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:09.004021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1396/2791] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:29:08 2022] PUT /identity/v3/projects/75fa32a7c50242a2a05096d05dac26b9/users/136d08c02fa44c5c97cbf7b7504dffff/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:09.008345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf436f6-161a-41e6-a379-57afeed8a29c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:09.019252 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf436f6-161a-41e6-a379-57afeed8a29c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:09.104667 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336d341-46db-4491-984c-b4177be37613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:09.105547 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336d341-46db-4491-984c-b4177be37613 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:09.105875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336d341-46db-4491-984c-b4177be37613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:09.106448 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336d341-46db-4491-984c-b4177be37613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:09.107502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336d341-46db-4491-984c-b4177be37613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:09.109143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336d341-46db-4491-984c-b4177be37613 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:09.120506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1396/2792] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:29:09.125446 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe89c2a-272c-4a33-8bb5-b4f18c8a6a28 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:09.136724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe89c2a-272c-4a33-8bb5-b4f18c8a6a28 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:09.142015 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b157425-8912-4d8a-9652-9cc7d9380ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:09.143136 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b157425-8912-4d8a-9652-9cc7d9380ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:09.143420 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b157425-8912-4d8a-9652-9cc7d9380ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:09.143790 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b157425-8912-4d8a-9652-9cc7d9380ffe admin admin] PATH_INFO: `/v3/projects/75fa32a7c50242a2a05096d05dac26b9/users/136d08c02fa44c5c97cbf7b7504dffff/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:09.145941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b157425-8912-4d8a-9652-9cc7d9380ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=75fa32a7c50242a2a05096d05dac26b9, user_id=136d08c02fa44c5c97cbf7b7504dffff, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:09.148704 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b157425-8912-4d8a-9652-9cc7d9380ffe admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:09.162175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1397/2793] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:29:09 2022] PUT /identity/v3/projects/75fa32a7c50242a2a05096d05dac26b9/users/136d08c02fa44c5c97cbf7b7504dffff/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:09.173084 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872df6b-a103-4752-bb1a-eefc78b3e521 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:09.173418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872df6b-a103-4752-bb1a-eefc78b3e521 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:09.173696 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872df6b-a103-4752-bb1a-eefc78b3e521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:09.201755 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-c872df6b-a103-4752-bb1a-eefc78b3e521 None None] MFA Rules not processed for user `136d08c02fa44c5c97cbf7b7504dffff`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:09.202979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c872df6b-a103-4752-bb1a-eefc78b3e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:09.284594 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1397/2794] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:09.296777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b157425-8912-4d8a-9652-9cc7d9380ffe admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:09.298970 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1b157425-8912-4d8a-9652-9cc7d9380ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:09.368258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b157425-8912-4d8a-9652-9cc7d9380ffe admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:09.371974 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b23d2c-ad06-41f4-8470-0f344dce8094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:09.372634 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b23d2c-ad06-41f4-8470-0f344dce8094 service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:09.372936 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b23d2c-ad06-41f4-8470-0f344dce8094 service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:09.373210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b23d2c-ad06-41f4-8470-0f344dce8094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:09.383475 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b23d2c-ad06-41f4-8470-0f344dce8094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:09.385740 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b23d2c-ad06-41f4-8470-0f344dce8094 service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:09.398816 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1398/2795] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:29:09.483765 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872df6b-a103-4752-bb1a-eefc78b3e521 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:09.497465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872df6b-a103-4752-bb1a-eefc78b3e521 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:09.502195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ff8ab-9fa5-4d7a-94af-8730069d64d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:09.502846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ff8ab-9fa5-4d7a-94af-8730069d64d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:09.503124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ff8ab-9fa5-4d7a-94af-8730069d64d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:09.503411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ff8ab-9fa5-4d7a-94af-8730069d64d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:09.565848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ff8ab-9fa5-4d7a-94af-8730069d64d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:09.567309 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ff8ab-9fa5-4d7a-94af-8730069d64d3 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:09.576833 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1398/2796] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:29:19.392894 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:19.572592 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=97 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:20.199048 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b23d2c-ad06-41f4-8470-0f344dce8094 service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:20.265375 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b23d2c-ad06-41f4-8470-0f344dce8094 service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:20.271318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:20.272130 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:20.272466 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:20.272699 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] PATH_INFO: `/v3/users/673dec9b313b40a190c55f7dbea0635c` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:20.274264 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=673dec9b313b40a190c55f7dbea0635c)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:20.276290 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:20.335835 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673dec9b313b40a190c55f7dbea0635c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:20.336506 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673dec9b313b40a190c55f7dbea0635c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:20.337120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673dec9b313b40a190c55f7dbea0635c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:20.344090 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673dec9b313b40a190c55f7dbea0635c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:20.352229 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673dec9b313b40a190c55f7dbea0635c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:20.369461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1399/2797] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:29:20 2022] DELETE /identity/v3/users/673dec9b313b40a190c55f7dbea0635c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:20.374128 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1d35-2240-4b12-bc02-01dada7f69bb None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:20.374423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1d35-2240-4b12-bc02-01dada7f69bb None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:20.374708 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1d35-2240-4b12-bc02-01dada7f69bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:20.393320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e82e1d35-2240-4b12-bc02-01dada7f69bb None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:20.394593 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e82e1d35-2240-4b12-bc02-01dada7f69bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:20.464642 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1399/2798] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:20.475231 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:20.476942 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:20.539077 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820557f4-4be0-43cc-b284-ef58ea591d5c admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:20.543235 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a08944-f804-4fe3-a4d8-3526545a878d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:20.544001 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a08944-f804-4fe3-a4d8-3526545a878d service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:20.544215 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a08944-f804-4fe3-a4d8-3526545a878d service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:20.544487 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a08944-f804-4fe3-a4d8-3526545a878d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:20.559026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a08944-f804-4fe3-a4d8-3526545a878d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:20.560490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a08944-f804-4fe3-a4d8-3526545a878d service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:20.571691 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1400/2799] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:29:20.885308 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e1d35-2240-4b12-bc02-01dada7f69bb None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:20.887411 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e82e1d35-2240-4b12-bc02-01dada7f69bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:20.906330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e1d35-2240-4b12-bc02-01dada7f69bb None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:20.914777 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:20.916320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:20.916823 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:20.917367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] PATH_INFO: `/v3/projects/4756c499b336409db919c113ec43ad77` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:20.919347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4756c499b336409db919c113ec43ad77)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:20.931953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:20.993347 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4756c499b336409db919c113ec43ad77', 'request_id': 'req-94e778fb-0ae6-4f9a-b928-221c2729c697'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.002397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4756c499b336409db919c113ec43ad77', 'request_id': 'req-94e778fb-0ae6-4f9a-b928-221c2729c697'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.009932 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4756c499b336409db919c113ec43ad77', 'request_id': 'req-94e778fb-0ae6-4f9a-b928-221c2729c697'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.023866 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] The token cache is being invalidate because project 4756c499b336409db919c113ec43ad77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:29:21.024143 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.024820 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.026414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1400/2800] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:29:20 2022] DELETE /identity/v3/projects/4756c499b336409db919c113ec43ad77 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:21.030780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a08944-f804-4fe3-a4d8-3526545a878d service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:21.041784 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a08944-f804-4fe3-a4d8-3526545a878d service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:21.068495 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:21.123417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a89faf-c058-4e11-b839-aa863a7c1ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:21.124309 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a89faf-c058-4e11-b839-aa863a7c1ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:21.124587 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a89faf-c058-4e11-b839-aa863a7c1ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:21.124862 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a89faf-c058-4e11-b839-aa863a7c1ebb admin admin] PATH_INFO: `/v3/users/136d08c02fa44c5c97cbf7b7504dffff` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:21.126132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a89faf-c058-4e11-b839-aa863a7c1ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=136d08c02fa44c5c97cbf7b7504dffff)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:21.128047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a89faf-c058-4e11-b839-aa863a7c1ebb admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:21.176265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-63a89faf-c058-4e11-b839-aa863a7c1ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136d08c02fa44c5c97cbf7b7504dffff'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.176927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-63a89faf-c058-4e11-b839-aa863a7c1ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136d08c02fa44c5c97cbf7b7504dffff'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.177534 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-63a89faf-c058-4e11-b839-aa863a7c1ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136d08c02fa44c5c97cbf7b7504dffff'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.184869 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-63a89faf-c058-4e11-b839-aa863a7c1ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136d08c02fa44c5c97cbf7b7504dffff'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.192159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-63a89faf-c058-4e11-b839-aa863a7c1ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136d08c02fa44c5c97cbf7b7504dffff'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.211137 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1401/2801] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:29:21 2022] DELETE /identity/v3/users/136d08c02fa44c5c97cbf7b7504dffff => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:21.573335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:21.574889 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:21.592875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e778fb-0ae6-4f9a-b928-221c2729c697 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:21.651626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b67fe5-b396-4332-af6f-2231bcb24af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:21.652434 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b67fe5-b396-4332-af6f-2231bcb24af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:21.652722 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b67fe5-b396-4332-af6f-2231bcb24af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:21.653004 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b67fe5-b396-4332-af6f-2231bcb24af8 admin admin] PATH_INFO: `/v3/projects/75fa32a7c50242a2a05096d05dac26b9` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:21.654248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b67fe5-b396-4332-af6f-2231bcb24af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75fa32a7c50242a2a05096d05dac26b9)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:21.656175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b67fe5-b396-4332-af6f-2231bcb24af8 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:21.689412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:21.706513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b0b67fe5-b396-4332-af6f-2231bcb24af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75fa32a7c50242a2a05096d05dac26b9', 'request_id': 'req-b0b67fe5-b396-4332-af6f-2231bcb24af8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.714848 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b0b67fe5-b396-4332-af6f-2231bcb24af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75fa32a7c50242a2a05096d05dac26b9', 'request_id': 'req-b0b67fe5-b396-4332-af6f-2231bcb24af8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.722230 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b0b67fe5-b396-4332-af6f-2231bcb24af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75fa32a7c50242a2a05096d05dac26b9', 'request_id': 'req-b0b67fe5-b396-4332-af6f-2231bcb24af8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.735020 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b0b67fe5-b396-4332-af6f-2231bcb24af8 admin admin] The token cache is being invalidate because project 75fa32a7c50242a2a05096d05dac26b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:29:21.735293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b0b67fe5-b396-4332-af6f-2231bcb24af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.736053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-b0b67fe5-b396-4332-af6f-2231bcb24af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:21.737714 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1401/2802] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:29:21 2022] DELETE /identity/v3/projects/75fa32a7c50242a2a05096d05dac26b9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:21.744520 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c8a7b-42f7-4b8a-ae12-51bd3024185e None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:21.745043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c8a7b-42f7-4b8a-ae12-51bd3024185e None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:21.745253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c8a7b-42f7-4b8a-ae12-51bd3024185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:21.764605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-240c8a7b-42f7-4b8a-ae12-51bd3024185e None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:21.765860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-240c8a7b-42f7-4b8a-ae12-51bd3024185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:21.829644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1402/2803] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:21.838140 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e506b3-dbcf-44f4-b8fd-79fc7cf819b8 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:21.838429 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e506b3-dbcf-44f4-b8fd-79fc7cf819b8 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:21.838706 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e506b3-dbcf-44f4-b8fd-79fc7cf819b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:21.859354 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-e2e506b3-dbcf-44f4-b8fd-79fc7cf819b8 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:21.860624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-e2e506b3-dbcf-44f4-b8fd-79fc7cf819b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:21.870114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1402/2804] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:21.875057 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c8a7b-42f7-4b8a-ae12-51bd3024185e None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:21.887183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c8a7b-42f7-4b8a-ae12-51bd3024185e None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:21.891915 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70387e1-cbbd-4792-9090-fccb5c53874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:21.892610 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70387e1-cbbd-4792-9090-fccb5c53874e admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:21.892882 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70387e1-cbbd-4792-9090-fccb5c53874e admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:21.893164 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70387e1-cbbd-4792-9090-fccb5c53874e admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:21.893944 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70387e1-cbbd-4792-9090-fccb5c53874e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:29:21.894253 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70387e1-cbbd-4792-9090-fccb5c53874e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:21.895889 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70387e1-cbbd-4792-9090-fccb5c53874e admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:21.909438 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1403/2805] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:29:21.914081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e506b3-dbcf-44f4-b8fd-79fc7cf819b8 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:21.923697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e506b3-dbcf-44f4-b8fd-79fc7cf819b8 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:21.928363 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e132b8-4cc3-4b30-9e13-e940496c7f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:21.929041 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e132b8-4cc3-4b30-9e13-e940496c7f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:21.929376 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e132b8-4cc3-4b30-9e13-e940496c7f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:21.929655 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e132b8-4cc3-4b30-9e13-e940496c7f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:21.930367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e132b8-4cc3-4b30-9e13-e940496c7f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:21.932814 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e132b8-4cc3-4b30-9e13-e940496c7f92 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:21.963462 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1403/2806] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:29:21 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:29:21.970051 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70387e1-cbbd-4792-9090-fccb5c53874e admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:21.980550 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70387e1-cbbd-4792-9090-fccb5c53874e admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:22.010646 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:22.059004 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de8c4d-4d16-41ea-b139-05f1f090a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:22.060140 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de8c4d-4d16-41ea-b139-05f1f090a241 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:22.060622 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de8c4d-4d16-41ea-b139-05f1f090a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:22.061103 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de8c4d-4d16-41ea-b139-05f1f090a241 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:22.062358 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de8c4d-4d16-41ea-b139-05f1f090a241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:22.065940 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de8c4d-4d16-41ea-b139-05f1f090a241 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:22.091859 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1404/2807] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:29:21 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:29:22.098056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e132b8-4cc3-4b30-9e13-e940496c7f92 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:22.109580 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e132b8-4cc3-4b30-9e13-e940496c7f92 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:22.114687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e91d2-49a3-401e-af51-0be0195d096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:22.115378 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e91d2-49a3-401e-af51-0be0195d096b admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:22.115664 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e91d2-49a3-401e-af51-0be0195d096b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:22.115946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e91d2-49a3-401e-af51-0be0195d096b admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:22.116685 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e91d2-49a3-401e-af51-0be0195d096b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:22.118344 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e91d2-49a3-401e-af51-0be0195d096b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:22.130807 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1404/2808] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:29:22.135043 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de8c4d-4d16-41ea-b139-05f1f090a241 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:22.145397 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de8c4d-4d16-41ea-b139-05f1f090a241 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:22.150384 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752f29c-cb76-45e7-87e4-057822ace8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:22.151060 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752f29c-cb76-45e7-87e4-057822ace8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:22.151346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752f29c-cb76-45e7-87e4-057822ace8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:22.151626 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752f29c-cb76-45e7-87e4-057822ace8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:22.152362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752f29c-cb76-45e7-87e4-057822ace8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:22.154033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752f29c-cb76-45e7-87e4-057822ace8e8 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:22.165653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1405/2809] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:29:22.169734 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e91d2-49a3-401e-af51-0be0195d096b admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:22.180638 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e91d2-49a3-401e-af51-0be0195d096b admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:22.186043 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8654ce-9b86-4ee1-897e-86725c94b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:22.187003 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8654ce-9b86-4ee1-897e-86725c94b77e admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:22.187260 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8654ce-9b86-4ee1-897e-86725c94b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:22.187533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8654ce-9b86-4ee1-897e-86725c94b77e admin admin] PATH_INFO: `/v3/projects/cdaff153c93147e9b4501bf7d7adb107/users/69c00d66dc6d49d99927f2915992f5d9/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:22.204656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8654ce-9b86-4ee1-897e-86725c94b77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdaff153c93147e9b4501bf7d7adb107, user_id=69c00d66dc6d49d99927f2915992f5d9, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:22.207328 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8654ce-9b86-4ee1-897e-86725c94b77e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:22.222052 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1405/2810] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:29:22 2022] PUT /identity/v3/projects/cdaff153c93147e9b4501bf7d7adb107/users/69c00d66dc6d49d99927f2915992f5d9/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 07:29:22.227478 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc20b-cc2a-4916-b4c8-1b5f2b655037 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:22.227800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc20b-cc2a-4916-b4c8-1b5f2b655037 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:22.228091 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc20b-cc2a-4916-b4c8-1b5f2b655037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:22.247008 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c96cc20b-cc2a-4916-b4c8-1b5f2b655037 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:22.248223 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c96cc20b-cc2a-4916-b4c8-1b5f2b655037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:22.308868 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1406/2811] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:22.318933 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8654ce-9b86-4ee1-897e-86725c94b77e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:22.321339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-2d8654ce-9b86-4ee1-897e-86725c94b77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:22.385445 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8654ce-9b86-4ee1-897e-86725c94b77e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:22.394075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886c700-e6bd-4239-995c-0564ae67da73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:22.396934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886c700-e6bd-4239-995c-0564ae67da73 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:22.397198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886c700-e6bd-4239-995c-0564ae67da73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:22.397507 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886c700-e6bd-4239-995c-0564ae67da73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:22.409264 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886c700-e6bd-4239-995c-0564ae67da73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:22.411953 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886c700-e6bd-4239-995c-0564ae67da73 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:22.426646 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1406/2812] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:29:23.180496 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03899d21-46b9-40e7-a513-3f173b76b204 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:23.181510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03899d21-46b9-40e7-a513-3f173b76b204 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:23.181510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03899d21-46b9-40e7-a513-3f173b76b204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:23.237920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-03899d21-46b9-40e7-a513-3f173b76b204 None None] MFA Rules not processed for user `69c00d66dc6d49d99927f2915992f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:23.239205 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-03899d21-46b9-40e7-a513-3f173b76b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:23.323150 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1407/2813] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:23.328049 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886c700-e6bd-4239-995c-0564ae67da73 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:23.340707 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886c700-e6bd-4239-995c-0564ae67da73 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:23.345375 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758ff47-88e1-47ca-88b8-998e1bd3b11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:23.346044 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ff47-88e1-47ca-88b8-998e1bd3b11e admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:23.346338 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ff47-88e1-47ca-88b8-998e1bd3b11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:23.346596 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ff47-88e1-47ca-88b8-998e1bd3b11e admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:23.347311 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758ff47-88e1-47ca-88b8-998e1bd3b11e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:23.349281 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758ff47-88e1-47ca-88b8-998e1bd3b11e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:23.381340 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1407/2814] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:29:23 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:29:23.385766 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03899d21-46b9-40e7-a513-3f173b76b204 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:23.398196 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03899d21-46b9-40e7-a513-3f173b76b204 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:23.446265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:23.470274 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac414634-6cc8-4901-b04a-78204ba1ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:23.470927 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac414634-6cc8-4901-b04a-78204ba1ee8c admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:23.471332 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac414634-6cc8-4901-b04a-78204ba1ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:23.471617 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac414634-6cc8-4901-b04a-78204ba1ee8c admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:23.472322 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac414634-6cc8-4901-b04a-78204ba1ee8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:23.474318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac414634-6cc8-4901-b04a-78204ba1ee8c admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:23.497881 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1408/2815] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:29:23 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:29:23.502106 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758ff47-88e1-47ca-88b8-998e1bd3b11e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:23.514855 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758ff47-88e1-47ca-88b8-998e1bd3b11e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:23.519968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab8c81-b595-4306-be94-e5d30802bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:23.520665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab8c81-b595-4306-be94-e5d30802bd15 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:23.520916 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab8c81-b595-4306-be94-e5d30802bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:23.521191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab8c81-b595-4306-be94-e5d30802bd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:23.522383 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab8c81-b595-4306-be94-e5d30802bd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:23.523561 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab8c81-b595-4306-be94-e5d30802bd15 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:23.534942 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1408/2816] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:29:23.540025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac414634-6cc8-4901-b04a-78204ba1ee8c admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:23.552780 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac414634-6cc8-4901-b04a-78204ba1ee8c admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:23.560805 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b14f8-48b9-4035-8a65-85b8302590c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:23.561779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b14f8-48b9-4035-8a65-85b8302590c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:23.562065 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b14f8-48b9-4035-8a65-85b8302590c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:23.562344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b14f8-48b9-4035-8a65-85b8302590c7 admin admin] PATH_INFO: `/v3/projects/0219ba5bf49149879ff29afd83016be2/users/f0569ab48b204921a2614f0a9119f8bb/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:23.580671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b14f8-48b9-4035-8a65-85b8302590c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0219ba5bf49149879ff29afd83016be2, user_id=f0569ab48b204921a2614f0a9119f8bb, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:23.583417 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b14f8-48b9-4035-8a65-85b8302590c7 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:23.599997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1409/2817] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:29:23 2022] PUT /identity/v3/projects/0219ba5bf49149879ff29afd83016be2/users/f0569ab48b204921a2614f0a9119f8bb/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:23.605257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab8c81-b595-4306-be94-e5d30802bd15 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:23.615910 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab8c81-b595-4306-be94-e5d30802bd15 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:23.634979 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:23.682725 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6bae9-a58c-4ae9-8e95-bb1bc9bafd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:23.683423 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6bae9-a58c-4ae9-8e95-bb1bc9bafd05 admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:23.683751 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6bae9-a58c-4ae9-8e95-bb1bc9bafd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:23.683952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6bae9-a58c-4ae9-8e95-bb1bc9bafd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:23.684697 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6bae9-a58c-4ae9-8e95-bb1bc9bafd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:23.686382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6bae9-a58c-4ae9-8e95-bb1bc9bafd05 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:23.698075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1409/2818] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:29:23.704684 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b14f8-48b9-4035-8a65-85b8302590c7 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:23.716263 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b14f8-48b9-4035-8a65-85b8302590c7 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:23.721908 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b5eac-6d4e-4aca-8b39-f6e4036536cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:23.723025 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b5eac-6d4e-4aca-8b39-f6e4036536cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:23.723425 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b5eac-6d4e-4aca-8b39-f6e4036536cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:23.723809 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b5eac-6d4e-4aca-8b39-f6e4036536cc admin admin] PATH_INFO: `/v3/projects/0219ba5bf49149879ff29afd83016be2/users/f0569ab48b204921a2614f0a9119f8bb/roles/7e74783d36c14c6bbb1e28c75c1c0aea` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:23.726208 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b5eac-6d4e-4aca-8b39-f6e4036536cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0219ba5bf49149879ff29afd83016be2, user_id=f0569ab48b204921a2614f0a9119f8bb, role_id=7e74783d36c14c6bbb1e28c75c1c0aea)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:23.729464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b5eac-6d4e-4aca-8b39-f6e4036536cc admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:23.742584 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1410/2819] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:29:23 2022] PUT /identity/v3/projects/0219ba5bf49149879ff29afd83016be2/users/f0569ab48b204921a2614f0a9119f8bb/roles/7e74783d36c14c6bbb1e28c75c1c0aea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:24.627737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c171f-111b-4451-984e-97228aa5e33b None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:24.628320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c171f-111b-4451-984e-97228aa5e33b None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:24.628320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c171f-111b-4451-984e-97228aa5e33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:24.656656 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-bf1c171f-111b-4451-984e-97228aa5e33b None None] MFA Rules not processed for user `f0569ab48b204921a2614f0a9119f8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:24.657951 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-bf1c171f-111b-4451-984e-97228aa5e33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:24.732779 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1410/2820] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:24.744934 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b5eac-6d4e-4aca-8b39-f6e4036536cc admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:24.747277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-da2b5eac-6d4e-4aca-8b39-f6e4036536cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:24.811941 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b5eac-6d4e-4aca-8b39-f6e4036536cc admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:24.816069 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9e7dc-39ce-4789-8e42-e021804cdd7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:24.816728 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9e7dc-39ce-4789-8e42-e021804cdd7c service cinder] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:24.817000 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9e7dc-39ce-4789-8e42-e021804cdd7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:24.817328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9e7dc-39ce-4789-8e42-e021804cdd7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:24.882667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9e7dc-39ce-4789-8e42-e021804cdd7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:24.884153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9e7dc-39ce-4789-8e42-e021804cdd7c service cinder] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:24.894958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1411/2821] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:29:26.305254 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c171f-111b-4451-984e-97228aa5e33b None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:26.317292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c171f-111b-4451-984e-97228aa5e33b None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:26.324069 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd6c30-a1ab-4870-85c1-0e350c3b46d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:26.324990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd6c30-a1ab-4870-85c1-0e350c3b46d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:26.325164 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd6c30-a1ab-4870-85c1-0e350c3b46d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:26.328293 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd6c30-a1ab-4870-85c1-0e350c3b46d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:26.338721 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd6c30-a1ab-4870-85c1-0e350c3b46d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:26.340212 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd6c30-a1ab-4870-85c1-0e350c3b46d5 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:26.352362 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1411/2822] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:29:28.789056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9e7dc-39ce-4789-8e42-e021804cdd7c service cinder] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:28.839345 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:28.849971 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9e7dc-39ce-4789-8e42-e021804cdd7c service cinder] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:28.854013 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918a1dc-c1b9-4ad8-af96-dddc74bbadf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:28.854663 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918a1dc-c1b9-4ad8-af96-dddc74bbadf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:28.854948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918a1dc-c1b9-4ad8-af96-dddc74bbadf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:28.855227 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918a1dc-c1b9-4ad8-af96-dddc74bbadf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:28.857056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8918a1dc-c1b9-4ad8-af96-dddc74bbadf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:28.918749 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918a1dc-c1b9-4ad8-af96-dddc74bbadf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:28.920503 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918a1dc-c1b9-4ad8-af96-dddc74bbadf1 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:28.930697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1412/2823] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:29:36.347106 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=60 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:38.926207 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=30 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:44.175177 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd6c30-a1ab-4870-85c1-0e350c3b46d5 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:44.177431 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-87cd6c30-a1ab-4870-85c1-0e350c3b46d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:44.250087 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918a1dc-c1b9-4ad8-af96-dddc74bbadf1 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:44.262075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd6c30-a1ab-4870-85c1-0e350c3b46d5 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:44.268387 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ace20-60cb-452a-8821-ddd0f2932cbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:44.269061 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ace20-60cb-452a-8821-ddd0f2932cbb service placement] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:44.269389 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ace20-60cb-452a-8821-ddd0f2932cbb service placement] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:44.269674 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ace20-60cb-452a-8821-ddd0f2932cbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:44.271854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-ba9ace20-60cb-452a-8821-ddd0f2932cbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:44.285607 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ace20-60cb-452a-8821-ddd0f2932cbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:44.287370 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ace20-60cb-452a-8821-ddd0f2932cbb service placement] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:44.299282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1412/2824] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:29:44.337920 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918a1dc-c1b9-4ad8-af96-dddc74bbadf1 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:44.343200 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:44.344277 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:44.344630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:44.344968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] PATH_INFO: `/v3/users/69c00d66dc6d49d99927f2915992f5d9` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:44.346378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c00d66dc6d49d99927f2915992f5d9)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:44.348477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:44.403284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c00d66dc6d49d99927f2915992f5d9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.404099 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c00d66dc6d49d99927f2915992f5d9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.404711 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c00d66dc6d49d99927f2915992f5d9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.412653 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c00d66dc6d49d99927f2915992f5d9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.424670 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c00d66dc6d49d99927f2915992f5d9'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.445752 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1413/2825] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:29:44 2022] DELETE /identity/v3/users/69c00d66dc6d49d99927f2915992f5d9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:44.670687 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ace20-60cb-452a-8821-ddd0f2932cbb service placement] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:44.682542 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ace20-60cb-452a-8821-ddd0f2932cbb service placement] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:44.747819 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:44.748692 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:44.748980 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:44.749298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] PATH_INFO: `/v3/projects/cdaff153c93147e9b4501bf7d7adb107` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:44.750511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdaff153c93147e9b4501bf7d7adb107)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:44.752421 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:44.807989 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdaff153c93147e9b4501bf7d7adb107', 'request_id': 'req-261b6561-2b87-4311-b7b3-a4d337b732b6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.817334 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdaff153c93147e9b4501bf7d7adb107', 'request_id': 'req-261b6561-2b87-4311-b7b3-a4d337b732b6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.826355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdaff153c93147e9b4501bf7d7adb107', 'request_id': 'req-261b6561-2b87-4311-b7b3-a4d337b732b6'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.841622 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] The token cache is being invalidate because project cdaff153c93147e9b4501bf7d7adb107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:29:44.841908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.842758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.844619 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1413/2826] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:29:44 2022] DELETE /identity/v3/projects/cdaff153c93147e9b4501bf7d7adb107 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:44.848717 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:44.850192 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:44.863861 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223922e-cd0f-42eb-bd17-baacb2c008da admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:44.921390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e6cc-c949-4163-9ffc-6763b76a12ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:44.922304 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e6cc-c949-4163-9ffc-6763b76a12ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:44.922633 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e6cc-c949-4163-9ffc-6763b76a12ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:44.922910 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e6cc-c949-4163-9ffc-6763b76a12ca admin admin] PATH_INFO: `/v3/users/f0569ab48b204921a2614f0a9119f8bb` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:44.924121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2e6cc-c949-4163-9ffc-6763b76a12ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0569ab48b204921a2614f0a9119f8bb)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:44.926085 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2e6cc-c949-4163-9ffc-6763b76a12ca admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:44.950236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:44.980419 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0df2e6cc-c949-4163-9ffc-6763b76a12ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0569ab48b204921a2614f0a9119f8bb'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.981070 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0df2e6cc-c949-4163-9ffc-6763b76a12ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0569ab48b204921a2614f0a9119f8bb'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.981700 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0df2e6cc-c949-4163-9ffc-6763b76a12ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0569ab48b204921a2614f0a9119f8bb'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.989423 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0df2e6cc-c949-4163-9ffc-6763b76a12ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0569ab48b204921a2614f0a9119f8bb'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:44.998306 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0df2e6cc-c949-4163-9ffc-6763b76a12ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0569ab48b204921a2614f0a9119f8bb'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:45.017750 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1414/2827] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:29:44 2022] DELETE /identity/v3/users/f0569ab48b204921a2614f0a9119f8bb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:45.207102 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:45.208691 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:45.224247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b6561-2b87-4311-b7b3-a4d337b732b6 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:45.252247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:45.302922 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:45.303826 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:45.304110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:45.304461 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8 admin admin] PATH_INFO: `/v3/projects/0219ba5bf49149879ff29afd83016be2` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:45.305770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0219ba5bf49149879ff29afd83016be2)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:45.308063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:45.359878 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0219ba5bf49149879ff29afd83016be2', 'request_id': 'req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:45.367508 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0219ba5bf49149879ff29afd83016be2', 'request_id': 'req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:45.374032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0219ba5bf49149879ff29afd83016be2', 'request_id': 'req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:45.386282 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8 admin admin] The token cache is being invalidate because project 0219ba5bf49149879ff29afd83016be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:29:45.386582 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:45.387237 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-a0467ed1-7903-4ac3-98fb-e848cbdf7ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:45.392867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1414/2828] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:29:45 2022] DELETE /identity/v3/projects/0219ba5bf49149879ff29afd83016be2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:45.395021 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9f0b9-9942-47f0-8309-dc1cdefd594f None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:45.395525 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9f0b9-9942-47f0-8309-dc1cdefd594f None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:45.395862 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9f0b9-9942-47f0-8309-dc1cdefd594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:45.414202 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-f9c9f0b9-9942-47f0-8309-dc1cdefd594f None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:45.415489 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-f9c9f0b9-9942-47f0-8309-dc1cdefd594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:45.495385 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1415/2829] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:45.503903 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b832c-8d32-491a-ad3f-4786a34dd468 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:45.504191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b832c-8d32-491a-ad3f-4786a34dd468 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:45.504541 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b832c-8d32-491a-ad3f-4786a34dd468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:45.526109 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-317b832c-8d32-491a-ad3f-4786a34dd468 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:45.528805 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-317b832c-8d32-491a-ad3f-4786a34dd468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:45.536665 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1415/2830] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:45.540866 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9f0b9-9942-47f0-8309-dc1cdefd594f None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:45.551561 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9f0b9-9942-47f0-8309-dc1cdefd594f None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:45.556815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73cac0-00d1-421f-9d5a-b963c1fb3f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:45.557580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73cac0-00d1-421f-9d5a-b963c1fb3f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:45.557975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73cac0-00d1-421f-9d5a-b963c1fb3f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:45.558259 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73cac0-00d1-421f-9d5a-b963c1fb3f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:45.559005 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73cac0-00d1-421f-9d5a-b963c1fb3f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:29:45.559314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73cac0-00d1-421f-9d5a-b963c1fb3f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:45.560963 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73cac0-00d1-421f-9d5a-b963c1fb3f12 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:45.574258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1416/2831] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:29:45.578683 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b832c-8d32-491a-ad3f-4786a34dd468 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:45.590705 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b832c-8d32-491a-ad3f-4786a34dd468 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:45.595600 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dd782-f5fc-4249-a853-e6cec577b284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:45.596268 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dd782-f5fc-4249-a853-e6cec577b284 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:45.596556 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dd782-f5fc-4249-a853-e6cec577b284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:45.596884 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dd782-f5fc-4249-a853-e6cec577b284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:45.597639 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dd782-f5fc-4249-a853-e6cec577b284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:45.599812 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dd782-f5fc-4249-a853-e6cec577b284 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:45.630550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1416/2832] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:29:45 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 07:29:45.634816 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73cac0-00d1-421f-9d5a-b963c1fb3f12 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:45.645335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73cac0-00d1-421f-9d5a-b963c1fb3f12 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:45.701453 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16809a9b-5ab3-4b63-85b9-7c65ac84844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:45.702156 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16809a9b-5ab3-4b63-85b9-7c65ac84844a admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:45.702443 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16809a9b-5ab3-4b63-85b9-7c65ac84844a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:45.702719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16809a9b-5ab3-4b63-85b9-7c65ac84844a admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:45.703437 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16809a9b-5ab3-4b63-85b9-7c65ac84844a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:45.705451 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16809a9b-5ab3-4b63-85b9-7c65ac84844a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:45.726039 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1417/2833] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:29:45 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:29:45.730569 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dd782-f5fc-4249-a853-e6cec577b284 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:45.742868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dd782-f5fc-4249-a853-e6cec577b284 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:45.749173 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92734ed-3a64-46dc-9df8-ab1723a94f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:45.749906 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92734ed-3a64-46dc-9df8-ab1723a94f2e admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:45.750191 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92734ed-3a64-46dc-9df8-ab1723a94f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:45.750471 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92734ed-3a64-46dc-9df8-ab1723a94f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:45.751226 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92734ed-3a64-46dc-9df8-ab1723a94f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:45.752867 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92734ed-3a64-46dc-9df8-ab1723a94f2e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:45.766382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1417/2834] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:29:45.770638 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16809a9b-5ab3-4b63-85b9-7c65ac84844a admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:45.781743 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16809a9b-5ab3-4b63-85b9-7c65ac84844a admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:45.788267 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f104c6-21b0-4d53-9f7b-73b3c9b3f896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:45.788983 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f104c6-21b0-4d53-9f7b-73b3c9b3f896 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:45.789260 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f104c6-21b0-4d53-9f7b-73b3c9b3f896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:45.789580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f104c6-21b0-4d53-9f7b-73b3c9b3f896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:45.790414 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f104c6-21b0-4d53-9f7b-73b3c9b3f896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:45.792080 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f104c6-21b0-4d53-9f7b-73b3c9b3f896 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:45.803284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1418/2835] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:29:45.808037 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92734ed-3a64-46dc-9df8-ab1723a94f2e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:45.818345 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92734ed-3a64-46dc-9df8-ab1723a94f2e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:45.823453 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b16f85-e729-4ee9-8dce-67fdd590670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:45.824412 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b16f85-e729-4ee9-8dce-67fdd590670e admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:45.824694 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b16f85-e729-4ee9-8dce-67fdd590670e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:45.824968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b16f85-e729-4ee9-8dce-67fdd590670e admin admin] PATH_INFO: `/v3/projects/ac777f1da17b4bd1a4c128953cd110b6/users/84e1c0eb1a7149079cbcf22469129931/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:45.840745 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b16f85-e729-4ee9-8dce-67fdd590670e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac777f1da17b4bd1a4c128953cd110b6, user_id=84e1c0eb1a7149079cbcf22469129931, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:45.843479 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b16f85-e729-4ee9-8dce-67fdd590670e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:45.859257 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1418/2836] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:29:45 2022] PUT /identity/v3/projects/ac777f1da17b4bd1a4c128953cd110b6/users/84e1c0eb1a7149079cbcf22469129931/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:45.870930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0ab1-e498-4505-93f5-0ad593996bbc None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:45.871395 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0ab1-e498-4505-93f5-0ad593996bbc None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:45.871676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0ab1-e498-4505-93f5-0ad593996bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:45.880049 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:45.905284 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-b7ee0ab1-e498-4505-93f5-0ad593996bbc None None] MFA Rules not processed for user `84e1c0eb1a7149079cbcf22469129931`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:45.906498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-b7ee0ab1-e498-4505-93f5-0ad593996bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:45.980764 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1419/2837] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:45.992816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b16f85-e729-4ee9-8dce-67fdd590670e admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:45.994690 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-15b16f85-e729-4ee9-8dce-67fdd590670e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:46.054105 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:46.061482 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b16f85-e729-4ee9-8dce-67fdd590670e admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:46.067230 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b95168-ddb7-43d8-be98-f2e66024116c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:46.068111 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b95168-ddb7-43d8-be98-f2e66024116c service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:46.068489 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b95168-ddb7-43d8-be98-f2e66024116c service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:46.068793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b95168-ddb7-43d8-be98-f2e66024116c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:46.080310 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b95168-ddb7-43d8-be98-f2e66024116c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:46.081781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b95168-ddb7-43d8-be98-f2e66024116c service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:46.101152 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1419/2838] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:29:49.187599 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee0ab1-e498-4505-93f5-0ad593996bbc None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:49.255348 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee0ab1-e498-4505-93f5-0ad593996bbc None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:49.261258 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:49.262390 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:49.262763 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:49.268698 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] PATH_INFO: `/v3/users/84e1c0eb1a7149079cbcf22469129931` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:49.268698 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e1c0eb1a7149079cbcf22469129931)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:49.268698 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:49.326461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e1c0eb1a7149079cbcf22469129931'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:49.327305 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e1c0eb1a7149079cbcf22469129931'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:49.327918 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e1c0eb1a7149079cbcf22469129931'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:49.337782 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e1c0eb1a7149079cbcf22469129931'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:49.346785 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e1c0eb1a7149079cbcf22469129931'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:49.376538 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1420/2839] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:29:49 2022] DELETE /identity/v3/users/84e1c0eb1a7149079cbcf22469129931 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:49.378267 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a84a2-e707-490b-b34f-92c3df2b2fdd None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:49.378781 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a84a2-e707-490b-b34f-92c3df2b2fdd None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:49.378908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a84a2-e707-490b-b34f-92c3df2b2fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:49.399305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-1f7a84a2-e707-490b-b34f-92c3df2b2fdd None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:49.400704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1f7a84a2-e707-490b-b34f-92c3df2b2fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:49.462223 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1420/2840] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:49.473020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:49.474817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:49.491280 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:49.540571 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837f0d0-0e47-4344-b47e-27abb6a196cd admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:49.546367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0cf29-db8d-4a91-8328-79bdd4ffce9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:49.547091 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0cf29-db8d-4a91-8328-79bdd4ffce9f service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:49.547418 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0cf29-db8d-4a91-8328-79bdd4ffce9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:49.547685 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0cf29-db8d-4a91-8328-79bdd4ffce9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:49.558806 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0cf29-db8d-4a91-8328-79bdd4ffce9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:49.560266 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0cf29-db8d-4a91-8328-79bdd4ffce9f service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:49.570464 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1421/2841] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:29:49.867160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a84a2-e707-490b-b34f-92c3df2b2fdd None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:49.868740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1f7a84a2-e707-490b-b34f-92c3df2b2fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:49.882541 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a84a2-e707-490b-b34f-92c3df2b2fdd None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:49.888727 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:49.889673 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:49.889954 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:49.890231 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e admin admin] PATH_INFO: `/v3/projects/ac777f1da17b4bd1a4c128953cd110b6` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:49.891604 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac777f1da17b4bd1a4c128953cd110b6)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:49.893645 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:49.949317 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac777f1da17b4bd1a4c128953cd110b6', 'request_id': 'req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:49.958764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac777f1da17b4bd1a4c128953cd110b6', 'request_id': 'req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:49.966160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac777f1da17b4bd1a4c128953cd110b6', 'request_id': 'req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:49.978818 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e admin admin] The token cache is being invalidate because project ac777f1da17b4bd1a4c128953cd110b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:29:49.979114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:49.979918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-f69ed689-7dcb-432d-9d83-dc5b534b8d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:29:49.981715 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1421/2842] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:29:49 2022] DELETE /identity/v3/projects/ac777f1da17b4bd1a4c128953cd110b6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:49.986994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e822a5-54b7-4d7a-975d-841d6af6d401 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:49.987291 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e822a5-54b7-4d7a-975d-841d6af6d401 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:49.987779 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e822a5-54b7-4d7a-975d-841d6af6d401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:50.008027 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-83e822a5-54b7-4d7a-975d-841d6af6d401 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:50.009335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-83e822a5-54b7-4d7a-975d-841d6af6d401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:50.075019 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1422/2843] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:50.083056 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c484ff5-3e10-4f45-b99b-f5c475395924 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:50.083367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c484ff5-3e10-4f45-b99b-f5c475395924 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:50.083631 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c484ff5-3e10-4f45-b99b-f5c475395924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:50.103737 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-5c484ff5-3e10-4f45-b99b-f5c475395924 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:50.104978 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5c484ff5-3e10-4f45-b99b-f5c475395924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:50.115623 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1422/2844] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:50.120297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e822a5-54b7-4d7a-975d-841d6af6d401 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:50.130904 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e822a5-54b7-4d7a-975d-841d6af6d401 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:50.136370 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef2b85-2588-4fe4-8df3-65ec487c1b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:50.137037 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef2b85-2588-4fe4-8df3-65ec487c1b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:50.137365 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef2b85-2588-4fe4-8df3-65ec487c1b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:50.137643 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef2b85-2588-4fe4-8df3-65ec487c1b6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:50.138368 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef2b85-2588-4fe4-8df3-65ec487c1b6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:29:50.138697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef2b85-2588-4fe4-8df3-65ec487c1b6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:50.140328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef2b85-2588-4fe4-8df3-65ec487c1b6b admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:50.153193 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1423/2845] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:29:50.157808 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c484ff5-3e10-4f45-b99b-f5c475395924 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:50.167758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c484ff5-3e10-4f45-b99b-f5c475395924 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:50.172868 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26be23f-4674-4c17-b1dc-f5dd608789f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:50.173567 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26be23f-4674-4c17-b1dc-f5dd608789f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:50.173851 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26be23f-4674-4c17-b1dc-f5dd608789f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:50.174127 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26be23f-4674-4c17-b1dc-f5dd608789f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:50.174836 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26be23f-4674-4c17-b1dc-f5dd608789f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:50.176758 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26be23f-4674-4c17-b1dc-f5dd608789f9 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:50.213053 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1423/2846] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:29:50 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:29:50.216593 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef2b85-2588-4fe4-8df3-65ec487c1b6b admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:50.227815 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef2b85-2588-4fe4-8df3-65ec487c1b6b admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:50.297964 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1a550-21cf-46a3-9343-4b3d89e096b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:50.298901 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1a550-21cf-46a3-9343-4b3d89e096b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:50.299311 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1a550-21cf-46a3-9343-4b3d89e096b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:50.299745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1a550-21cf-46a3-9343-4b3d89e096b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:50.300533 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1a550-21cf-46a3-9343-4b3d89e096b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:50.302692 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1a550-21cf-46a3-9343-4b3d89e096b5 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:50.333909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1424/2847] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:29:50 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:29:50.336666 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26be23f-4674-4c17-b1dc-f5dd608789f9 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:50.354306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26be23f-4674-4c17-b1dc-f5dd608789f9 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:50.360103 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a74fde-8f93-4b06-9611-996cf7d8e1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:50.360845 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a74fde-8f93-4b06-9611-996cf7d8e1af admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:50.361126 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a74fde-8f93-4b06-9611-996cf7d8e1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:50.361435 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a74fde-8f93-4b06-9611-996cf7d8e1af admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:50.362220 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a74fde-8f93-4b06-9611-996cf7d8e1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:50.363858 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a74fde-8f93-4b06-9611-996cf7d8e1af admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:50.375854 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1424/2848] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:29:50.380224 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1a550-21cf-46a3-9343-4b3d89e096b5 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:50.391471 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1a550-21cf-46a3-9343-4b3d89e096b5 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:50.397169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b47ba-a688-466c-bce0-ed1fe744e5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:50.397878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b47ba-a688-466c-bce0-ed1fe744e5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:50.398165 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b47ba-a688-466c-bce0-ed1fe744e5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:50.398449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b47ba-a688-466c-bce0-ed1fe744e5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:50.399189 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b47ba-a688-466c-bce0-ed1fe744e5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:50.400928 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b47ba-a688-466c-bce0-ed1fe744e5c9 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:50.412795 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1425/2849] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:29:50.417555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a74fde-8f93-4b06-9611-996cf7d8e1af admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:50.428357 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a74fde-8f93-4b06-9611-996cf7d8e1af admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:50.433861 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871a5a3-6698-4fcc-9d91-bb9fbde4339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:50.434784 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871a5a3-6698-4fcc-9d91-bb9fbde4339d admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:50.435073 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871a5a3-6698-4fcc-9d91-bb9fbde4339d admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:50.435352 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871a5a3-6698-4fcc-9d91-bb9fbde4339d admin admin] PATH_INFO: `/v3/projects/d383046679e5465fbdd404a932e034ca/users/051516f5d2044f86a920633a62892281/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:50.451904 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871a5a3-6698-4fcc-9d91-bb9fbde4339d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d383046679e5465fbdd404a932e034ca, user_id=051516f5d2044f86a920633a62892281, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:50.454627 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871a5a3-6698-4fcc-9d91-bb9fbde4339d admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:50.469174 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1425/2850] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:29:50 2022] PUT /identity/v3/projects/d383046679e5465fbdd404a932e034ca/users/051516f5d2044f86a920633a62892281/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:29:50.479911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f077e-420c-413a-bbac-9d41a3923765 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:50.480236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f077e-420c-413a-bbac-9d41a3923765 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:50.480514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f077e-420c-413a-bbac-9d41a3923765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:50.508628 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-5d7f077e-420c-413a-bbac-9d41a3923765 None None] MFA Rules not processed for user `051516f5d2044f86a920633a62892281`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:29:50.509958 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-5d7f077e-420c-413a-bbac-9d41a3923765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:50.520450 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:50.579239 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1426/2851] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:29:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:29:50.595735 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871a5a3-6698-4fcc-9d91-bb9fbde4339d admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:29:50.597925 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-5871a5a3-6698-4fcc-9d91-bb9fbde4339d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:29:50.609808 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:50.659388 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871a5a3-6698-4fcc-9d91-bb9fbde4339d admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:29:50.663217 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14467e42-b3bf-4f12-af0b-8df8d2a14809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:29:50.663877 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14467e42-b3bf-4f12-af0b-8df8d2a14809 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:29:50.664159 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14467e42-b3bf-4f12-af0b-8df8d2a14809 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:29:50.664436 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14467e42-b3bf-4f12-af0b-8df8d2a14809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:29:50.674414 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14467e42-b3bf-4f12-af0b-8df8d2a14809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:29:50.675870 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14467e42-b3bf-4f12-af0b-8df8d2a14809 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:29:50.685764 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1426/2852] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:29:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:30:00.575976 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=22 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:00.681071 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=22 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:02.857262 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f077e-420c-413a-bbac-9d41a3923765 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:02.935206 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f077e-420c-413a-bbac-9d41a3923765 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:02.940460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:02.941654 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:02.941917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:02.942268 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] PATH_INFO: `/v3/users/051516f5d2044f86a920633a62892281` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:02.943629 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=051516f5d2044f86a920633a62892281)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:02.945977 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:03.000825 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '051516f5d2044f86a920633a62892281'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:03.001535 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '051516f5d2044f86a920633a62892281'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:03.002132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '051516f5d2044f86a920633a62892281'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:03.010144 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '051516f5d2044f86a920633a62892281'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:03.020167 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '051516f5d2044f86a920633a62892281'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:03.042256 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1427/2853] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:30:02 2022] DELETE /identity/v3/users/051516f5d2044f86a920633a62892281 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:30:03.047346 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e7dc-2ce4-4c98-887e-6fb21c99e7f3 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:03.047908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e7dc-2ce4-4c98-887e-6fb21c99e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:03.047908 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e7dc-2ce4-4c98-887e-6fb21c99e7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:03.068626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-2486e7dc-2ce4-4c98-887e-6fb21c99e7f3 None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:30:03.069931 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-2486e7dc-2ce4-4c98-887e-6fb21c99e7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:03.140920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1427/2854] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:30:03.151549 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:03.153100 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:03.218990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80818496-2e8c-4841-8bcb-7185597d7328 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:03.222854 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a69d0b-874a-4b52-9b2e-bc6ff903ca77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:03.223514 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a69d0b-874a-4b52-9b2e-bc6ff903ca77 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:03.223793 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a69d0b-874a-4b52-9b2e-bc6ff903ca77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:03.224072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a69d0b-874a-4b52-9b2e-bc6ff903ca77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:03.234828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a69d0b-874a-4b52-9b2e-bc6ff903ca77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:03.236329 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a69d0b-874a-4b52-9b2e-bc6ff903ca77 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:03.247311 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1428/2855] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:30:03.616110 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486e7dc-2ce4-4c98-887e-6fb21c99e7f3 None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:03.618660 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-2486e7dc-2ce4-4c98-887e-6fb21c99e7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:03.633875 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486e7dc-2ce4-4c98-887e-6fb21c99e7f3 None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:03.639473 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:03.640433 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:03.640712 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:03.640983 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f admin admin] PATH_INFO: `/v3/projects/d383046679e5465fbdd404a932e034ca` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:03.642846 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d383046679e5465fbdd404a932e034ca)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:03.644929 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:03.698160 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd383046679e5465fbdd404a932e034ca', 'request_id': 'req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:03.707475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd383046679e5465fbdd404a932e034ca', 'request_id': 'req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:03.713763 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd383046679e5465fbdd404a932e034ca', 'request_id': 'req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:03.726791 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f admin admin] The token cache is being invalidate because project d383046679e5465fbdd404a932e034ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:30:03.727123 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:03.728156 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1d33dba9-9cd2-4b6c-a69a-eba57061cb2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:03.730624 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1428/2856] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:30:03 2022] DELETE /identity/v3/projects/d383046679e5465fbdd404a932e034ca => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:30:03.736307 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503cd45-e182-44c7-b889-7a9035505b5b None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:03.736598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503cd45-e182-44c7-b889-7a9035505b5b None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:03.736900 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503cd45-e182-44c7-b889-7a9035505b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:03.757246 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-9503cd45-e182-44c7-b889-7a9035505b5b None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:30:03.758456 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-9503cd45-e182-44c7-b889-7a9035505b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:03.775980 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:03.837234 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1429/2857] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:30:03.903794 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dab29-1905-48c7-a583-72f25f816c6d None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:03.904063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dab29-1905-48c7-a583-72f25f816c6d None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:03.904382 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dab29-1905-48c7-a583-72f25f816c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:03.926733 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-524dab29-1905-48c7-a583-72f25f816c6d None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:30:03.927900 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-524dab29-1905-48c7-a583-72f25f816c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:03.936990 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1429/2858] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:30:03.941626 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503cd45-e182-44c7-b889-7a9035505b5b None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:03.952635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503cd45-e182-44c7-b889-7a9035505b5b None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:03.957724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a96099-3607-4bf0-863e-a4873ef63515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:03.958401 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a96099-3607-4bf0-863e-a4873ef63515 admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:03.958701 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a96099-3607-4bf0-863e-a4873ef63515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:03.958962 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a96099-3607-4bf0-863e-a4873ef63515 admin admin] PATH_INFO: `/v3/domains` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:03.959708 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a96099-3607-4bf0-863e-a4873ef63515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 07:30:03.960020 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a96099-3607-4bf0-863e-a4873ef63515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:03.961714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a96099-3607-4bf0-863e-a4873ef63515 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:03.974056 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1430/2859] 10.222.0.62 () {58 vars in 1152 bytes} [Thu Jul 7 07:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 07:30:03.978555 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dab29-1905-48c7-a583-72f25f816c6d None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:03.988418 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dab29-1905-48c7-a583-72f25f816c6d None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:03.996635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b753b8-ef36-4c1c-b2b4-e41fe111f9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:03.997380 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b753b8-ef36-4c1c-b2b4-e41fe111f9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:03.997672 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b753b8-ef36-4c1c-b2b4-e41fe111f9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:03.997946 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b753b8-ef36-4c1c-b2b4-e41fe111f9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:03.998860 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b753b8-ef36-4c1c-b2b4-e41fe111f9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:04.000878 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b753b8-ef36-4c1c-b2b4-e41fe111f9e2 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:04.030970 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1430/2860] 10.222.0.62 () {60 vars in 1152 bytes} [Thu Jul 7 07:30:03 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:30:04.035878 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a96099-3607-4bf0-863e-a4873ef63515 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:04.051427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a96099-3607-4bf0-863e-a4873ef63515 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:04.115612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7d355-fd36-461e-a521-01297a151efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:04.116297 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7d355-fd36-461e-a521-01297a151efb admin admin] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:04.116580 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7d355-fd36-461e-a521-01297a151efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:04.116856 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7d355-fd36-461e-a521-01297a151efb admin admin] PATH_INFO: `/v3/users` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:04.117582 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7d355-fd36-461e-a521-01297a151efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:04.119841 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7d355-fd36-461e-a521-01297a151efb admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:04.149075 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1431/2861] 10.222.0.62 () {60 vars in 1143 bytes} [Thu Jul 7 07:30:04 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 07:30:04.152349 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b753b8-ef36-4c1c-b2b4-e41fe111f9e2 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:04.164510 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b753b8-ef36-4c1c-b2b4-e41fe111f9e2 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:04.170089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d336de0-835a-4348-b929-e0d64f36562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:04.170744 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d336de0-835a-4348-b929-e0d64f36562c admin admin] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:04.171028 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d336de0-835a-4348-b929-e0d64f36562c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:04.171306 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d336de0-835a-4348-b929-e0d64f36562c admin admin] PATH_INFO: `/v3/roles` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:04.172037 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d336de0-835a-4348-b929-e0d64f36562c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:04.173981 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d336de0-835a-4348-b929-e0d64f36562c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:04.187314 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1431/2862] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:30:04.191948 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7d355-fd36-461e-a521-01297a151efb admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:04.204254 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7d355-fd36-461e-a521-01297a151efb admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:04.209676 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa9fae-e5c0-4e73-a910-d41a6d18562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:04.210439 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa9fae-e5c0-4e73-a910-d41a6d18562a admin admin] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:04.210630 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa9fae-e5c0-4e73-a910-d41a6d18562a admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:04.210930 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa9fae-e5c0-4e73-a910-d41a6d18562a admin admin] PATH_INFO: `/v3/roles` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:04.211671 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa9fae-e5c0-4e73-a910-d41a6d18562a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:04.213991 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa9fae-e5c0-4e73-a910-d41a6d18562a admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:04.225586 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1432/2863] 10.222.0.62 () {58 vars in 1121 bytes} [Thu Jul 7 07:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 07:30:04.230292 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d336de0-835a-4348-b929-e0d64f36562c admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:04.240967 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d336de0-835a-4348-b929-e0d64f36562c admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:04.246150 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fe828-68fe-4e94-8240-6d6bf25d8b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:04.247072 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fe828-68fe-4e94-8240-6d6bf25d8b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:04.247335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fe828-68fe-4e94-8240-6d6bf25d8b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:04.247603 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fe828-68fe-4e94-8240-6d6bf25d8b2b admin admin] PATH_INFO: `/v3/projects/d8abca76d27949458c35fa47aee8196c/users/cda50f3332bc48b3a32a7b849afa3c97/roles/118677ef2dfa4e808ddc78b083c01059` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:04.266081 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fe828-68fe-4e94-8240-6d6bf25d8b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8abca76d27949458c35fa47aee8196c, user_id=cda50f3332bc48b3a32a7b849afa3c97, role_id=118677ef2dfa4e808ddc78b083c01059)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:04.269449 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fe828-68fe-4e94-8240-6d6bf25d8b2b admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:04.288385 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1432/2864] 10.222.0.62 () {60 vars in 1482 bytes} [Thu Jul 7 07:30:04 2022] PUT /identity/v3/projects/d8abca76d27949458c35fa47aee8196c/users/cda50f3332bc48b3a32a7b849afa3c97/roles/118677ef2dfa4e808ddc78b083c01059 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:30:04.299315 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cb491-4a5e-42a8-abf5-05dd4bb335d7 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:04.299605 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cb491-4a5e-42a8-abf5-05dd4bb335d7 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:04.299887 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cb491-4a5e-42a8-abf5-05dd4bb335d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:04.331026 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-886cb491-4a5e-42a8-abf5-05dd4bb335d7 None None] MFA Rules not processed for user `cda50f3332bc48b3a32a7b849afa3c97`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:30:04.332968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-886cb491-4a5e-42a8-abf5-05dd4bb335d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:04.407367 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1433/2865] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:30:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:30:04.418506 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fe828-68fe-4e94-8240-6d6bf25d8b2b admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:04.420617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d40fe828-68fe-4e94-8240-6d6bf25d8b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:04.448552 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:04.494559 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fe828-68fe-4e94-8240-6d6bf25d8b2b admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:04.498253 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa397c8-1707-4c14-a072-92d86a4e8477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:04.498934 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa397c8-1707-4c14-a072-92d86a4e8477 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:04.499211 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa397c8-1707-4c14-a072-92d86a4e8477 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:04.499482 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa397c8-1707-4c14-a072-92d86a4e8477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:04.508526 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa397c8-1707-4c14-a072-92d86a4e8477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:04.510026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa397c8-1707-4c14-a072-92d86a4e8477 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:04.520330 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1433/2866] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:30:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:30:05.892323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4fd00-51c4-49a4-b92c-dbd119cc5cee None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:05.893003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4fd00-51c4-49a4-b92c-dbd119cc5cee None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:05.893003 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4fd00-51c4-49a4-b92c-dbd119cc5cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:05.915331 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-8ad4fd00-51c4-49a4-b92c-dbd119cc5cee None None] MFA Rules not processed for user `cda50f3332bc48b3a32a7b849afa3c97`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:30:05.916611 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8ad4fd00-51c4-49a4-b92c-dbd119cc5cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:05.924448 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1434/2867] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:30:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:30:05.966077 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa397c8-1707-4c14-a072-92d86a4e8477 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:05.967773 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-afa397c8-1707-4c14-a072-92d86a4e8477 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:06.038096 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa397c8-1707-4c14-a072-92d86a4e8477 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:06.042377 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb182c5-e46a-4756-b2e8-bffd567f84a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6af41d833941debd6afcecd952af0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:06.043032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb182c5-e46a-4756-b2e8-bffd567f84a9 service glance] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:06.043315 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb182c5-e46a-4756-b2e8-bffd567f84a9 service glance] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:06.043597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb182c5-e46a-4756-b2e8-bffd567f84a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:06.045597 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3fb182c5-e46a-4756-b2e8-bffd567f84a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:06.129974 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb182c5-e46a-4756-b2e8-bffd567f84a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:06.131438 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb182c5-e46a-4756-b2e8-bffd567f84a9 service glance] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:06.143688 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1434/2868] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:30:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:30:06.634328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4fd00-51c4-49a4-b92c-dbd119cc5cee None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:06.635847 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-8ad4fd00-51c4-49a4-b92c-dbd119cc5cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:06.652707 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:06.706697 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4fd00-51c4-49a4-b92c-dbd119cc5cee None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:06.710589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9be2d-3963-4809-b96c-fc03ce3afec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:06.711159 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9be2d-3963-4809-b96c-fc03ce3afec6 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:06.711828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9be2d-3963-4809-b96c-fc03ce3afec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:06.711828 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9be2d-3963-4809-b96c-fc03ce3afec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:06.713775 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0bd9be2d-3963-4809-b96c-fc03ce3afec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:06.731642 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9be2d-3963-4809-b96c-fc03ce3afec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:06.733563 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9be2d-3963-4809-b96c-fc03ce3afec6 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:06.746482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1435/2869] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:30:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:30:10.851759 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb182c5-e46a-4756-b2e8-bffd567f84a9 service glance] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:10.853465 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-3fb182c5-e46a-4756-b2e8-bffd567f84a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:10.931229 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb182c5-e46a-4756-b2e8-bffd567f84a9 service glance] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:10.937786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42537eba-d0fe-48ef-8020-271ab139abcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:10.937786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42537eba-d0fe-48ef-8020-271ab139abcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:10.937786 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42537eba-d0fe-48ef-8020-271ab139abcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:10.938200 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42537eba-d0fe-48ef-8020-271ab139abcc admin admin] PATH_INFO: `/v3/users/ba90d232c52145288745a765f6131023` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:10.939175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42537eba-d0fe-48ef-8020-271ab139abcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba90d232c52145288745a765f6131023)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:10.941121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42537eba-d0fe-48ef-8020-271ab139abcc admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:10.946232 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=100 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:10.997505 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-42537eba-d0fe-48ef-8020-271ab139abcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba90d232c52145288745a765f6131023'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:10.998175 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-42537eba-d0fe-48ef-8020-271ab139abcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba90d232c52145288745a765f6131023'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:10.998782 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-42537eba-d0fe-48ef-8020-271ab139abcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba90d232c52145288745a765f6131023'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:11.006743 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-42537eba-d0fe-48ef-8020-271ab139abcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba90d232c52145288745a765f6131023'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:11.015413 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-42537eba-d0fe-48ef-8020-271ab139abcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba90d232c52145288745a765f6131023'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:11.034371 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1435/2870] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:30:10 2022] DELETE /identity/v3/users/ba90d232c52145288745a765f6131023 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:30:11.224589 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9be2d-3963-4809-b96c-fc03ce3afec6 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:11.240175 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9be2d-3963-4809-b96c-fc03ce3afec6 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:11.309412 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:11.310314 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:11.310598 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:11.310876 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] PATH_INFO: `/v3/projects/322cc6f4005b49f1889dcc6dca8043f2` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:11.312206 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=322cc6f4005b49f1889dcc6dca8043f2)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:11.314552 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:11.384198 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '322cc6f4005b49f1889dcc6dca8043f2', 'request_id': 'req-0f811158-81e4-4b12-86cf-52f3310389a8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:11.406855 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '322cc6f4005b49f1889dcc6dca8043f2', 'request_id': 'req-0f811158-81e4-4b12-86cf-52f3310389a8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:11.421631 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '322cc6f4005b49f1889dcc6dca8043f2', 'request_id': 'req-0f811158-81e4-4b12-86cf-52f3310389a8'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:11.436719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] The token cache is being invalidate because project 322cc6f4005b49f1889dcc6dca8043f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:30:11.437058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:11.437788 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:11.439378 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1436/2871] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:30:11 2022] DELETE /identity/v3/projects/322cc6f4005b49f1889dcc6dca8043f2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:30:21.030167 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:21.431460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:21.439141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36333d1-44cb-4a9e-9d6b-2af33402d6f5 None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:21.439438 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36333d1-44cb-4a9e-9d6b-2af33402d6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:21.439718 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36333d1-44cb-4a9e-9d6b-2af33402d6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:21.458063 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-c36333d1-44cb-4a9e-9d6b-2af33402d6f5 None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:30:21.459289 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-c36333d1-44cb-4a9e-9d6b-2af33402d6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:21.517612 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1436/2872] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:30:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:30:21.573047 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:21.575013 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:21.648623 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f811158-81e4-4b12-86cf-52f3310389a8 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:21.654116 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce75e0-14e9-4aa2-b75a-7c52202e42f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:21.654770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce75e0-14e9-4aa2-b75a-7c52202e42f9 service swift] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:21.655045 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce75e0-14e9-4aa2-b75a-7c52202e42f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:21.655303 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce75e0-14e9-4aa2-b75a-7c52202e42f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:21.665072 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce75e0-14e9-4aa2-b75a-7c52202e42f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:21.666757 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce75e0-14e9-4aa2-b75a-7c52202e42f9 service swift] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:21.675909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1437/2873] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:30:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:30:22.214298 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1608646-f2d1-4740-9dce-1302c63fc3ea None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:22.214802 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1608646-f2d1-4740-9dce-1302c63fc3ea None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:22.214912 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1608646-f2d1-4740-9dce-1302c63fc3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:22.234296 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-a1608646-f2d1-4740-9dce-1302c63fc3ea None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:30:22.235520 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-a1608646-f2d1-4740-9dce-1302c63fc3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:22.244176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1437/2874] 10.222.0.62 () {58 vars in 967 bytes} [Thu Jul 7 07:30:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:30:22.256469 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce75e0-14e9-4aa2-b75a-7c52202e42f9 service swift] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:22.267797 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce75e0-14e9-4aa2-b75a-7c52202e42f9 service swift] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:22.273058 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1f466-5757-4f36-b918-aae6694c0a9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:22.273753 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1f466-5757-4f36-b918-aae6694c0a9c service swift] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:22.274030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1f466-5757-4f36-b918-aae6694c0a9c service swift] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:22.274409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1f466-5757-4f36-b918-aae6694c0a9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:22.282645 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1f466-5757-4f36-b918-aae6694c0a9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:22.284226 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1f466-5757-4f36-b918-aae6694c0a9c service swift] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:22.293183 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1438/2875] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:30:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:30:22.512909 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420da750-1ad6-4e2c-8f22-96a46b4f23fd None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:22.513203 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420da750-1ad6-4e2c-8f22-96a46b4f23fd None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:22.513531 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420da750-1ad6-4e2c-8f22-96a46b4f23fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:22.532849 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-420da750-1ad6-4e2c-8f22-96a46b4f23fd None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:30:22.534122 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-420da750-1ad6-4e2c-8f22-96a46b4f23fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:22.542602 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1438/2876] 10.222.0.62 () {58 vars in 1009 bytes} [Thu Jul 7 07:30:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:30:22.557811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1f466-5757-4f36-b918-aae6694c0a9c service swift] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:22.573050 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1f466-5757-4f36-b918-aae6694c0a9c service swift] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:22.581068 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c42028-e8ad-4517-a619-72bc3c41f735 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:22.581747 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c42028-e8ad-4517-a619-72bc3c41f735 service swift] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:22.582055 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c42028-e8ad-4517-a619-72bc3c41f735 service swift] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:22.582335 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c42028-e8ad-4517-a619-72bc3c41f735 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:22.592519 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c42028-e8ad-4517-a619-72bc3c41f735 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:22.594179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c42028-e8ad-4517-a619-72bc3c41f735 service swift] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:22.603032 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1439/2877] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:30:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:30:22.953513 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60199ac6-b5e2-4b15-88a3-af65cbbed57a None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:22.953809 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60199ac6-b5e2-4b15-88a3-af65cbbed57a None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:22.954094 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60199ac6-b5e2-4b15-88a3-af65cbbed57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:22.971958 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-60199ac6-b5e2-4b15-88a3-af65cbbed57a None None] MFA Rules not processed for user `5dbfbf3cbf304d8c85dabb7ad26380e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:30:22.973168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-60199ac6-b5e2-4b15-88a3-af65cbbed57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:22.981095 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1439/2878] 10.222.0.62 () {58 vars in 967 bytes} [Thu Jul 7 07:30:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:30:22.993731 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c42028-e8ad-4517-a619-72bc3c41f735 service swift] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:23.005133 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c42028-e8ad-4517-a619-72bc3c41f735 service swift] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:23.010719 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d95503-215f-43bc-880d-dab5871f2c10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16f8303298b04e009e22ea05ba24a3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:23.011373 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d95503-215f-43bc-880d-dab5871f2c10 service swift] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:23.011635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d95503-215f-43bc-880d-dab5871f2c10 service swift] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:23.011937 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d95503-215f-43bc-880d-dab5871f2c10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:23.020286 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d95503-215f-43bc-880d-dab5871f2c10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:23.022046 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d95503-215f-43bc-880d-dab5871f2c10 service swift] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:23.029968 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1440/2879] 10.222.0.62 () {60 vars in 1384 bytes} [Thu Jul 7 07:30:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 07:30:25.172917 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60199ac6-b5e2-4b15-88a3-af65cbbed57a None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:25.174491 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-60199ac6-b5e2-4b15-88a3-af65cbbed57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:25.242329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60199ac6-b5e2-4b15-88a3-af65cbbed57a None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:25.247927 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:25.248793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:25.249078 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:25.249397 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] PATH_INFO: `/v3/users/cda50f3332bc48b3a32a7b849afa3c97` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:25.250700 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda50f3332bc48b3a32a7b849afa3c97)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:25.252648 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:25.303757 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda50f3332bc48b3a32a7b849afa3c97'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:25.304439 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda50f3332bc48b3a32a7b849afa3c97'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:25.305079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda50f3332bc48b3a32a7b849afa3c97'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:25.312367 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda50f3332bc48b3a32a7b849afa3c97'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:25.320813 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda50f3332bc48b3a32a7b849afa3c97'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:25.338961 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1440/2880] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:30:25 2022] DELETE /identity/v3/users/cda50f3332bc48b3a32a7b849afa3c97 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:30:25.343665 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a61278-5c27-4798-bad1-c65f056aa8fe None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:25.344166 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a61278-5c27-4798-bad1-c65f056aa8fe None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:25.344270 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a61278-5c27-4798-bad1-c65f056aa8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:25.361956 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-02a61278-5c27-4798-bad1-c65f056aa8fe None None] MFA Rules not processed for user `a3aabddbd41c4280b0867d9e10f45bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:30:25.363188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-02a61278-5c27-4798-bad1-c65f056aa8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:25.434323 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1441/2881] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:30:25.444069 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:25.445536 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:25.452207 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:25.505952 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175101e-0f10-4e70-ba3c-ba0dba99b6a6 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:25.510275 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb78ca-ec63-43fc-bf8e-9f77eedb6769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:25.510968 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb78ca-ec63-43fc-bf8e-9f77eedb6769 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:25.511248 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb78ca-ec63-43fc-bf8e-9f77eedb6769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:25.511533 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb78ca-ec63-43fc-bf8e-9f77eedb6769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:25.522089 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb78ca-ec63-43fc-bf8e-9f77eedb6769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:25.523689 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb78ca-ec63-43fc-bf8e-9f77eedb6769 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:25.533770 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1441/2882] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:30:25.726860 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a61278-5c27-4798-bad1-c65f056aa8fe None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:30:25.728460 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-02a61278-5c27-4798-bad1-c65f056aa8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:30:25.743424 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a61278-5c27-4798-bad1-c65f056aa8fe None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:30:25.753635 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:30:25.754604 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:30:25.754883 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:30:25.755170 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] PATH_INFO: `/v3/projects/d8abca76d27949458c35fa47aee8196c` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:30:25.756770 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8abca76d27949458c35fa47aee8196c)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:30:25.758679 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:30:25.807546 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:25.810330 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8abca76d27949458c35fa47aee8196c', 'request_id': 'req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:25.817018 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8abca76d27949458c35fa47aee8196c', 'request_id': 'req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:25.824562 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8abca76d27949458c35fa47aee8196c', 'request_id': 'req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:25.836318 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] The token cache is being invalidate because project d8abca76d27949458c35fa47aee8196c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:30:25.836615 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:25.837362 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:30:25.839033 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1442/2883] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:30:25 2022] DELETE /identity/v3/projects/d8abca76d27949458c35fa47aee8196c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:30:35.529320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=24 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:35.833127 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:31:16.000320 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb78ca-ec63-43fc-bf8e-9f77eedb6769 service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:31:16.002186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-69bb78ca-ec63-43fc-bf8e-9f77eedb6769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:31:16.015181 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb78ca-ec63-43fc-bf8e-9f77eedb6769 service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:31:16.071591 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0e6af-cb17-4e30-99d3-6340e026dd84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:31:16.072241 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0e6af-cb17-4e30-99d3-6340e026dd84 service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:31:16.072518 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0e6af-cb17-4e30-99d3-6340e026dd84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:31:16.072816 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0e6af-cb17-4e30-99d3-6340e026dd84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:31:16.074740 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-0dd0e6af-cb17-4e30-99d3-6340e026dd84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:31:16.086964 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0e6af-cb17-4e30-99d3-6340e026dd84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:31:16.089255 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0e6af-cb17-4e30-99d3-6340e026dd84 service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:31:16.102124 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1442/2884] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:31:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:31:26.096329 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=26 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:31:38.836800 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:31:38.838298 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:31:38.921544 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d016f5-d1f4-4653-91b7-ce89e0a40a88 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:31:38.927850 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696feb2-ccd5-4bff-9018-f406dc5fc56f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:31:38.928541 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696feb2-ccd5-4bff-9018-f406dc5fc56f service nova] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:31:38.928821 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696feb2-ccd5-4bff-9018-f406dc5fc56f service nova] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:31:38.929093 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696feb2-ccd5-4bff-9018-f406dc5fc56f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:31:38.930982 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1696feb2-ccd5-4bff-9018-f406dc5fc56f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:31:38.944978 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696feb2-ccd5-4bff-9018-f406dc5fc56f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:31:38.946659 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696feb2-ccd5-4bff-9018-f406dc5fc56f service nova] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:31:38.958265 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1443/2885] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:31:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:31:40.377335 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d3b38-b032-4c89-a2b5-717c4db5155f None None] REQUEST_METHOD: `POST` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:31:40.377924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d3b38-b032-4c89-a2b5-717c4db5155f None None] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:31:40.377924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d3b38-b032-4c89-a2b5-717c4db5155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:31:40.396266 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.auth.core [None req-829d3b38-b032-4c89-a2b5-717c4db5155f None None] MFA Rules not processed for user `63d931e360f94cf78880ec2f2970a066`. Rule list: `[]` (Enabled: `True`). {{(pid=80278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:31:40.397502 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-829d3b38-b032-4c89-a2b5-717c4db5155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:31:40.460402 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1443/2886] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:31:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:31:42.295169 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696feb2-ccd5-4bff-9018-f406dc5fc56f service nova] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:31:42.296925 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1696feb2-ccd5-4bff-9018-f406dc5fc56f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:31:42.373030 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696feb2-ccd5-4bff-9018-f406dc5fc56f service nova] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:31:42.381687 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f6a20-2226-4bac-909f-010ec43f0f98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:31:42.382369 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6a20-2226-4bac-909f-010ec43f0f98 service placement] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:31:42.382673 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6a20-2226-4bac-909f-010ec43f0f98 service placement] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:31:42.382967 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6a20-2226-4bac-909f-010ec43f0f98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:31:42.384852 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1a1f6a20-2226-4bac-909f-010ec43f0f98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:31:42.397764 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f6a20-2226-4bac-909f-010ec43f0f98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:31:42.399409 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f6a20-2226-4bac-909f-010ec43f0f98 service placement] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:31:42.416210 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1444/2887] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:31:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:31:50.453618 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=25 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:31:52.412156 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=66 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:31:59.168032 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d3b38-b032-4c89-a2b5-717c4db5155f None None] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:31:59.170015 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-829d3b38-b032-4c89-a2b5-717c4db5155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:31:59.198192 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d3b38-b032-4c89-a2b5-717c4db5155f None None] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:31:59.204920 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792d0d4-1baf-4be9-8a62-b5beb3f40509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:31:59.205635 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d0d4-1baf-4be9-8a62-b5beb3f40509 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:31:59.205915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d0d4-1baf-4be9-8a62-b5beb3f40509 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:31:59.206381 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d0d4-1baf-4be9-8a62-b5beb3f40509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:31:59.208677 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7792d0d4-1baf-4be9-8a62-b5beb3f40509 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:31:59.222276 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792d0d4-1baf-4be9-8a62-b5beb3f40509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:31:59.223828 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792d0d4-1baf-4be9-8a62-b5beb3f40509 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:31:59.236789 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1444/2888] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:31:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:32:09.231079 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=6 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:33:27.358084 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f6a20-2226-4bac-909f-010ec43f0f98 service placement] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:33:27.359745 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-1a1f6a20-2226-4bac-909f-010ec43f0f98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:33:27.457364 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f6a20-2226-4bac-909f-010ec43f0f98 service placement] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:33:27.463121 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ccd32-85e3-432e-8554-7937ec31a00e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:33:27.463777 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ccd32-85e3-432e-8554-7937ec31a00e service placement] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:33:27.464067 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ccd32-85e3-432e-8554-7937ec31a00e service placement] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:33:27.464346 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ccd32-85e3-432e-8554-7937ec31a00e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:33:27.466236 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-838ccd32-85e3-432e-8554-7937ec31a00e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:33:27.478431 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ccd32-85e3-432e-8554-7937ec31a00e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:33:27.480054 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ccd32-85e3-432e-8554-7937ec31a00e service placement] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:33:27.491327 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1445/2889] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:33:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:33:33.165578 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792d0d4-1baf-4be9-8a62-b5beb3f40509 service nova] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:33:33.167247 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-7792d0d4-1baf-4be9-8a62-b5beb3f40509 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:33:33.255888 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792d0d4-1baf-4be9-8a62-b5beb3f40509 service nova] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:33:33.260538 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a9718-d121-46d5-bc1f-d5be7af0e7b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7af6f0c53d4c599f5dd80150b4a22e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:33:33.261195 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a9718-d121-46d5-bc1f-d5be7af0e7b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:33:33.261525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a9718-d121-46d5-bc1f-d5be7af0e7b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:33:33.261809 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a9718-d121-46d5-bc1f-d5be7af0e7b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:33:33.263715 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-8a3a9718-d121-46d5-bc1f-d5be7af0e7b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:33:33.275209 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a9718-d121-46d5-bc1f-d5be7af0e7b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:33:33.276668 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a9718-d121-46d5-bc1f-d5be7af0e7b6 service cinder] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:33:33.286748 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1445/2890] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:33:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:33:37.487344 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=37 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:33:41.244491 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b018a1-39d9-4841-a6ba-25f24d759a26 None None] REQUEST_METHOD: `POST` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:33:41.245179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b018a1-39d9-4841-a6ba-25f24d759a26 None None] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:33:41.245179 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b018a1-39d9-4841-a6ba-25f24d759a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:33:41.263612 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.auth.core [None req-c7b018a1-39d9-4841-a6ba-25f24d759a26 None None] MFA Rules not processed for user `63d931e360f94cf78880ec2f2970a066`. Rule list: `[]` (Enabled: `True`). {{(pid=80277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 07:33:41.264858 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c7b018a1-39d9-4841-a6ba-25f24d759a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:33:41.272911 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1446/2891] 10.222.0.62 () {58 vars in 957 bytes} [Thu Jul 7 07:33:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 07:33:43.281890 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=39 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:33:51.258095 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=3 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:35:40.193141 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a9718-d121-46d5-bc1f-d5be7af0e7b6 service cinder] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:35:40.234339 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a9718-d121-46d5-bc1f-d5be7af0e7b6 service cinder] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:35:40.243176 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4109b04-1d95-4a9c-ac9c-e96084fc9ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42acdb53c342401da6b32be6b9f3d030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:35:40.244390 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4109b04-1d95-4a9c-ac9c-e96084fc9ce4 service nova] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:35:40.244924 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4109b04-1d95-4a9c-ac9c-e96084fc9ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:35:40.245525 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4109b04-1d95-4a9c-ac9c-e96084fc9ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:35:40.248680 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-d4109b04-1d95-4a9c-ac9c-e96084fc9ce4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:35:40.281485 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4109b04-1d95-4a9c-ac9c-e96084fc9ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:35:40.283710 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4109b04-1d95-4a9c-ac9c-e96084fc9ce4 service nova] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:35:40.296926 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1446/2892] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:35:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:35:40.408059 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b018a1-39d9-4841-a6ba-25f24d759a26 None None] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:35:40.409804 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-c7b018a1-39d9-4841-a6ba-25f24d759a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:35:40.448289 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b018a1-39d9-4841-a6ba-25f24d759a26 None None] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:35:40.455994 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eeb52-09fb-46ad-b52a-c4246f126f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:35:40.457667 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eeb52-09fb-46ad-b52a-c4246f126f52 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:35:40.458089 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eeb52-09fb-46ad-b52a-c4246f126f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:35:40.459975 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eeb52-09fb-46ad-b52a-c4246f126f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:35:40.462997 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2c6eeb52-09fb-46ad-b52a-c4246f126f52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:35:40.480120 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6eeb52-09fb-46ad-b52a-c4246f126f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:35:40.481724 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6eeb52-09fb-46ad-b52a-c4246f126f52 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:35:40.494778 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1447/2893] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:35:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:35:41.701720 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4109b04-1d95-4a9c-ac9c-e96084fc9ce4 service nova] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:35:41.712705 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4109b04-1d95-4a9c-ac9c-e96084fc9ce4 service nova] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:35:41.717918 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567bfa0-da9d-406c-a997-e2d55b62fe7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:35:41.718626 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567bfa0-da9d-406c-a997-e2d55b62fe7d service neutron] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:35:41.718915 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567bfa0-da9d-406c-a997-e2d55b62fe7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:35:41.720550 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567bfa0-da9d-406c-a997-e2d55b62fe7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:35:41.723012 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-f567bfa0-da9d-406c-a997-e2d55b62fe7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:35:41.738017 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567bfa0-da9d-406c-a997-e2d55b62fe7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:35:41.739493 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567bfa0-da9d-406c-a997-e2d55b62fe7d service neutron] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:35:41.757530 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1447/2894] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:35:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:35:50.488848 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=15 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:35:51.746640 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=24 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:35:54.458132 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eeb52-09fb-46ad-b52a-c4246f126f52 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:35:54.459632 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2c6eeb52-09fb-46ad-b52a-c4246f126f52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:35:54.471714 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eeb52-09fb-46ad-b52a-c4246f126f52 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:35:54.475461 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec838b-636f-4cfe-bd89-810c7c72ccd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d0c6b46b5d248e5bed2b1bbdfa74f59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:35:54.476158 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec838b-636f-4cfe-bd89-810c7c72ccd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:35:54.476444 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec838b-636f-4cfe-bd89-810c7c72ccd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:35:54.476722 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec838b-636f-4cfe-bd89-810c7c72ccd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:35:54.478484 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a0ec838b-636f-4cfe-bd89-810c7c72ccd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:35:54.586477 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec838b-636f-4cfe-bd89-810c7c72ccd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:35:54.587939 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec838b-636f-4cfe-bd89-810c7c72ccd2 service neutron] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:35:54.608748 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1448/2895] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:35:57.977114 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567bfa0-da9d-406c-a997-e2d55b62fe7d service neutron] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:35:57.990960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567bfa0-da9d-406c-a997-e2d55b62fe7d service neutron] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:35:57.997094 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a2fa7-9a29-4d10-8242-50dae502a731 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:35:57.997793 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a2fa7-9a29-4d10-8242-50dae502a731 service placement] REQUEST_METHOD: `GET` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:35:57.998075 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a2fa7-9a29-4d10-8242-50dae502a731 service placement] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:35:57.998355 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a2fa7-9a29-4d10-8242-50dae502a731 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:35:58.000244 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-bd6a2fa7-9a29-4d10-8242-50dae502a731 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:35:58.013705 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a2fa7-9a29-4d10-8242-50dae502a731 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:35:58.015403 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a2fa7-9a29-4d10-8242-50dae502a731 service placement] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:35:58.028162 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1448/2896] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:35:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:36:01.472804 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec838b-636f-4cfe-bd89-810c7c72ccd2 service neutron] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:36:01.474353 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-a0ec838b-636f-4cfe-bd89-810c7c72ccd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:36:01.491328 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec838b-636f-4cfe-bd89-810c7c72ccd2 service neutron] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:36:01.496124 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:36:01.497042 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:36:01.497427 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:36:01.497698 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] PATH_INFO: `/v3/users/63d931e360f94cf78880ec2f2970a066` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:36:01.498909 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d931e360f94cf78880ec2f2970a066)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:36:01.500905 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:36:01.549153 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d931e360f94cf78880ec2f2970a066'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:01.549877 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d931e360f94cf78880ec2f2970a066'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:01.550471 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d931e360f94cf78880ec2f2970a066'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:01.557352 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d931e360f94cf78880ec2f2970a066'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:01.566103 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d931e360f94cf78880ec2f2970a066'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:01.585931 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1449/2897] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:36:01 2022] DELETE /identity/v3/users/63d931e360f94cf78880ec2f2970a066 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:36:01.771655 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a2fa7-9a29-4d10-8242-50dae502a731 service placement] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:36:01.783026 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a2fa7-9a29-4d10-8242-50dae502a731 service placement] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:36:01.842539 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:36:01.843419 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:36:01.843704 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:36:01.843996 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] PATH_INFO: `/v3/projects/aafd6d9a6d134f538a61498790991c0c` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:36:01.845198 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aafd6d9a6d134f538a61498790991c0c)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:36:01.847205 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:36:01.895305 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aafd6d9a6d134f538a61498790991c0c', 'request_id': 'req-177dd582-e660-4354-b3bd-586b1dbc3431'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:01.903392 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aafd6d9a6d134f538a61498790991c0c', 'request_id': 'req-177dd582-e660-4354-b3bd-586b1dbc3431'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:01.910729 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aafd6d9a6d134f538a61498790991c0c', 'request_id': 'req-177dd582-e660-4354-b3bd-586b1dbc3431'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:01.922850 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] The token cache is being invalidate because project aafd6d9a6d134f538a61498790991c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:36:01.923142 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:01.923800 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:01.925435 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1449/2898] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:36:01 2022] DELETE /identity/v3/projects/aafd6d9a6d134f538a61498790991c0c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:36:01.929498 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:36:01.930917 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:36:01.944449 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69290a-d9f7-4a38-a398-388628027a33 admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:36:01.977572 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:36:02.010490 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:36:02.011857 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:36:02.012233 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:36:02.012618 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] PATH_INFO: `/v3/users/5f339204d14e4043aeb4d4811ceab07c` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:36:02.014756 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f339204d14e4043aeb4d4811ceab07c)` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:36:02.017990 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:36:02.087510 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f339204d14e4043aeb4d4811ceab07c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:02.088187 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f339204d14e4043aeb4d4811ceab07c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:02.088817 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f339204d14e4043aeb4d4811ceab07c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:02.096361 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f339204d14e4043aeb4d4811ceab07c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:02.104811 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.notifications [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f339204d14e4043aeb4d4811ceab07c'} {{(pid=80277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:02.123207 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1450/2899] 10.222.0.62 () {58 vars in 1223 bytes} [Thu Jul 7 07:36:01 2022] DELETE /identity/v3/users/5f339204d14e4043aeb4d4811ceab07c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:36:02.313960 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] Authenticating user token {{(pid=80278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:36:02.315617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.fernet_utils [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:36:02.331511 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dd582-e660-4354-b3bd-586b1dbc3431 admin admin] Validating token access rules against request {{(pid=80278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:36:02.390713 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb622c34-dc43-4226-87db-c708db38c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aabddbd41c4280b0867d9e10f45bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5d565ccc8d74ff1978b89c064272f84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:36:02.391617 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb622c34-dc43-4226-87db-c708db38c98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:36:02.391902 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb622c34-dc43-4226-87db-c708db38c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:36:02.392168 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb622c34-dc43-4226-87db-c708db38c98c admin admin] PATH_INFO: `/v3/projects/b871f9f08b4d4b65b462c28e0d4df924` {{(pid=80278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:36:02.393475 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb622c34-dc43-4226-87db-c708db38c98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b871f9f08b4d4b65b462c28e0d4df924)` {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:36:02.395695 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb622c34-dc43-4226-87db-c708db38c98c admin admin] RBAC: Authorization granted {{(pid=80278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:36:02.423484 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:36:02.456186 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fb622c34-dc43-4226-87db-c708db38c98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b871f9f08b4d4b65b462c28e0d4df924', 'request_id': 'req-fb622c34-dc43-4226-87db-c708db38c98c'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:02.465430 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fb622c34-dc43-4226-87db-c708db38c98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b871f9f08b4d4b65b462c28e0d4df924', 'request_id': 'req-fb622c34-dc43-4226-87db-c708db38c98c'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:02.471684 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fb622c34-dc43-4226-87db-c708db38c98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b871f9f08b4d4b65b462c28e0d4df924', 'request_id': 'req-fb622c34-dc43-4226-87db-c708db38c98c'} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:02.489618 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fb622c34-dc43-4226-87db-c708db38c98c admin admin] The token cache is being invalidate because project b871f9f08b4d4b65b462c28e0d4df924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 07:36:02.490121 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fb622c34-dc43-4226-87db-c708db38c98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:02.491172 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG keystone.notifications [None req-fb622c34-dc43-4226-87db-c708db38c98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 07:36:02.494295 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: [pid: 80278|app: 0|req: 1450/2900] 10.222.0.62 () {58 vars in 1232 bytes} [Thu Jul 7 07:36:02 2022] DELETE /identity/v3/projects/b871f9f08b4d4b65b462c28e0d4df924 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 07:36:12.119539 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:36:12.483610 dv-cinder-826608-5-iscsi devstack@keystone.service[80278]: DEBUG dbcounter [-] [80278] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:38:33.262354 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] Authenticating user token {{(pid=80277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 07:38:33.264188 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:38:33.345929 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69e3b9-abe7-4c1b-8b14-4552b8b8b8de admin admin] Validating token access rules against request {{(pid=80277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 07:38:33.421813 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4c942-256e-44bf-90b6-4a2db93d995b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd80f27a4499407d8c350f2908638334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d7163b6caf648d89fd2cd48f27b1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 07:38:33.422482 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4c942-256e-44bf-90b6-4a2db93d995b service placement] REQUEST_METHOD: `GET` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 07:38:33.422767 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4c942-256e-44bf-90b6-4a2db93d995b service placement] SCRIPT_NAME: `/identity` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 07:38:33.423046 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4c942-256e-44bf-90b6-4a2db93d995b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 07:38:33.424943 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.fernet_utils [None req-eca4c942-256e-44bf-90b6-4a2db93d995b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 07:38:33.436993 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4c942-256e-44bf-90b6-4a2db93d995b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 07:38:33.438644 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4c942-256e-44bf-90b6-4a2db93d995b service placement] RBAC: Authorization granted {{(pid=80277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 07:38:33.449063 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: [pid: 80277|app: 0|req: 1451/2901] 10.222.0.62 () {60 vars in 1365 bytes} [Thu Jul 7 07:38:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 07:38:43.444723 dv-cinder-826608-5-iscsi devstack@keystone.service[80277]: DEBUG dbcounter [-] [80277] Writing DB stats keystone:SELECT=58 {{(pid=80277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}